{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,16]],"date-time":"2026-11-16T18:38:43Z","timestamp":1794854323797,"version":"4.9.1"},"reference-count":105,"publisher":"SAGE Publications","issue":"2","license":[{"start":{"date-parts":[[2025,4,1]],"date-time":"2025-04-01T00:00:00Z","timestamp":1743465600000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2025,4,1]],"date-time":"2025-04-01T00:00:00Z","timestamp":1743465600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"funder":[{"name":"UM International Collaboration Grant","award":["ST080-2022"],"award-info":[{"award-number":["ST080-2022"]}]}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Sage Open"],"published-print":{"date-parts":[[2025,4]]},"abstract":"<jats:p>Legal Judgment Prediction (LJP) study is experiencing a growing need for automating legal judgment process to predict court decisions. In this context, the present paper provides a systematic literature review of previous LJP study, implementing machine learning (ML) as decision-making and natural language processing (NLP) to extract information from legal judgment documents. Relevant articles were found in reputable indexing databases through the search strategy, with the outcomes filtered by applying inclusion and exclusion criteria. Furthermore, six research questions were constructed to observe the datasets, topics\/trends, NLP and ML methods, evaluation methods, and challenges. The LJP topic included three topics which were charge, law article, and term-of-penalty prediction. There were 21 NLP methods applied, emphasizing the highest implementation of Term Frequency-Inverse Document Frequency (TF-IDF) while the most implemented ML method was Support Vector Machine (SVM). Accuracy was the most used metric as an evaluation method. Additionally, this work emphasizes the importance of LJP and the potential use of NLP and ML. This study urges further investigation into NLP and ML, as well as practical uses of LJP. Low classification performance, low quantity of data, imbalanced dataset, data accessibility, data labeling, extraction of semantic information from natural language, expert involvement, generalizability issue, and multilingual datasets represent a few of the major problems that LJP faces, and the study is significant because it clarifies some of the major issues that LJP faces. Among those problems, low amounts of dataset and low classification performance were regarded as the most challenging tasks to deal with.<\/jats:p>","DOI":"10.1177\/21582440251329663","type":"journal-article","created":{"date-parts":[[2025,6,25]],"date-time":"2025-06-25T02:58:35Z","timestamp":1750820315000},"update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":18,"title":["Legal Judgment Prediction using Natural Language Processing and Machine Learning Methods: A Systematic Literature Review"],"prefix":"10.1177","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8560-8626","authenticated-orcid":false,"given":"Nasa Zata","family":"Dina","sequence":"first","affiliation":[{"name":"Universiti Malaya, Kuala Lumpur, Malaysia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5637-9158","authenticated-orcid":false,"given":"Sri Devi","family":"Ravana","sequence":"additional","affiliation":[{"name":"Universiti Malaya, Kuala Lumpur, Malaysia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Norisma","family":"Idris","sequence":"additional","affiliation":[{"name":"Universiti Malaya, Kuala Lumpur, Malaysia"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","published-online":{"date-parts":[[2025,4,21]]},"reference":[{"key":"e_1_3_3_2_1","doi-asserted-by":"crossref","unstructured":"Acharya H. R. Bhat A. D. Avinash K. Srinath R. (2020). LegoNet-classification and extractive summarization of Indian legal judgments with capsule networks and sentence embeddings. Journal of Intelligent & Fuzzy Systems 39(2) 2037-2046. https:\/\/doi.org\/10.3233\/JIFS-179870","DOI":"10.3233\/JIFS-179870"},{"key":"e_1_3_3_3_1","doi-asserted-by":"crossref","unstructured":"Aletras N. Tsarapatsanis D. Preo\u0327tiuc-Pietro D. Lampos V. (2016). Predicting judicial decisions of the European Court of human rights: A natural language processing perspective. PeerJ Computure Science 2 e93. https:\/\/doi.org\/10.7717\/peerj-cs.93","DOI":"10.7717\/peerj-cs.93"},{"key":"e_1_3_3_4_1","doi-asserted-by":"crossref","unstructured":"Al-Garadi M. A. Yang Y. C. Sarker A. (2022). The role of natural language processing during the COVID-19 pandemic: Health applications opportunities and challenges. Healthcare 10(11) 2270. https:\/\/doi.org\/10.3390\/healthcare10112270.","DOI":"10.3390\/healthcare10112270"},{"key":"e_1_3_3_5_1","doi-asserted-by":"crossref","unstructured":"Almuslim Inkpen D. (2022). Legal judgment prediction for Canadian appeal cases. In 7th International conference on data science and machine learning applications (CDMA) (pp. 163\u2013168). IEEE. https:\/\/doi.org\/10.1109\/CDMA54072.2022.00032","DOI":"10.1109\/CDMA54072.2022.00032"},{"key":"e_1_3_3_6_1","doi-asserted-by":"crossref","unstructured":"Amin A. Anwar S. Adnan A. Nawaz M. Howard N. Qadir J. Hawalah A. Hussain A. (2016). Comparing oversampling techniques to handle the class imbalance problem: A customer churn prediction case study. IEEE Access 4 7940\u20137957. https:\/\/doi.org\/10.1109\/ACCESS.2016.2619719","DOI":"10.1109\/ACCESS.2016.2619719"},{"key":"e_1_3_3_7_1","unstructured":"Angelo T. (2016). Mauritius: \u2018capitulation consolidation creation\u2019 in a study of mixed legal systems: Endangered entrenched or blended. Ashgate."},{"key":"e_1_3_3_8_1","doi-asserted-by":"crossref","unstructured":"Badampudi D. Wohlin C. Petersen K. (2015). Experiences from using snowballing and database searches in systematic literature studies. In EASE \u201815: Proceedings of the 19th international conference on evaluation and assessment in software engineering (pp. 1\u201310). Association for Computing Machinery. https:\/\/doi.org\/10.1145\/2745802.2745818","DOI":"10.1145\/2745802.2745818"},{"key":"e_1_3_3_9_1","doi-asserted-by":"crossref","unstructured":"Bhagat S. K. Tiyasha T. Awadh S. M. Tung T. M. Jawad A. H. Yaseen Z. M. (2021). Prediction of sediment heavy metal at the Australian Bays using newly developed hybrid artificial intelligence models. Environmental Pollution 268 115663. https:\/\/doi.org\/10.1016\/j.envpol.2020.115663","DOI":"10.1016\/j.envpol.2020.115663"},{"issue":"3","key":"e_1_3_3_10_1","first-page":"326","article-title":"Predicting outcome of judicial cases and analysis using machine learning","volume":"6","author":"Bhilare N. P.","year":"2019","unstructured":"Bhilare N. P., Parab N. S., Thakur B. (2019). Predicting outcome of judicial cases and analysis using machine learning. International Research Journal of Engineering and Technology, 6(3), 326\u2013330.","journal-title":"International Research Journal of Engineering and Technology"},{"key":"e_1_3_3_11_1","unstructured":"Binns R. (2018). Fairness in machine learning: Lessons from political philosophy. In Proceedings of the 2018 Conference on Fairness Accountability and Transparency (pp. 149\u2013159). https:\/\/proceedings.mlr.press\/v81\/binns18a.html"},{"key":"e_1_3_3_12_1","unstructured":"Blei D. M. Ng A. Y. Jordan M. I. (2003). Latent dirichlet allocation. Journal of Machine Learning Research 3 993\u20131022. https:\/\/doi.org\/10.5555\/944919.944937"},{"key":"e_1_3_3_13_1","volume-title":"Systematic approaches to a successful literature review","author":"Booth A.","year":"2016","unstructured":"Booth A., Sutton A., Papaioannou D. (2016). Systematic approaches to a successful literature review. Sage Publishing."},{"key":"e_1_3_3_14_1","doi-asserted-by":"crossref","unstructured":"Breiman L. (2001). Random forests. Machine Learning 45 5\u201332. https:\/\/doi.org\/10.1023\/A:1010933404324","DOI":"10.1023\/A:1010933404324"},{"key":"e_1_3_3_15_1","doi-asserted-by":"crossref","unstructured":"Cambria E. White B. (2014). Jumping NLP curves: A review of natural language processing research. IEEE Computational Intelligence Magazine 9(2) 48\u201357. https:\/\/doi.org\/10.1109\/MCI.2014.2307227","DOI":"10.1109\/MCI.2014.2307227"},{"key":"e_1_3_3_16_1","doi-asserted-by":"crossref","unstructured":"Castro A. P. Wainer G. A. Calixto W. P. (2022). Weighting construction by bag-of-words with similarity-learning and supervised training for classification models in court text documents. Applied Soft Computing 124 108987. https:\/\/doi.org\/10.1016\/j.asoc.2022.108987","DOI":"10.1016\/j.asoc.2022.108987"},{"key":"e_1_3_3_17_1","unstructured":"Chalkidis I. (2018). Law2Vec: Legal Word Embeddings. https:\/\/archive.org\/details\/Law2Vec"},{"key":"e_1_3_3_18_1","doi-asserted-by":"crossref","unstructured":"Chalkidis I. Fergadiotis E. Malakasiotis P. Androutsopoulos I. (2019a). Large-scale multi-label text classification on EU legislation. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics. https:\/\/doi.org\/10.18653\/v1\/P19-1636","DOI":"10.18653\/v1\/P19-1636"},{"key":"e_1_3_3_19_1","doi-asserted-by":"crossref","unstructured":"Chalkidis I. Androutsopoulos I. Aletras N. (2019b). Neural legal judgment prediction in English. In Proceedings of the 57th annual meeting of the association for computational linguistics (pp. 4317\u20134323). Association for Computational Linguistics. https:\/\/doi.org\/10.18653\/v1\/P19-1424","DOI":"10.18653\/v1\/P19-1424"},{"key":"e_1_3_3_20_1","doi-asserted-by":"crossref","unstructured":"Chalkidis I. Fergadiotis M. Tsarapatsanis D. Aletras N. Androutsopoulos I. Malakasiotis P. (2021). Paragraph-level rationale extraction through regularization: A case study on European court of human rights cases. In Proceedings of the 2021 conference of the North American chapter of the association for computational linguistics: Human language technologies (pp. 226\u2013241). Association for Computational Linguistics. https:\/\/doi.org\/10.18653\/v1\/2021.naacl-main.22","DOI":"10.18653\/v1\/2021.naacl-main.22"},{"key":"e_1_3_3_21_1","doi-asserted-by":"crossref","unstructured":"Chawla N. V. Bowyer K. W. Hall L. O. Kegelmeyer W. P. (2002). SMOTE: Synthetic minority over-sampling technique. Journal of Artificial Intelligence Research 16 321\u2013357. https:\/\/doi.org\/10.1613\/jair.953","DOI":"10.1613\/jair.953"},{"key":"e_1_3_3_22_1","doi-asserted-by":"crossref","unstructured":"Chen D. L. Eagel J. (2017). Can machine learning help predict the outcome of asylum adjudications? In Proceedings of the 16th Edition of the International Conference on Articial Intelligence and Law (pp. 237\u2013240). https:\/\/doi.org\/10.1145\/3086512.3086538","DOI":"10.1145\/3086512.3086538"},{"key":"e_1_3_3_23_1","doi-asserted-by":"crossref","unstructured":"Cortes C. Vapnik V. (1995). Support-vector networks. Machine Learning 20(3) 273\u2013297. http:\/\/dx.doi.org\/10.1007\/BF00994018","DOI":"10.1023\/A:1022627411411"},{"issue":"4","key":"e_1_3_3_24_1","first-page":"243","article-title":"Legal judgment prediction: An overview and future directions","volume":"53","author":"Coyle K.","year":"2020","unstructured":"Coyle K., Hwang J. (2020). Legal judgment prediction: An overview and future directions. Artificial Intelligence Review, 53(4), 243\u2013247.","journal-title":"Artificial Intelligence Review"},{"key":"e_1_3_3_25_1","doi-asserted-by":"crossref","unstructured":"Degani T. Tokowicz N. (2010). Semantic ambiguity within and across languages: An integrative review. Quarterly Journal of Experimental Psychology 63(7) 1266\u20131303. https:\/\/doi.org\/10.1080\/17470210903377372","DOI":"10.1080\/17470210903377372"},{"key":"e_1_3_3_26_1","doi-asserted-by":"crossref","unstructured":"Dina N. Z. Triwastuti R. Silfiani M. (2021). TF-IDF decision matrix to measure customers\u2019 satisfaction of ride hailing mobile application services: Multi-criteria decision-making approach. International Journal of Interactive Mobile Technologies 15(17) 104\u2013118. https:\/\/doi.org\/10.3991\/ijim.v15i17.22509","DOI":"10.3991\/ijim.v15i17.22509"},{"key":"e_1_3_3_27_1","doi-asserted-by":"crossref","unstructured":"Dina N. Z. Juniarta N. (2022). Deriving customers preferences for hotels from unstructured data. Geojournal of Tourism and Geosites 43(3) 872\u2013877. https:\/\/doi.org\/10.30892\/gtg.43305-899","DOI":"10.30892\/gtg.43305-899"},{"key":"e_1_3_3_28_1","doi-asserted-by":"crossref","unstructured":"Edmond G. Martire K. San Roque M. Mehera. (2017). Expert reports and forensic sciences. UNSW Law Journal 40(2) 590\u2013637. https:\/\/doi.org\/10.53637\/IPWZ9949","DOI":"10.53637\/IPWZ9949"},{"key":"e_1_3_3_29_1","doi-asserted-by":"crossref","unstructured":"Elish M. O. Helmy T. Hussain M. I. (2013). Empirical study of homogeneous and heterogeneous ensemble models for software development effort estimation. Mathematical Problems in Engineering 2013(1) 312067. https:\/\/doi.org\/10.1155\/2013\/312067","DOI":"10.1155\/2013\/312067"},{"key":"e_1_3_3_30_1","doi-asserted-by":"crossref","unstructured":"Elmousalami H. H. (2020). Artificial intelligence and parametric construction cost estimate modeling: State-of-the-art review. Journal of Construction Engineering and Management 146(1) 03119008. https:\/\/doi.org\/10.1061\/(ASCE)CO.1943-7862.0001678","DOI":"10.1061\/(ASCE)CO.1943-7862.0001678"},{"key":"e_1_3_3_31_1","doi-asserted-by":"crossref","unstructured":"Fang Y. Tian X. Wu H. Gu S. Wang Z. Wang F. Li J. Weng Y. (2020). Few-shot learning for Chinese legal controversial issues classification. IEEE Access 8 75022\u201375034. https:\/\/doi.org\/10.1109\/ACCESS.2020.2988493","DOI":"10.1109\/ACCESS.2020.2988493"},{"key":"e_1_3_3_32_1","doi-asserted-by":"crossref","unstructured":"Farhadishad M. Kazemifard M. Rezaei Z. (2023). Predicting court judgment in criminal cases by text mining techniques. Journal of Information Technology Management 15(2) 204\u2013222. https:\/\/doi.org\/10.22059\/jitm.2023.350464.3206","DOI":"10.12720\/jait.15.2.288-298"},{"key":"e_1_3_3_33_1","doi-asserted-by":"crossref","unstructured":"Feng Y. Li C. Ng V. (2022). Legal judgment prediction via event extraction with constraints. In Proceedings of the 60th annual meeting of the association for computational linguistics (pp. 648\u2013664). Association for Computational Linguistics. https:\/\/doi.org\/10.18653\/v1\/2022.acl-long.48","DOI":"10.18653\/v1\/2022.acl-long.48"},{"key":"e_1_3_3_34_1","doi-asserted-by":"crossref","unstructured":"Fern\u00e1ndez A. Garcia S. Herrera F. Chawla N. V. (2018). SMOTE for learning from imbalanced data: Progress and challenges marking the 15-year anniversary. Journal of Artificial Intelligence Research 61 863\u2013905. https:\/\/doi.org\/10.1613\/jair.1.11192","DOI":"10.1613\/jair.1.11192"},{"key":"e_1_3_3_35_1","doi-asserted-by":"crossref","unstructured":"Fran\u00e7a J. V. Boaro J. M. dos Santos P. T. Henrique F. Garcia V. Manfredini C. Neto J. S. S. (2020). Legal judgment prediction in the context of energy market using Gradient Boosting. In IEEE International Conference on Systems Man and Cybernetics (SMC) (pp. 875\u2013880). IEEE. https:\/\/doi.org\/10.1109\/SMC42975.2020.9283297","DOI":"10.1109\/SMC42975.2020.9283297"},{"key":"e_1_3_3_36_1","unstructured":"Freund Y. Schapire R. E. (1996). Experiments with a new boosting algorithm. In International Conference on Machine Learning (pp. 148\u2013156). http:\/\/dl.acm.org\/citation.cfm?id=3091696.309171"},{"key":"e_1_3_3_37_1","doi-asserted-by":"crossref","unstructured":"Gan L. Kuang K. Yang Y. Wu F. (2021). Judgment prediction via injecting legal knowledge into neural networks. In Proceedings of AAAI (pp. 12866\u201312874). https:\/\/doi.org\/10.1609\/aaai.v35i14.17522","DOI":"10.1609\/aaai.v35i14.17522"},{"key":"e_1_3_3_38_1","doi-asserted-by":"crossref","unstructured":"Geetha R. Thilagam T. (2021). A review on the effectiveness of machine learning and deep learning algorithms for cyber security. Archives of Computational Methods in Engineering 28(4) 2861\u20132879. https:\/\/doi.org\/10.1007\/s11831-020-09478-2","DOI":"10.1007\/s11831-020-09478-2"},{"key":"e_1_3_3_39_1","doi-asserted-by":"crossref","unstructured":"Ghaedi A. M. Vafaei A. (2017). Applications of artificial neural networks for adsorption removal of dyes from aqueous solution: A review. Advances in Colloid and Interface Science 245 20\u201339. https:\/\/doi.org\/10.1016\/j.cis.2017.04.015","DOI":"10.1016\/j.cis.2017.04.015"},{"key":"e_1_3_3_40_1","doi-asserted-by":"crossref","unstructured":"Goldacre B. Morton C. E. DeVito N. J. (2019). Why researchers should share their analytic code. BMJ 367 l6365. https:\/\/doi.org\/10.1136\/bmj.l6365","DOI":"10.1136\/bmj.l6365"},{"key":"e_1_3_3_41_1","doi-asserted-by":"crossref","unstructured":"Graa O. Rekik I. (2019). Multi-view learning-based data proliferator for boosting classification using highly imbalanced classes. Journal of Neuroscience Methods 327 108344. https:\/\/doi.org\/10.1016\/j.jneumeth.2019.108344","DOI":"10.1016\/j.jneumeth.2019.108344"},{"key":"e_1_3_3_42_1","doi-asserted-by":"crossref","unstructured":"Guo X. Zhang H. Ye L. Li S. (2021). TenLa: An approach based on controllable tensor decomposition and optimized lasso regression for judgement prediction of legal cases. Applied Intelligence 51 2233\u20132252. https:\/\/doi.org\/10.1007\/s10489-020-01912-z","DOI":"10.1007\/s10489-020-01912-z"},{"key":"e_1_3_3_43_1","doi-asserted-by":"crossref","unstructured":"Gusenbauer M. Haddaway N. R. (2020). Which academic search systems are suitable for systematic reviews or meta-analyses? Evaluating retrieval qualities of Google scholar PubMed and 26 other resources. Research Synthesis Methods 11(2) 181\u2013217. https:\/\/doi.org\/10.1002\/jrsm.1378","DOI":"10.1002\/jrsm.1378"},{"key":"e_1_3_3_44_1","doi-asserted-by":"crossref","unstructured":"Haddaway N. R. Akl E. A. Page M. J. Welch V. A. Keenan C. Lotfi T. (2020). Open synthesis and the coronavirus pandemic in 2020. Journal of Clinical Epidemiology 126 184\u2013191. https:\/\/doi.org\/10.1016\/j.jclinepi.2020.06.032","DOI":"10.1016\/j.jclinepi.2020.06.032"},{"key":"e_1_3_3_45_1","doi-asserted-by":"crossref","unstructured":"Hamilton D. G. Fraser H. Fidler F. McDonald S. Rowhani-Farid A. Hong K. Page M. J. (2021). Rates and predictors of data and code sharing in the medical and health sciences: Protocol for a systematic review and individual participant data meta-analysis. F1000 Research 10 491. https:\/\/doi.org\/10.12688\/f1000research.53874.2","DOI":"10.12688\/f1000research.53874.2"},{"key":"e_1_3_3_46_1","doi-asserted-by":"crossref","unstructured":"Hansen L. K. Salamon P. (1990). Neural network ensembles. IEEE Transactions on Pattern Analysis and Machine Intelligence 12(10) 993\u20131001. https:\/\/doi.org\/10.1109\/34.58871","DOI":"10.1109\/34.58871"},{"key":"e_1_3_3_47_1","doi-asserted-by":"crossref","unstructured":"Hariyanti E. Janeswari M. B. Moningka M. M. Aziz F. M. Putri A. R. Hapsari O. S. Sutha N. A. A. D. Sinaga Y. A. A. Bendesa M. P. (2023). Implementation of artificial intelligence in various domains of IT governance: A systematic literature review. Journal of Information Systems Engineering and Business Intelligence 9(2) 305\u2013319. https:\/\/doi.org\/10.20473\/jisebi.9.2.305-319.","DOI":"10.20473\/jisebi.9.2.305-319"},{"key":"e_1_3_3_48_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11517-020-02223-8"},{"key":"e_1_3_3_49_1","doi-asserted-by":"crossref","unstructured":"Imran M. Ismail M. A. Hamid S. Nasir M. H. N. M. (2022). Complex process modeling in process mining: A systematic review. IEEE Access 10 101515\u2013101536. https:\/\/doi.org\/10.1109\/ACCESS.2022.3208231","DOI":"10.1109\/ACCESS.2022.3208231"},{"key":"e_1_3_3_50_1","doi-asserted-by":"crossref","unstructured":"Jiang Y. Zhang N. (2023). A quantitative evaluation of judicial justice in civil cases with Chinese free trade zone enterprises as the plaintiff. Heliyon 9(2) e13344. https:\/\/doi.org\/10.1016\/j.heliyon.2023.e13344","DOI":"10.1016\/j.heliyon.2023.e13344"},{"key":"e_1_3_3_51_1","doi-asserted-by":"crossref","unstructured":"Jouloudari J. H. Marefat A. Nematollahi M. A. Oyelere S. S. Hussain S. (2023). Effective class-imbalance learning based on smote and convolutional neural networks. Applied Science 13(6) 4006. https:\/\/doi.org\/10.3390\/app13064006","DOI":"10.3390\/app13064006"},{"key":"e_1_3_3_52_1","doi-asserted-by":"crossref","unstructured":"Katz D. M. Bommarito M. J. Blackman J. A. (2017). A general approach for predicting the behavior of the Supreme Court of the United States. PLoS ONE 12(4) e0174698. https:\/\/doi.org\/10.1371\/journal.pone.0174698","DOI":"10.1371\/journal.pone.0174698"},{"key":"e_1_3_3_53_1","doi-asserted-by":"crossref","unstructured":"Kaur H. Choudhury T. Singh T. P. Shamoon M. (2019). Crime analysis using text mining. In Proceedings of the 2019 international conference on contemporary computing and informatics (pp. 283\u2013288). IEEE. https:\/\/doi.org\/10.1109\/IC3I46837.2019.9055606","DOI":"10.1109\/IC3I46837.2019.9055606"},{"key":"e_1_3_3_54_1","doi-asserted-by":"crossref","unstructured":"Kim C. Bai B. Kim P. Chon K. (2018). Review of reviews: A systematic analysis of review papers in the hospitality and tourism literature. International Journal of Hospitality Management 70 49\u201358. https:\/\/doi.org\/10.1016\/j.ijhm.2017.10.023","DOI":"10.1016\/j.ijhm.2017.10.023"},{"key":"e_1_3_3_55_1","unstructured":"Kitchenham B. Charters S. (2007). Guidelines for performing systematic literature reviews in software engineering. Technical report ver. 2.3 Ebse Technical Report. EBSE-2007-01 2007."},{"key":"e_1_3_3_56_1","doi-asserted-by":"crossref","unstructured":"Kowsrihawat K. Vateekul P. Boonkwan P. (2018). Predicting judicial decisions of criminal cases from Thai supreme court using Bi-directional GRU with attention mechanism. In 5th Asian Conference on Defense Technology (ACDT) (pp. 50\u201355). https:\/\/doi.org\/10.1109\/acdt.2018.8592948","DOI":"10.1109\/ACDT.2018.8592948"},{"key":"e_1_3_3_57_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4842-5940-5"},{"key":"e_1_3_3_58_1","doi-asserted-by":"crossref","unstructured":"Kumar P. Bhatnagar R. Gaur K. Bhatnagar A. (2021). Classification of imbalanced data: Review of methods and applications. In IOP Conference Series: Materials science and engineering Volume 1099 International conference on applied scientific computational intelligence using data science (ASCI 2020) 1099 012077. IOP. https:\/\/doi.org\/10.1088\/1757-899X\/1099\/1\/012077","DOI":"10.1088\/1757-899X\/1099\/1\/012077"},{"key":"e_1_3_3_59_1","doi-asserted-by":"crossref","unstructured":"Leins K. Lau J. H. Baldwin T. (2020). Who should decide what uses of NLP are appropriate and on what basis? In Proceedings of the 58th annual meeting of the association for computational linguistics (pp. 2908\u20132913). Association for Computational Linguistics. https:\/\/doi.org\/10.18653\/v1\/2020.acl-main.261","DOI":"10.18653\/v1\/2020.acl-main.261"},{"key":"e_1_3_3_60_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11265-018-1429-9"},{"key":"e_1_3_3_61_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.arabjc.2021.103680"},{"key":"e_1_3_3_62_1","doi-asserted-by":"crossref","unstructured":"Liberati A. Altman D. G. Tetzlaff J. Gotzsche P. C. Ioannidis J. P. A. Clarke M. Devereaux P. J. Kleijnen J. Moher D. (2009). The PRISMA statement for reporting systematic reviews and metanalyses of studies that evaluate healthcare interventions: Explanation and elaboration. BMJ 339(1) 1\u201327. https:\/\/doi.org\/10.1136\/bmj.b2700","DOI":"10.1136\/bmj.b2700"},{"key":"e_1_3_3_63_1","doi-asserted-by":"crossref","unstructured":"Linnenluecke M. K. Marrone M. Singh A. K. (2020). Conducting systematic literature reviews and bibliometric analyses. Australian Journal of Management 45(2) 175\u2013194. https:\/\/doi.org\/10.1177\/0312896219877678","DOI":"10.1177\/0312896219877678"},{"key":"e_1_3_3_64_1","doi-asserted-by":"crossref","unstructured":"Liu Y. H. Chen Y. L. Ho W. L. (2015). Predicting associated statutes for legal problems. Information Processing & Management 51(1) 194\u2013211. https:\/\/doi.org\/10.1016\/j.ipm.2014.07.003","DOI":"10.1016\/j.ipm.2014.07.003"},{"key":"e_1_3_3_65_1","doi-asserted-by":"crossref","unstructured":"Liu Z. Chen H. A. (2017). Predictive performance comparison of machine learning models for judicial cases. In Proceedings of the 2017 IEEE symposium series on computational intelligence (SSCI) (pp. 1\u20136). IEEE. https:\/\/doi.org\/10.1109\/SSCI.2017.8285436","DOI":"10.1109\/SSCI.2017.8285436"},{"key":"e_1_3_3_66_1","doi-asserted-by":"crossref","unstructured":"Liu Y. H. Chen Y. L. (2018). A two-phase sentiment analysis approach for judgement prediction. Journal of Information Science 44(5) 594\u2013607. https:\/\/doi.org\/10.1177\/0165551517722741","DOI":"10.1177\/0165551517722741"},{"key":"e_1_3_3_67_1","doi-asserted-by":"crossref","unstructured":"Malik V. Sanjay R. Nigam S. K. Ghosh K. Guha S. K. Bhattacharya A. Modi A. (2021). ILDC for CJPE: Indian legal documents corpus for court judgment prediction and explanation. In Proceedings of ACL (pp. 4046\u20134062). Association for Computational Linguistics. https:\/\/doi.org\/10.18653\/v1\/2021.acl-long.313","DOI":"10.18653\/v1\/2021.acl-long.313"},{"key":"e_1_3_3_68_1","doi-asserted-by":"publisher","DOI":"10.1177\/0894439318770744"},{"key":"e_1_3_3_69_1","doi-asserted-by":"crossref","unstructured":"McConnell D. J. Zhu J. Pandya S. Aguiar D. (2021). Case-level prediction of motion outcomes in civil litigation. In Proceedings of the Eighteenth International Conference on Artificial Intelligence and Law (pp. 99\u2013108). Association for Computing Machinery. https:\/\/doi.org\/10.1145\/3462757.3466101","DOI":"10.1145\/3462757.3466101"},{"key":"e_1_3_3_70_1","first-page":"24","volume-title":"Proceedings of the Conference on Empirical Legal Studies","author":"Medvedeva M.","year":"2018","unstructured":"Medvedeva M., Vols M., Wieling M. (2018). Judicial decisions of the European Court of Human Rights: Looking into the crystal ball. In Proceedings of the Conference on Empirical Legal Studies (pp. 24\u201336)."},{"key":"e_1_3_3_71_1","doi-asserted-by":"crossref","unstructured":"Medvedeva M. Vols M. Wieling M. (2020). Using machine learning to predict decisions of the European Court of Human Rights. Artificial Intelligence and Law 28 237\u2013266. https:\/\/doi.org\/10.1007\/s10506-019-09255-y","DOI":"10.1007\/s10506-019-09255-y"},{"key":"e_1_3_3_72_1","doi-asserted-by":"crossref","unstructured":"Meline T. (2006). Selecting studies for systemic review: Inclusion and exclusion criteria. Contemporary Issues in Communication Science and Disorders 33 21\u201327. https:\/\/doi.org\/10.1044\/cicsd_33_S_21","DOI":"10.1044\/cicsd_33_S_21"},{"key":"e_1_3_3_73_1","doi-asserted-by":"crossref","unstructured":"O\u2019Dea R. E. Lagisz M. Jennions M. D. Koricheva J. Noble D. W. Parker T. H. Nakagawa S. et al. (2021). Preferred reporting items for systematic reviews and metaanalyses in ecology and evolutionary biology: A PRISMA extension. Biological Reviews of the Cambridge Philosophical Society 96(5) 1695\u20131722. https:\/\/doi.org\/10.1111\/brv.12721","DOI":"10.1111\/brv.12721"},{"key":"e_1_3_3_74_1","doi-asserted-by":"crossref","unstructured":"Opitz J. (2024). A closer look at classification evaluation metrics and a critical reflection of common evaluation practice. Transactions of the Association for Computational Linguistics 12 820\u2013836. https:\/\/doi.org\/10.1162\/tacl_a_00675","DOI":"10.1162\/tacl_a_00675"},{"key":"e_1_3_3_75_1","doi-asserted-by":"crossref","unstructured":"Paez A. (2017). Gray literature: An important resource in systematic reviews. Journal of Evidence-Based Medicine 10(3) 233\u2013240. https:\/\/doi.org\/10.1111\/jebm.12266.","DOI":"10.1111\/jebm.12266"},{"key":"e_1_3_3_76_1","doi-asserted-by":"crossref","unstructured":"Page M. J. Nguyen P. Y. Hamilton D. G. Haddaway N. R. Kanukula R. Moher D. McKenzie J. E. (2022). Data and code availability statements in systematic reviews of interventions were often missing or inaccurate: A content analysis. Journal of Clinical Epidemiology 147 1\u201310. https:\/\/doi.org\/10.1016\/j.jclinepi.2022.03.003","DOI":"10.1016\/j.jclinepi.2022.03.003"},{"key":"e_1_3_3_77_1","doi-asserted-by":"crossref","unstructured":"Park M. Chai S. (2021). AI model for predicting legal judgments to improve accuracy and explainability of online privacy invasion cases. Applied Sciences 11(23) 11080. https:\/\/doi.org\/10.3390\/app112311080","DOI":"10.3390\/app112311080"},{"key":"e_1_3_3_78_1","doi-asserted-by":"crossref","unstructured":"Pollock Berge E. (2018). How to do a systematic review. International Journal of Stroke 13(2) 138\u2013156. https:\/\/doi.org\/10.1177\/1747493017743796","DOI":"10.1177\/1747493017743796"},{"key":"e_1_3_3_79_1","doi-asserted-by":"crossref","unstructured":"Pudaruth S. Soyjaudah K. M. S. Gunputh R. P. (2018). An innovative multi-segment strategy for the classification of legal judgments using the k-nearest neighbor classifier. Complex & Intelligent Systems 4 1\u201310. https:\/\/doi.org\/10.1007\/s40747-017-0042-z","DOI":"10.1007\/s40747-017-0042-z"},{"key":"e_1_3_3_80_1","doi-asserted-by":"crossref","unstructured":"Quemy A. Wrembel R. (2020). On integrating and classifying legal text documents. In Proceedings of the international conference on database and expert systems applications (pp. 385\u2013399). Springer. https:\/\/doi.org\/10.1007\/978-3-030-59003-1_25","DOI":"10.1007\/978-3-030-59003-1_25"},{"key":"e_1_3_3_81_1","doi-asserted-by":"crossref","unstructured":"Raghupathi V. Zhou Y. Raghupathi W. (2018). Legal decision support: exploring big data analytics approach to modeling pharma patent validity cases. IEEE Access 6 41518\u201341528. https:\/\/doi.org\/10.1109\/ACCESS.2018.2859052","DOI":"10.1109\/ACCESS.2018.2859052"},{"key":"e_1_3_3_82_1","doi-asserted-by":"crossref","unstructured":"Raharjana I. K. Siahaan D. Fatichah C. (2021). User stories and natural language processing: A systematic literature review. IEEE Access 9 53811\u201353826. https:\/\/doi.org\/10.1109\/ACCESS.2021.3070606","DOI":"10.1109\/ACCESS.2021.3070606"},{"key":"e_1_3_3_83_1","doi-asserted-by":"crossref","unstructured":"Ray S. (2019). A quick review of machine learning algorithms. In 2019 International Conference on Machine Learning Big Data Cloud and Parallel Computing (COMITCon) (pp. 35\u201339). https:\/\/doi.org\/10.1109\/COMITCon.2019.8862451","DOI":"10.1109\/COMITCon.2019.8862451"},{"key":"e_1_3_3_84_1","doi-asserted-by":"crossref","unstructured":"Re M. Valentini G. (2012). Ensemble Methods. CRC Press.","DOI":"10.1201\/b11822-34"},{"key":"e_1_3_3_85_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jag.2023.103569"},{"key":"e_1_3_3_86_1","doi-asserted-by":"crossref","unstructured":"Schapire R. E. (1990). The strength of weak learnability. Machine Learning 5 197\u2013227. https:\/\/doi.org\/10.1007\/BF00116037","DOI":"10.1023\/A:1022648800760"},{"key":"e_1_3_3_87_1","doi-asserted-by":"crossref","unstructured":"Sch\u00f6n E. M. Thomaschewski J. Escalona M. J. (2017). Agile requirements engineering: A systematic literature review. Computer Standards & Interfaces 49 79\u201391. https:\/\/doi.org\/10.1016\/j.csi.2016.08.011","DOI":"10.1016\/j.csi.2016.08.011"},{"key":"e_1_3_3_88_1","doi-asserted-by":"crossref","unstructured":"Seni G. Elder J. F. (2010). Ensemble methods in data mining: Improving accuracy through combining predictions. Synthesis Lectures on Data Mining and Knowledge Discovery 2 1\u2013126. https:\/\/doi.org\/10.1007\/978-3-031-01899-2","DOI":"10.1007\/978-3-031-01899-2_1"},{"key":"e_1_3_3_89_1","doi-asserted-by":"crossref","unstructured":"Shaikh R. A. Sahu T. P. Anand V. (2020). Predicting outcomes of legal cases based on legal factors using classifiers. Procedia Computer Science 167 2393\u20132402. https:\/\/doi.org\/10.1016\/j.procs.2020.03.292","DOI":"10.1016\/j.procs.2020.03.292"},{"key":"e_1_3_3_90_1","doi-asserted-by":"crossref","unstructured":"Sil R. Roy A. (2020). A novel approach on argument based legal prediction model using machine learning. In 2020 International conference on smart electronics and communication (ICOSEC) (pp. 487\u2013490). IEEE. https:\/\/doi.org\/10.1109\/ICOSEC49089.2020.9215310","DOI":"10.1109\/ICOSEC49089.2020.9215310"},{"key":"e_1_3_3_91_1","doi-asserted-by":"crossref","unstructured":"Sulea O. M. Zampieri M. Vela M. Genabith J. (2017). Predicting the law area and decisions of French supreme court cases. In Proceedings of RANLP (pp. 716\u2013722). Association of Computational Linguistics. https:\/\/doi.org\/10.26615\/978-954-452-049-6_092","DOI":"10.26615\/978-954-452-049-6_092"},{"key":"e_1_3_3_92_1","doi-asserted-by":"crossref","unstructured":"Tan T. Z. Ng G. S. Quek C. (2007). Complementary learning fuzzy neural network: an approach to imbalanced dataset. In 2007 International Joint Conference on Neural Networks (pp. 2306\u20132311). IEEE. https:\/\/doi.org\/10.1109\/IJCNN.2007.4371318","DOI":"10.1109\/IJCNN.2007.4371318"},{"key":"e_1_3_3_93_1","doi-asserted-by":"crossref","unstructured":"Thammaboosadee S. Watanapa B. Chan J. H. Silparcha U. (2014). A two-stage classifier that identifies charge and punishment under criminal law of civil law system. IEICE Transactions on Information and Systems 97 864\u2013875. https:\/\/doi.org\/10.1587\/transinf.E97.D.864","DOI":"10.1587\/transinf.E97.D.864"},{"key":"e_1_3_3_94_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.findings-acl.314"},{"key":"e_1_3_3_95_1","doi-asserted-by":"crossref","unstructured":"Veale M. Binns R. (2017). Fairer machine learning in the real world: Mitigating discrimination without collecting sensitive data. Big Data & Society 4(2) 1\u201317. https:\/\/doi.org\/10.1177\/2053951717743530","DOI":"10.1177\/2053951717743530"},{"key":"e_1_3_3_96_1","doi-asserted-by":"crossref","unstructured":"Virtucio M. B. L. Aborot J. A. Abonita J. K. C. Avinante R. S. Copino R. J. B. Neverida M. P. Osiana V. O. Peramo E. C. Syjuco J. G. Tan G. B. A. (2018). Predicting decisions of the Philippine supreme court using natural language processing and machine learning. In Proceedings of the 2018 IEEE 42nd annual computer software and applications conference (COMPSAC) (pp. 130\u2013135). IEEE. https:\/\/doi.org\/10.1109\/COMPSAC.2018.10348","DOI":"10.1109\/COMPSAC.2018.10348"},{"key":"e_1_3_3_97_1","doi-asserted-by":"crossref","unstructured":"Visentin A. Nardotto A. O\u2019Sullivan B. (2019). Predicting judicial decisions: A statistically rigorous approach and a new ensemble classifier. In Proceedings of the 2019 IEEE 31st International Conference on Tools with Artificial Intelligence (ICTAI) (pp. 1820\u20131824). IEEE. https:\/\/doi.org\/10.1109\/ICTAI.2019.00275","DOI":"10.1109\/ICTAI.2019.00275"},{"key":"e_1_3_3_98_1","doi-asserted-by":"crossref","unstructured":"Wang N. Tian M. Y. (2023). Intelligent Justice: Human-centered considerations in China\u2019s legal AI transformation. AI Ethics 3(2) 349\u2013354. https:\/\/doi.org\/10.1007\/s43681-022-00202-3","DOI":"10.1007\/s43681-022-00202-3"},{"key":"e_1_3_3_99_1","doi-asserted-by":"crossref","unstructured":"Wu Y. Kuang K. Zhang Y. Liu X. Sun C. Xiao J. Zhuang Y. Si L. Wu F. (2020). De-biased court\u2019s view generation with causality. In Proceedings of EMNLP (pp. 763\u2013780). Association for Computational Linguistics. https:\/\/doi.org\/10.18653\/v1\/2020.emnlp-main.56","DOI":"10.18653\/v1\/2020.emnlp-main.56"},{"key":"e_1_3_3_100_1","doi-asserted-by":"crossref","unstructured":"Yang Y. Yuan W. Li Y. Wang D. Liu J. He T. (2020). An empirical study of law articles prediction on transportation legal cases. In 2020 7th international conference on dependable systems and their applications (DSA) (pp. 125\u2013130). IEEE. https:\/\/doi.org\/10.1109\/DSA51864.2020.00024","DOI":"10.1109\/DSA51864.2020.00024"},{"key":"e_1_3_3_101_1","doi-asserted-by":"crossref","unstructured":"Yu L. Li S. Liu S. (2023). Fast support vector machine training via three-term conjugate-like SMO algorithm. Pattern Recognition 139 109478. https:\/\/doi.org\/10.1016\/j.patcog.2023.109478.","DOI":"10.1016\/j.patcog.2023.109478"},{"key":"e_1_3_3_102_1","doi-asserted-by":"crossref","unstructured":"Zadgaonkar A. V. Agrawal A. J. (2021). An overview of information extraction techniques for legal document analysis and processing. Int. J. Electr. Comput. Eng. 11(6) 5450\u20135457. https:\/\/doi.org\/10.11591\/ijece.v11i6.pp5450-5457","DOI":"10.11591\/ijece.v11i6.pp5450-5457"},{"key":"e_1_3_3_103_1","doi-asserted-by":"crossref","unstructured":"Zheng X. Liu Y. Jiang J. Thomas L. M. Su N. (2021). Predicting the litigation outcome of PPP project disputes between public authority and private partner using an ensemble model. Journal of Business Economics and Management 22(2) 320\u2013345. https:\/\/doi.org\/10.3846\/jbem.2021.13219","DOI":"10.3846\/jbem.2021.13219"},{"key":"e_1_3_3_104_1","doi-asserted-by":"crossref","unstructured":"Zhong H. Wang Y. Tu C. Zhang T. Liu Z. Sun M. (2020). Iteratively questioning and answering for interpretable legal judgment prediction. In Proceedings of AAAI (pp. 1250\u20131257). https:\/\/doi.org\/10.1609\/aaai.v34i01.5479","DOI":"10.1609\/aaai.v34i01.5479"},{"key":"e_1_3_3_105_1","doi-asserted-by":"publisher","DOI":"10.1201\/b12207"},{"key":"e_1_3_3_106_1","doi-asserted-by":"crossref","unstructured":"Zounemat-Kermani M. Batelaan O. Fadaee M. Hinkelmann R. (2021). Ensemble machine learning paradigms in hydrology: A review. Journal of Hydrology 598 126266. https:\/\/doi.org\/10.1016\/j.jhydrol.2021.126266","DOI":"10.1016\/j.jhydrol.2021.126266"}],"container-title":["Sage Open"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/21582440251329663","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/21582440251329663","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/21582440251329663","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,30]],"date-time":"2026-04-30T23:22:44Z","timestamp":1777591364000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/21582440251329663"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,4]]},"references-count":105,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2025,4]]}},"alternative-id":["10.1177\/21582440251329663"],"URL":"https:\/\/doi.org\/10.1177\/21582440251329663","relation":{},"ISSN":["2158-2440","2158-2440"],"issn-type":[{"value":"2158-2440","type":"print"},{"value":"2158-2440","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,4]]},"article-number":"21582440251329663"}}