{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,21]],"date-time":"2026-08-21T13:15:48Z","timestamp":1787318148308,"version":"build-2736575974"},"reference-count":121,"publisher":"Springer Science and Business Media LLC","issue":"12","license":[{"start":{"date-parts":[[2025,10,17]],"date-time":"2025-10-17T00:00:00Z","timestamp":1760659200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,10,17]],"date-time":"2025-10-17T00:00:00Z","timestamp":1760659200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001773","name":"University of New South Wales","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100001773","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Artif Intell Rev"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Given the large size and volumes of contracts and their underlying inherent complexity, manual reviews become inefficient and prone to errors, creating a clear need for automation. Automatic Legal Contract Classification (LCC) revolutionizes the way legal contracts are analyzed, offering substantial improvements in speed, accuracy, and accessibility. This survey delves into the challenges of automatic LCC and a detailed examination of key tasks, datasets, and methodologies. We identify seven classification tasks within LCC, and review fourteen datasets related to English-language contracts, including public, proprietary, and non-public sources. We also introduce a methodology taxonomy for LCC, categorized into Traditional Machine Learning, Deep Learning, and Transformer-based approaches. Additionally, the survey discusses evaluation techniques and highlights the best-performing results from the reviewed studies. By providing a thorough overview of current methods and their limitations, this survey suggests future research directions to improve the efficiency, accuracy, and scalability of LCC. As the first comprehensive survey on LCC, it aims to support legal NLP researchers and practitioners in improving legal processes, making legal information more accessible, and promoting a more informed and equitable society.<\/jats:p>","DOI":"10.1007\/s10462-025-11359-8","type":"journal-article","created":{"date-parts":[[2025,10,17]],"date-time":"2025-10-17T02:48:34Z","timestamp":1760669314000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["A survey of classification tasks and approaches for legal contracts"],"prefix":"10.1007","volume":"58","author":[{"given":"Amrita","family":"Singh","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Aditya","family":"Joshi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jiaojiao","family":"Jiang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hye-young","family":"Paik","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2025,10,17]]},"reference":[{"key":"11359_CR1","doi-asserted-by":"crossref","unstructured":"Abadi M, Chu A, Goodfellow I, et\u00a0al. (2016) Deep learning with differential privacy. In: Proceedings of the 2016 ACM SIGSAC conference on computer and communications security, pp 308\u2013318","DOI":"10.1145\/2976749.2978318"},{"key":"11359_CR2","unstructured":"ACL Anthology (2025) Acl anthology. https:\/\/aclanthology.org\/. Accessed: 10 Mar 2025"},{"key":"11359_CR3","unstructured":"ACM Digital Library (2025) Acm digital library. http:\/\/portal.acm.org\/. Accessed: 10 Mar 2025"},{"key":"11359_CR4","doi-asserted-by":"crossref","unstructured":"Aejas B, Bouras A, Belhi A, et\u00a0al (2022) A review of contract entity extraction. In: Proceedings of Sixth International Congress on Information and Communication Technology: ICICT 2021, Vol 4, Springer, London, pp 763\u2013771","DOI":"10.1007\/978-981-16-2102-4_69"},{"key":"11359_CR5","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1007\/978-3-030-72376-7_1","volume-title":"Coordination, Organizations, Institutions, Norms, and Ethics for Governance of Multi-Agent Systems XIII: International Workshops COIN 2017 and COINE 2020, Sao Paulo, Brazil, May 8\u20139, 2017 and Virtual Event, May 9, 2020","author":"JP Aires","year":"2021","unstructured":"Aires JP, Meneguzzi F (2021) Norm conflict identification using a convolutional neural network. Coordination, Organizations, Institutions, Norms, and Ethics for Governance of Multi-Agent Systems XIII: International Workshops COIN 2017 and COINE 2020, Sao Paulo, Brazil, May 8\u20139, 2017 and Virtual Event, May 9, 2020. Springer, Berlin, pp 3\u201319"},{"issue":"4","key":"11359_CR6","doi-asserted-by":"publisher","first-page":"397","DOI":"10.1007\/s10506-017-9205-x","volume":"25","author":"JP Aires","year":"2017","unstructured":"Aires JP, Pinheiro D, Lima VS et al (2017) Norm conflict identification in contracts. Artif Intell Law 25(4):397\u2013428","journal-title":"Artif Intell Law"},{"key":"11359_CR7","doi-asserted-by":"crossref","unstructured":"Aires JP, Monteiro J, Granada R, et\u00a0al. (2018) Norm conflict identification using vector space offsets. In: 2018 International Joint Conference on Neural Networks (IJCNN), IEEE, pp 1\u20138","DOI":"10.1109\/IJCNN.2018.8489119"},{"key":"11359_CR8","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2410.21306","author":"F Ariai","year":"2024","unstructured":"Ariai F, Demartini G (2024) Natural language processing for the legal domain: a survey of tasks, datasets, models, and challenges. ACM Comput Surv. https:\/\/doi.org\/10.48550\/arXiv.2410.21306","journal-title":"ACM Comput Surv"},{"key":"11359_CR9","unstructured":"Armstead J (2015) Implementing Job Classification Procedures into the Human Resource Certification Institute Official PHR and SPHR Certification Guide. Jones International University"},{"key":"11359_CR10","unstructured":"Amoah MO (2021) Effectiveness of evaluation processes to increase organisational transparency and efficiency in contracts management: Kma. PhD thesis"},{"issue":"3","key":"11359_CR11","doi-asserted-by":"publisher","first-page":"839","DOI":"10.1007\/s10506-023-09369-4","volume":"32","author":"D Braun","year":"2024","unstructured":"Braun D (2024) I beg to differ: how disagreement is handled in the annotation of legal machine learning data sets. Artif Intell Law 32(3):839\u2013862","journal-title":"Artif Intell Law"},{"key":"11359_CR12","doi-asserted-by":"crossref","unstructured":"Braun D, Matthes F (2022) Clause topic classification in german and english standard form contracts. In: The 5th Workshop on e-Commerce and NLP, ECNLP 2022, Association for Computational Linguistics (ACL), pp 199\u2013209","DOI":"10.18653\/v1\/2022.ecnlp-1.23"},{"issue":"11","key":"11359_CR13","doi-asserted-by":"publisher","first-page":"4669","DOI":"10.3390\/su16114669","volume":"16","author":"LF Cardona","year":"2024","unstructured":"Cardona LF, Guzm\u00e1n-Luna JA, Restrepo-Carmona JA (2024) Bibliometric analysis of intelligent systems for early anomaly detection in oil and gas contracts: exploring recent progress and challenges. Sustainability 16(11):4669","journal-title":"Sustainability"},{"key":"11359_CR14","doi-asserted-by":"crossref","unstructured":"Chalkidis I (2023) Chatgpt may pass the bar exam soon, but has a long way to go for the lexglue benchmark. arXiv e-prints pp arXiv\u20132304","DOI":"10.2139\/ssrn.4385460"},{"key":"11359_CR15","doi-asserted-by":"crossref","unstructured":"Chalkidis I, Androutsopoulos I, Michos A (2018) Obligation and prohibition extraction using hierarchical rnns. In: Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pp 254\u2013259","DOI":"10.18653\/v1\/P18-2041"},{"issue":"2","key":"11359_CR16","doi-asserted-by":"publisher","first-page":"171","DOI":"10.1007\/s10506-018-9238-9","volume":"27","author":"I Chalkidis","year":"2019","unstructured":"Chalkidis I, Kampas D (2019) Deep learning in law: early adaptation and legal word embeddings trained on large corpora. Artif Intell Law 27(2):171\u2013198","journal-title":"Artif Intell Law"},{"key":"11359_CR17","doi-asserted-by":"publisher","first-page":"2898","DOI":"10.18653\/v1\/2020.findings-emnlp.261","volume":"2020","author":"I Chalkidis","year":"2020","unstructured":"Chalkidis I, Fergadiotis M, Malakasiotis P et al (2020) Legal-bert: the muppets straight out of law school. Findings of the Association for Computational Linguistics EMNLP 2020:2898\u20132904","journal-title":"Findings of the Association for Computational Linguistics EMNLP"},{"key":"11359_CR18","doi-asserted-by":"crossref","unstructured":"Chalkidis I, Fergadiotis M, Tsarapatsanis D, et\u00a0al (2021) Paragraph-level rationale extraction through regularization: A case study on European court of human rights cases. In: Toutanova K, Rumshisky A, Zettlemoyer L, et\u00a0al (eds) Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Association for Computational Linguistics, Online, pp 226\u2013241","DOI":"10.18653\/v1\/2021.naacl-main.22"},{"key":"11359_CR19","doi-asserted-by":"crossref","unstructured":"Chalkidis I, Jana A, Hartung D, et\u00a0al. (2022) Lexglue: A benchmark dataset for legal language understanding in english. In: Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Vol 1: Long Papers), pp 4310\u20134330","DOI":"10.18653\/v1\/2022.acl-long.297"},{"key":"11359_CR20","doi-asserted-by":"crossref","unstructured":"Chalkidis I, Garneau N, Goan\u0163\u0103 C, et\u00a0al. (2023) Lexfiles and legallama: Facilitating english multinational legal language model development. In: Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Vol 1: Long Papers), pp 15513\u201315535","DOI":"10.18653\/v1\/2023.acl-long.865"},{"key":"11359_CR21","unstructured":"Chen B, Zhang Z, Langren\u00e9 N, et\u00a0al. (2023) Unleashing the potential of prompt engineering in large language models: a comprehensive review.\u00a0Preprint at https:\/\/arxiv.org\/abs\/quant-ph\/2310"},{"key":"11359_CR22","unstructured":"Cheng D, Huang S, Wei F (2024) Adapting large language models via reading comprehension. In: The Twelfth International Conference on Learning Representations"},{"key":"11359_CR23","doi-asserted-by":"publisher","DOI":"10.1016\/j.autcon.2023.105020","volume":"154","author":"S Chung","year":"2023","unstructured":"Chung S, Moon S, Kim J et al (2023) Comparing natural language processing (nlp) applications in construction and computer science using preferred reporting items for systematic reviews (prisma). Autom Constr 154:105020","journal-title":"Autom Constr"},{"key":"11359_CR24","unstructured":"Colombo P, Pessoa\u00a0Pires T, Boudiaf M, et\u00a0al. (2024) Saullm-7b: a pioneering large language model for law. Preprint at https:\/\/arxiv.org\/abs\/quant-ph\/2403a"},{"key":"11359_CR25","doi-asserted-by":"crossref","unstructured":"Conneau A, Khandelwal K, Goyal N, et\u00a0al. (2020) Unsupervised cross-lingual representation learning at scale. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp 8440\u20138451","DOI":"10.18653\/v1\/2020.acl-main.747"},{"key":"11359_CR26","first-page":"18","volume":"2010","author":"M Curtotti","year":"2010","unstructured":"Curtotti M, McCreath E (2010) Corpus based classification of text in Australian contracts. Proceedings of the Australasian Language Technology Association Workshop 2010:18\u201326","journal-title":"Proceedings of the Australasian Language Technology Association Workshop"},{"key":"11359_CR27","unstructured":"Danezis G, Domingo-Ferrer J, Hansen M, et\u00a0al. (2015) Privacy and data protection by design-from policy to engineering.\u00a0Preprint at https:\/\/arxiv.org\/abs\/quant-ph\/1501"},{"key":"11359_CR28","unstructured":"Devlin J, Chang MW, Lee K, et\u00a0al. (2019) Bert: Pre-training of deep bidirectional transformers for language understanding. In: Proceedings of the 2019 conference of the North American chapter of the association for computational linguistics: human language technologies, vol 1 (long and short papers), pp 4171\u20134186"},{"issue":"4","key":"11359_CR29","doi-asserted-by":"publisher","first-page":"633","DOI":"10.1111\/1468-2230.12424","volume":"82","author":"G Edmond","year":"2019","unstructured":"Edmond G, Martire KA (2019) Just cognition: scientific research on bias and some implications for legal procedure and decision-making. Mod Law Rev 82(4):633\u2013664","journal-title":"Mod Law Rev"},{"key":"11359_CR30","unstructured":"Freitas LJG (2024) Text clustering applied to unbalanced data in legal contexts. In: Proceedings of the 16th International Conference on Computational Processing of Portuguese-Vol 1, pp 639\u2013642"},{"key":"11359_CR31","doi-asserted-by":"publisher","DOI":"10.1093\/acprof:oso\/9780190240158.001.0001","volume-title":"Contract as promise: a theory of contractual obligation","author":"C Fried","year":"2015","unstructured":"Fried C (2015) Contract as promise: a theory of contractual obligation. Oxford University Press, Oxford"},{"key":"11359_CR32","unstructured":"Funaki R, Nagata Y, Suenaga K, et\u00a0al. (2020) A contract corpus for recognizing rights and obligations. In: Proceedings of the Twelfth Language Resources and Evaluation Conference, pp 2045\u20132053"},{"key":"11359_CR33","unstructured":"Gao X, Singh MP (2014) Extracting normative relationships from business contracts. In: Proceedings of the 2014 international conference on Autonomous agents and multi-agent systems, pp 101\u2013108"},{"key":"11359_CR34","unstructured":"Garreau D, Luxburg U (2020) Explaining the explainer: a first theoretical analysis of lime. In: International conference on artificial intelligence and statistics, PMLR, pp 1287\u20131296"},{"key":"11359_CR35","doi-asserted-by":"crossref","unstructured":"Gee L, Zugarini A, Rigutini L, et\u00a0al. (2022) Fast vocabulary transfer for language model compression. In: Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing: Industry Track, pp 409\u2013416","DOI":"10.18653\/v1\/2022.emnlp-industry.41"},{"key":"11359_CR36","doi-asserted-by":"crossref","unstructured":"Gee L, Rigutini L, Ernandes M, et\u00a0al. (2023) Multi-word tokenization for sequence compression. In: Wang M, Zitouni I (eds) Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing: Industry Track. Association for Computational Linguistics, Singapore, pp 612\u2013621","DOI":"10.18653\/v1\/2023.emnlp-industry.58"},{"key":"11359_CR37","unstructured":"Geng S, Lebret R, Aberer K (2021) Legal transformer models may not always help. Preprint at https:\/\/arxiv.org\/abs\/quant-ph\/2109"},{"key":"11359_CR38","doi-asserted-by":"crossref","unstructured":"Ghosh S, Evuru CKR, Kumar S, et\u00a0al (2023) DALE: Generative data augmentation for low-resource legal NLP. In: Bouamor H, Pino J, Bali K (eds) Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, Singapore, pp 8511\u20138565","DOI":"10.18653\/v1\/2023.emnlp-main.528"},{"key":"11359_CR39","unstructured":"Google Scholar (2025) Google scholar. https:\/\/scholar.google.com\/, Accessed: 10 Mar 2025"},{"key":"11359_CR40","doi-asserted-by":"publisher","DOI":"10.1007\/s10506-023-09379-2","author":"SG Graham","year":"2023","unstructured":"Graham SG, Soltani H, Isiaq O (2023) Natural language processing for legal document review: categorising deontic modalities in contracts. Artif Intell Law (1):22. https:\/\/doi.org\/10.1007\/s10506-023-09379-2","journal-title":"Artif Intell Law"},{"key":"11359_CR41","first-page":"9647","volume":"2023","author":"S Gretz","year":"2023","unstructured":"Gretz S, Halfon A, Shnayderman I et al (2023) Zero-shot topical text classification with llms-an experimental study. Findings Assoc Comput Linguistics EMNLP 2023:9647\u20139676","journal-title":"Findings Assoc Comput Linguistics EMNLP"},{"key":"11359_CR42","doi-asserted-by":"publisher","first-page":"17569","DOI":"10.1007\/s00521-021-06343-6","volume":"33","author":"A Guarino","year":"2021","unstructured":"Guarino A, Lettieri N, Malandrino D et al (2021) A machine learning-based approach to identify unlawful practices in online terms of service: analysis, implementation and evaluation. Neural Comput Appl 33:17569\u201317587","journal-title":"Neural Comput Appl"},{"key":"11359_CR43","first-page":"44123","volume":"36","author":"N Guha","year":"2023","unstructured":"Guha N, Nyarko J, Ho D et al (2023) Legalbench: a collaboratively built benchmark for measuring legal reasoning in large language models. Adv Neural Inf Process Syst 36:44123\u201344279","journal-title":"Adv Neural Inf Process Syst"},{"key":"11359_CR44","doi-asserted-by":"crossref","unstructured":"Haapio H, Passera S (2021) Contracts as interfaces: Exploring visual representation patterns in contract design. In: Legal Informatics. Cambridge University Press, p 213\u2013238","DOI":"10.1017\/9781316529683.018"},{"issue":"9","key":"11359_CR45","doi-asserted-by":"publisher","DOI":"10.1061\/(ASCE)CO.1943-7862.0002122","volume":"147","author":"F Hassan","year":"2021","unstructured":"Hassan F, Le T, Lv X (2021) Addressing legal and contractual matters in construction using natural language processing: a critical review. J Constr Eng Manag 147(9):03121004","journal-title":"J Constr Eng Manag"},{"key":"11359_CR46","first-page":"29217","volume":"35","author":"P Henderson","year":"2022","unstructured":"Henderson P, Krass M, Zheng L et al (2022) Pile of law: Learning responsible data filtering from the law and a 256gb open-source legal dataset. Adv Neural Inf Process Syst 35:29217\u201329234","journal-title":"Adv Neural Inf Process Syst"},{"key":"11359_CR47","unstructured":"Hendrycks D, Burns C, Chen A, et\u00a0al (2021) Cuad: An expert-annotated nlp dataset for legal contract review. NeurIPS"},{"key":"11359_CR48","unstructured":"IEEE Xplore (2025) Ieee xplore digital library. https:\/\/ieeexplore.ieee.org\/, Accessed 10 Mar 2025"},{"key":"11359_CR49","doi-asserted-by":"crossref","unstructured":"Indukuri KV, Krishna PR (2010) Mining e-contract documents to classify clauses. In: Proceedings of the third annual ACM Bangalore conference, pp 1\u20135","DOI":"10.1145\/1754288.1754295"},{"key":"11359_CR50","doi-asserted-by":"crossref","unstructured":"Joshi V, Anish PR, Ghaisas S (2021) Domain adaptation for an automated classification of deontic modalities in software engineering contracts. In: Proceedings of the 29th ACM joint meeting on European software engineering conference and symposium on the foundations of software engineering, pp 1275\u20131280","DOI":"10.1145\/3468264.3473921"},{"key":"11359_CR51","doi-asserted-by":"crossref","unstructured":"Katrak M (2022) The role of language prediction models in contractual interpretation: the challenges and future prospects of gpt-3. Legal Analytics pp 47\u201362","DOI":"10.1201\/9781003215998-5"},{"issue":"1","key":"11359_CR52","doi-asserted-by":"publisher","first-page":"e0262710","DOI":"10.1371\/journal.pone.0262710","volume":"17","author":"GM Khan","year":"2022","unstructured":"Khan GM, Khan SU, Khan HU et al (2022) Challenges and practices identification in complex outsourcing relationships: a systematic literature review. PLoS One 17(1):e0262710","journal-title":"PLoS One"},{"key":"11359_CR53","unstructured":"Kira Systems (2025) Kira Systems: AI Contract Analysis Software. https:\/\/kirasystems.com. Accessed 2 Jun 2025"},{"key":"11359_CR54","first-page":"22199","volume":"35","author":"T Kojima","year":"2022","unstructured":"Kojima T, Gu SS, Reid M et al (2022) Large language models are zero-shot reasoners. Adv Neural Inf Process Syst 35:22199\u201322213","journal-title":"Adv Neural Inf Process Syst"},{"key":"11359_CR55","first-page":"1907","volume":"2021","author":"Y Koreeda","year":"2021","unstructured":"Koreeda Y, Manning CD (2021) Contractnli: a dataset for document-level natural language inference for contracts. Findings Assoc Comput Linguist EMNLP 2021:1907\u20131919","journal-title":"Findings Assoc Comput Linguist EMNLP"},{"key":"11359_CR56","doi-asserted-by":"crossref","unstructured":"Lee K, He L, Zettlemoyer L (2018) Higher-order coreference resolution with coarse-to-fine inference. In: Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Vol 2 (Short Papers), pp 687\u2013692","DOI":"10.18653\/v1\/N18-2108"},{"key":"11359_CR57","unstructured":"Leivaditi S, Rossi J, Kanoulas E (2020) A benchmark for lease contract review.\u00a0Preprint at https:\/\/arxiv.org\/abs\/quant-ph\/2010"},{"key":"11359_CR58","first-page":"9459","volume":"33","author":"P Lewis","year":"2020","unstructured":"Lewis P, Perez E, Piktus A et al (2020) Retrieval-augmented generation for knowledge-intensive nlp tasks. Adv Neural Inf Process Syst 33:9459\u20139474","journal-title":"Adv Neural Inf Process Syst"},{"key":"11359_CR59","doi-asserted-by":"crossref","unstructured":"Lin YC, Chen SA, Liu JJ, et\u00a0al. (2023) Linear classifier: An often-forgotten baseline for text classification. In: Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Vol 2: Short Papers), pp 1876\u20131888","DOI":"10.18653\/v1\/2023.acl-short.160"},{"key":"11359_CR60","doi-asserted-by":"publisher","first-page":"117","DOI":"10.1007\/s10506-019-09243-2","volume":"27","author":"M Lippi","year":"2019","unstructured":"Lippi M, Pa\u0142ka P, Contissa G et al (2019) Claudette: an automated detector of potentially unfair clauses in online terms of service. Artif Intell Law 27:117\u2013139","journal-title":"Artif Intell Law"},{"key":"11359_CR61","unstructured":"Madry A, Makelov A, Schmidt L, et\u00a0al. (2018) Towards deep learning models resistant to adversarial attacks. In: International Conference on Learning Representations, p\u00a09"},{"key":"11359_CR62","doi-asserted-by":"crossref","unstructured":"Marvin G, Hellen N, Jjingo D, et\u00a0al. (2023) Prompt engineering in large language models. In: International conference on data intelligence and cognitive informatics, Springer, pp 387\u2013402","DOI":"10.1007\/978-981-99-7962-2_30"},{"key":"11359_CR63","doi-asserted-by":"crossref","unstructured":"Massey AK, Rutledge RL, Ant\u00f3n AI, et\u00a0al. (2014) Identifying and classifying ambiguity for regulatory requirements. In: 2014 IEEE 22nd international requirements engineering conference (RE), IEEE, pp 83\u201392","DOI":"10.1109\/RE.2014.6912250"},{"key":"11359_CR64","doi-asserted-by":"crossref","unstructured":"Montelongo A, Becker JL (2020) Tasks performed in the legal domain through deep learning: A bibliometric review (1987\u20132020). In: 2020 International Conference on Data Mining Workshops (ICDMW), IEEE, pp 775\u2013781","DOI":"10.1109\/ICDMW51313.2020.00113"},{"key":"11359_CR65","volume-title":"Semantic Processing of Legal Texts","author":"S Montemagni","year":"2010","unstructured":"Montemagni S, Peters W, Tiscornia D (2010) Semantic Processing of Legal Texts. Springer, Berlin"},{"key":"11359_CR66","unstructured":"Mosca E, Szigeti F, Tragianni S, et\u00a0al. (2022) Shap-based explanation methods: a review for nlp interpretability. In: Proceedings of the 29th international conference on computational linguistics, pp 4593\u20134603"},{"key":"11359_CR67","unstructured":"McMahan B, Moore E, Ramage D, et\u00a0al. (2017) Communication-efficient learning of deep networks from decentralized data. In: Artificial intelligence and statistics, PMLR, pp 1273\u20131282"},{"key":"11359_CR68","doi-asserted-by":"crossref","unstructured":"Neill JO, Buitelaar P, Robin C, et\u00a0al. (2017) Classifying sentential modality in legal language: a use case in financial regulations, acts and directives. In: Proceedings of the 16th edition of the International Conference on Articial Intelligence and Law, pp 159\u2013168","DOI":"10.1145\/3086512.3086528"},{"key":"11359_CR69","doi-asserted-by":"publisher","first-page":"3016","DOI":"10.18653\/v1\/2023.findings-emnlp.200","volume":"2023","author":"J Niklaus","year":"2023","unstructured":"Niklaus J, Matoshi V, Rani P et al (2023) Lextreme: a multi-lingual and multi-task benchmark for the legal domain. Findings of the Association for Computational Linguistics EMNLP 2023:3016\u20133054","journal-title":"Findings of the Association for Computational Linguistics EMNLP"},{"key":"11359_CR70","doi-asserted-by":"crossref","unstructured":"Niklaus J, Matoshi V, St\u00fcrmer M, et\u00a0al. (2024) Multilegalpile: A 689gb multilingual legal corpus. In: Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp 15077\u201315094","DOI":"10.18653\/v1\/2024.acl-long.805"},{"key":"11359_CR71","doi-asserted-by":"publisher","first-page":"1315","DOI":"10.30574\/wjarr.2025.25.3.0896","volume":"25","author":"EO Osifo","year":"2025","unstructured":"Osifo EO, Omumu ES, Alozie M (2025) Evolving contractual obligations in construction law: implications of regulatory changes on project delivery. World J Adv Res Rev 25:1315\u20131333","journal-title":"World J Adv Res Rev"},{"key":"11359_CR72","doi-asserted-by":"crossref","unstructured":"Palmirani M, Governatori G, Rotolo A, et\u00a0al. (2011) Legalruleml: Xml-based rules and norms. In: International Workshop on Rules and Rule Markup Languages for the Semantic Web, Springer, pp 298\u2013312","DOI":"10.1007\/978-3-642-24908-2_30"},{"key":"11359_CR73","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v36i10.21363","author":"S Paul","year":"2022","unstructured":"Paul S, Goyal P, Ghosh S (2022) Lesicin: A heterogeneous graph-based approach for automatic legal statute identification from indian legal documents. Proceedings of the AAAI conference on artificial intelligence. https:\/\/doi.org\/10.1609\/aaai.v36i10.21363","journal-title":"Proceedings of the AAAI conference on artificial intelligence"},{"key":"11359_CR74","doi-asserted-by":"crossref","unstructured":"Paul S, Mandal A, Goyal P, et\u00a0al. (2023) Pre-trained language models for the legal domain: a case study on indian law. In: Proceedings of the nineteenth international conference on artificial intelligence and law, pp 187\u2013196","DOI":"10.1145\/3594536.3595165"},{"issue":"3","key":"11359_CR75","first-page":"1","volume":"2","author":"H Pazhohan","year":"2023","unstructured":"Pazhohan H (2023) Global data protection standards: a comparative analysis of GDPR and other international privacy laws. Legal Stud Digit Age 2(3):1\u201312","journal-title":"Legal Stud Digit Age"},{"key":"11359_CR76","doi-asserted-by":"crossref","unstructured":"Rajpurkar P, Jia R, Liang P (2018) Know what you don\u2019t know: Unanswerable questions for SQuAD. In: Gurevych I, Miyao Y (eds) Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Vol 2: Short Papers). Association for Computational Linguistics, Melbourne, Australia, pp 784\u2013789","DOI":"10.18653\/v1\/P18-2124"},{"key":"11359_CR77","unstructured":"Reich N, Micklitz HW, Rott P, et\u00a0al. (2014) European consumer law. Intersentia"},{"issue":"1","key":"11359_CR78","doi-asserted-by":"publisher","DOI":"10.1007\/s44206-023-00081-z","volume":"3","author":"KM Richmond","year":"2024","unstructured":"Richmond KM, Muddamsetty SM, Gammeltoft-Hansen T et al (2024) Explainable ai and law: an evidential survey. Digital Society 3(1):1","journal-title":"Digital Society"},{"key":"11359_CR79","unstructured":"ROSS Intelligence (2025) ROSS Intelligence: AI for Legal Research. https:\/\/www.rossintelligence.com\u00a0Accessed 2 Jun 2025"},{"issue":"1","key":"11359_CR80","doi-asserted-by":"publisher","first-page":"59","DOI":"10.1007\/s10506-021-09288-2","volume":"30","author":"F Ruggeri","year":"2022","unstructured":"Ruggeri F, Lagioia F, Lippi M et al (2022) Detecting and explaining unfairness in consumer contracts through memory networks. Artif Intell Law 30(1):59\u201392","journal-title":"Artif Intell Law"},{"key":"11359_CR81","doi-asserted-by":"crossref","unstructured":"Sainani A, Anish PR, Joshi V, et\u00a0al. (2020) Extracting and classifying requirements from software engineering contracts. In: 2020 IEEE 28th international requirements engineering conference (RE), IEEE, pp 147\u2013157","DOI":"10.1109\/RE48521.2020.00026"},{"key":"11359_CR82","doi-asserted-by":"crossref","unstructured":"Sancheti A, Garimella A, Srinivasan BV, et\u00a0al. (2022) Agent-specific deontic modality detection in legal language. In: Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, pp 11563\u201311579","DOI":"10.18653\/v1\/2022.emnlp-main.795"},{"key":"11359_CR83","first-page":"381","volume":"2024","author":"T Santosh","year":"2024","unstructured":"Santosh T, Weiss C, Grabmair M (2024) Lexsumm and lext5: benchmarking and modeling legal summarization tasks in english. Nat Legal Language Process Workshop 2024:381\u2013403","journal-title":"Nat Legal Language Process Workshop"},{"key":"11359_CR84","doi-asserted-by":"publisher","first-page":"1279794","DOI":"10.3389\/frai.2023.1279794","volume":"6","author":"J Savelka","year":"2023","unstructured":"Savelka J, Ashley KD (2023) The unreasonable effectiveness of large language models in zero-shot semantic annotation of legal texts. Front Artif Intell 6:1279794","journal-title":"Front Artif Intell"},{"key":"11359_CR85","volume-title":"Profit from the source: transforming your business by putting suppliers at the core","author":"C Schuh","year":"2022","unstructured":"Schuh C, Schnellbacher W, Triplat A (2022) Profit from the source: transforming your business by putting suppliers at the core. Harvard Business Press, Brighton"},{"key":"11359_CR86","doi-asserted-by":"crossref","unstructured":"Sen P, Danilevsky M, Li Y, et\u00a0al. (2020) Learning explainable linguistic expressions with neural inductive logic programming for sentence classification. In: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp 4211\u20134221","DOI":"10.18653\/v1\/2020.emnlp-main.345"},{"key":"11359_CR87","unstructured":"Seo W, Kang Y (2022) Systematic literature review for the application of artificial intelligence to the management of construction claims and disputes. In: International conference on construction engineering and project management, Korea Institute of Construction Engineering and Management, pp 57\u201366"},{"key":"11359_CR88","doi-asserted-by":"publisher","first-page":"18253","DOI":"10.1109\/ACCESS.2025.3533217","volume":"13","author":"M Siino","year":"2025","unstructured":"Siino M, Falco M, Croce D et al (2025) Exploring llms applications in law: a literature review on current legal nlp approaches. IEEE Access 13:18253\u201318276","journal-title":"IEEE Access"},{"key":"11359_CR89","unstructured":"Siino M, Tinnirello I (2024) Gpt hallucination detection through prompt engineering. In: Proc. of the 25th Working Notes of the Conference and Labs of the Evaluation Forum, pp 712\u2013721"},{"key":"11359_CR90","first-page":"99","volume":"2023","author":"A Singhal","year":"2023","unstructured":"Singhal A, Anish PR, Karande S et al (2023) Towards mitigating perceived unfairness in contracts from a non-legal stakeholder\u2019s perspective. Proceedings of the Natural Legal Language Processing Workshop 2023:99\u2013112","journal-title":"Proceedings of the Natural Legal Language Processing Workshop"},{"key":"11359_CR91","unstructured":"Singhal A, Jain C, Anish PR, et\u00a0al (2024) Generating clarification questions for disambiguating contracts. In: Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), pp 7611\u20137622"},{"issue":"1","key":"11359_CR92","doi-asserted-by":"publisher","first-page":"12755","DOI":"10.1038\/s41598-024-63648-x","volume":"14","author":"A Singh","year":"2024","unstructured":"Singh A, Rose Anish P, Verma A et al (2024) A data decomposition-based hierarchical classification method for multi-label classification of contractual obligations for the purpose of their governance. Sci Rep 14(1):12755","journal-title":"Sci Rep"},{"key":"11359_CR93","first-page":"1","volume":"77","author":"DJ Solove","year":"2025","unstructured":"Solove DJ (2025) Artificial intelligence and privacy. Fla L Rev 77:1","journal-title":"Fla L Rev"},{"key":"11359_CR94","unstructured":"Springer (2025) Springer. https:\/\/link.springer.com\/. Accessed 10 Mar 2025"},{"key":"11359_CR95","unstructured":"Tauqeer A (2024) An infrastructure with semantic contracts and licenses for improving data sharing. PhD thesis, Wageningen University and Research"},{"issue":"4","key":"11359_CR96","doi-asserted-by":"publisher","first-page":"852","DOI":"10.1111\/jels.12365","volume":"20","author":"D Teichman","year":"2023","unstructured":"Teichman D, Zamir E, Ritov I (2023) Biases in legal decision-making: comparing prosecutors, defense attorneys, law students, and laypersons. J Empir Leg Stud 20(4):852\u2013894","journal-title":"J Empir Leg Stud"},{"key":"11359_CR97","unstructured":"Tuggener D, Von\u00a0D\u00e4niken P, Peetz T, et\u00a0al. (2020) Ledgar: a large-scale multi-label corpus for text classification of legal provisions in contracts. In: Proceedings of the twelfth language resources and evaluation conference, pp 1235\u20131241"},{"key":"11359_CR98","unstructured":"U.S. SEC\u2019s EDGAR database (2025) Software license agreement. https:\/\/www.sec.gov\/Archives\/edgar\/data\/786344\/000119312507182563\/dex1027.htm. Accessed: 4 Jun 2025"},{"issue":"SPE230","key":"11359_CR99","doi-asserted-by":"publisher","first-page":"9","DOI":"10.15446\/dyna.v90n230.111700","volume":"90","author":"JD Vel\u00e1squez-Henao","year":"2023","unstructured":"Vel\u00e1squez-Henao JD, Franco-Cardona CJ, Cadavid-Higuita L (2023) Prompt engineering: a methodology for optimizing interactions with ai-language models in the field of engineering. Dyna 90(SPE230):9\u201317","journal-title":"Dyna"},{"issue":"4","key":"11359_CR100","doi-asserted-by":"publisher","first-page":"561","DOI":"10.1007\/s10506-022-09327-6","volume":"30","author":"S Villata","year":"2022","unstructured":"Villata S, Araszkiewicz M, Ashley K et al (2022) Thirty years of artificial intelligence and law: the third decade. Artif Intell Law 30(4):561\u2013591","journal-title":"Artif Intell Law"},{"issue":"2","key":"11359_CR101","doi-asserted-by":"publisher","first-page":"88","DOI":"10.5204\/lthj.3483","volume":"6","author":"BT Wang","year":"2024","unstructured":"Wang BT (2024) Prompts and large language models: a new tool for drafting, reviewing and interpreting contracts? Law Technol and Humans 6(2):88\u2013106","journal-title":"Law Technol and Humans"},{"key":"11359_CR102","doi-asserted-by":"crossref","unstructured":"Wang Y, Zhao Y (2024) Metacognitive prompting improves understanding in large language models. In: Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies Vol 1Long Papers, pp 1914\u20131926","DOI":"10.18653\/v1\/2024.naacl-long.106"},{"key":"11359_CR103","doi-asserted-by":"publisher","first-page":"2208","DOI":"10.18653\/v1\/2022.findings-naacl.170","volume":"2022","author":"Q Wang","year":"2022","unstructured":"Wang Q, Zhao K, Amor R et al (2022) D2gclf: Document-to-graph classifier for legal document classification. Findings Assoc Comput Linguist NAACL 2022:2208\u20132221","journal-title":"Findings Assoc Comput Linguist NAACL"},{"key":"11359_CR104","unstructured":"Wang X, Wei J, Schuurmans D, et\u00a0al (2022b) Self-consistency improves chain of thought reasoning in language models. In: The Eleventh International Conference on Learning Representations"},{"key":"11359_CR105","doi-asserted-by":"crossref","unstructured":"Wang L, Xu W, Lan Y, et\u00a0al. (2023) Plan-and-solve prompting: Improving zero-shot chain-of-thought reasoning by large language models. In: Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics, Vol 1, Long Papers, pp 2609\u20132634","DOI":"10.18653\/v1\/2023.acl-long.147"},{"issue":"1","key":"11359_CR106","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-024-01029-4","volume":"7","author":"L Wang","year":"2024","unstructured":"Wang L, Chen X, Deng X et al (2024) Prompt engineering in consistency and reliability with the evidence-based guideline for LLMs. NPJ Digit Med 7(1):41","journal-title":"NPJ Digit Med"},{"key":"11359_CR107","unstructured":"Wang F, Zhang Z, Zhang X, et\u00a0al (2024a) A comprehensive survey of small language models in the era of large language models: Techniques, enhancements, applications, collaboration with llms, and trustworthiness. CoRR"},{"key":"11359_CR108","first-page":"24824","volume":"35","author":"J Wei","year":"2022","unstructured":"Wei J, Wang X, Schuurmans D et al (2022) Chain-of-thought prompting elicits reasoning in large language models. Adv Neural Inf Process Syst 35:24824\u201324837","journal-title":"Adv Neural Inf Process Syst"},{"key":"11359_CR109","doi-asserted-by":"crossref","unstructured":"Wohlin C (2014) Guidelines for snowballing in systematic literature studies and a replication in software engineering. In: Proceedings of the 18th international conference on evaluation and assessment in software engineering, pp 1\u201310","DOI":"10.1145\/2601248.2601268"},{"key":"11359_CR110","doi-asserted-by":"crossref","unstructured":"Wu C, Gan Y, Ge Y, et\u00a0al. (2024) Llama pro: Progressive llama with block expansion. In: Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp 6518\u20136537","DOI":"10.18653\/v1\/2024.acl-long.352"},{"key":"11359_CR111","doi-asserted-by":"crossref","unstructured":"Yang Z, Yang D, Dyer C, et\u00a0al. (2016) Hierarchical attention networks for document classification. In: Proceedings of the 2016 conference of the North American chapter of the association for computational linguistics: human language technologies, pp 1480\u20131489","DOI":"10.18653\/v1\/N16-1174"},{"key":"11359_CR112","first-page":"11809","volume":"36","author":"S Yao","year":"2023","unstructured":"Yao S, Yu D, Zhao J et al (2023) Tree of thoughts: deliberate problem solving with large language models. Adv Neural Inf Process Syst 36:11809\u201311822","journal-title":"Adv Neural Inf Process Syst"},{"key":"11359_CR113","first-page":"355","volume":"2024","author":"Q Ye","year":"2024","unstructured":"Ye Q, Ahmed M, Pryzant R et al (2024) Prompt engineering a prompt engineer. Findings Assoc Comput Linguist ACL 2024:355\u2013385","journal-title":"Findings Assoc Comput Linguist ACL"},{"issue":"2","key":"11359_CR114","first-page":"357","volume":"28","author":"H Yu","year":"2021","unstructured":"Yu H, Li H et al (2021) A knowledge graph construction approach for legal domain. Tehni\u010dki vjesnik 28(2):357\u2013362","journal-title":"Tehni\u010dki vjesnik"},{"key":"11359_CR115","first-page":"13617","volume":"2023","author":"J Yun","year":"2023","unstructured":"Yun J, Kim M, Kim Y (2023) Focus on the core: efficient attention via pruned token compression for document classification. Findings Assoc Comput Linguist EMNLP 2023:13617\u201313628","journal-title":"Findings Assoc Comput Linguist EMNLP"},{"issue":"6","key":"11359_CR116","doi-asserted-by":"publisher","DOI":"10.1061\/JCEMD4.COENG-14032","volume":"150","author":"MS Zeberga","year":"2024","unstructured":"Zeberga MS, Haaskjold H, Hussein B (2024) Digital technologies for preventing, mitigating, and resolving contractual disagreements in the aec industry: a systematic literature review. J Constr Eng Manag 150(6):03124002","journal-title":"J Constr Eng Manag"},{"issue":"2","key":"11359_CR117","doi-asserted-by":"publisher","first-page":"62","DOI":"10.1109\/MNET.2016.7437026","volume":"30","author":"H Zhang","year":"2016","unstructured":"Zhang H, Shu Y, Cheng P et al (2016) Privacy and performance trade-off in cyber-physical systems. IEEE Netw 30(2):62\u201366","journal-title":"IEEE Netw"},{"key":"11359_CR118","doi-asserted-by":"publisher","first-page":"5671","DOI":"10.18653\/v1\/2022.findings-emnlp.416","volume":"2022","author":"Z Zhang","year":"2022","unstructured":"Zhang Z, Wang S, Xu Y et al (2022) Task compass: scaling multi-task pre-training with task prefix. Findings Assoc Comput Linguist EMNLP 2022:5671\u20135685","journal-title":"Findings Assoc Comput Linguist EMNLP"},{"issue":"4","key":"11359_CR119","doi-asserted-by":"publisher","DOI":"10.1061\/JMENEA.MEENG-5331","volume":"39","author":"L Zhang","year":"2023","unstructured":"Zhang L, Yao H, Fu Y et al (2023) Comparing subjective and objective measurements of contract complexity in influencing construction project performance: survey versus machine learning. J Manage Eng 39(4):04023017","journal-title":"J Manage Eng"},{"key":"11359_CR120","doi-asserted-by":"crossref","unstructured":"Zheng L, Guha N, Anderson BR, et\u00a0al. (2021) When does pretraining help? assessing self-supervised learning for law and the casehold dataset of 53,000+ legal holdings. In: Proceedings of the eighteenth international conference on artificial intelligence and law, pp 159\u2013168","DOI":"10.1145\/3462757.3466088"},{"key":"11359_CR121","unstructured":"Zhuang W, Chen C, Lyu L (2023) When foundation model meets federated learning: Motivations, challenges, and future directions.\u00a0Preprint at https:\/\/arxiv.org\/abs\/quant-ph\/2306"}],"container-title":["Artificial Intelligence Review"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10462-025-11359-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10462-025-11359-8\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10462-025-11359-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,12,6]],"date-time":"2025-12-06T02:02:00Z","timestamp":1764986520000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10462-025-11359-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,10,17]]},"references-count":121,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2025,12]]}},"alternative-id":["11359"],"URL":"https:\/\/doi.org\/10.1007\/s10462-025-11359-8","relation":{},"ISSN":["1573-7462"],"issn-type":[{"value":"1573-7462","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,10,17]]},"assertion":[{"value":"14 August 2025","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 October 2025","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no Conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}],"article-number":"380"}}