{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,18]],"date-time":"2026-05-18T11:14:31Z","timestamp":1779102871560,"version":"3.51.4"},"reference-count":111,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2025,11,21]],"date-time":"2025-11-21T00:00:00Z","timestamp":1763683200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,11,21]],"date-time":"2025-11-21T00:00:00Z","timestamp":1763683200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100000266","name":"Engineering and Physical Sciences Research Council","doi-asserted-by":"publisher","award":["EP\/Y009800\/1"],"award-info":[{"award-number":["EP\/Y009800\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Responsible AI","award":["KP0016"],"award-info":[{"award-number":["KP0016"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["AI &amp; Soc"],"published-print":{"date-parts":[[2026,4]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>The legal profession faces mounting pressures, including case backlogs and limited access to legal services. Large language models (LLMs), such as OpenAI\u2019s GPT series, have been touted as potential solutions, promising to streamline tasks such as legal drafting, summarisation, analysis, and advice. Proponents argue these models can enhance efficiency, accuracy, and access to justice. However, significant risks remain. LLMs are prone to bias, factual hallucinations, and opaque reasoning processes, which can have severe consequences in high-stakes legal contexts. For responsible use in law, legal use cases must be accurately operationalised into LLM tasks that are sensitive to legal settings, as do the evaluation metrics used to evaluate LLMs performing those tasks. This paper presents a rapid literature review of LLM research in legal contexts since ChatGPT-4\u2019s release in March 2023. We examine how legal tasks are operationalised for LLMs and what evaluation metrics are used, with a focus on how these align\u2014or fail to align\u2014with real-world legal practice. We argue that existing studies often overlook the institutional, organisational, and professional contexts in which these tools would be deployed. This oversight limits the practical relevance of current evaluations and proposes directions for more contextually grounded research and responsible deployment strategies.<\/jats:p>","DOI":"10.1007\/s00146-025-02741-9","type":"journal-article","created":{"date-parts":[[2025,11,21]],"date-time":"2025-11-21T06:56:54Z","timestamp":1763708214000},"page":"4025-4043","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["A rapid evidence review of evaluation techniques for large language models in legal use cases: trends, gaps, and recommendations for future research"],"prefix":"10.1007","volume":"41","author":[{"given":"Joshua","family":"Kelsall","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xingwei","family":"Tan","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Aislinn","family":"Bergin","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jiahong","family":"Chen","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Maria","family":"Waheed","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tom","family":"Sorell","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rob","family":"Procter","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Maria","family":"Liakata","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jenny","family":"Chim","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Serene","family":"Chi","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2025,11,21]]},"reference":[{"issue":"2","key":"2741_CR1","doi-asserted-by":"publisher","first-page":"179","DOI":"10.1207\/S15327051HCI1523_5","volume":"15","author":"M Ackerman","year":"2000","unstructured":"Ackerman M (2000) The intellectual challenge of CSCW: the gap between social requirements and technical feasibility. Hum Comput Interact 15(2):179\u2013203. https:\/\/doi.org\/10.1207\/S15327051HCI1523_5","journal-title":"Hum Comput Interact"},{"issue":"6","key":"2741_CR2","doi-asserted-by":"publisher","first-page":"1278796","DOI":"10.1007\/s10506-024-09397-8","volume":"17","author":"A Al Zubaer","year":"2023","unstructured":"Al Zubaer A, Granitzer M, Mitrovi\u0107 J (2023) Performance analysis of large language models in the domain of legal argument mining. Front Artif Intell 17(6):1278796. https:\/\/doi.org\/10.1007\/s10506-024-09397-8","journal-title":"Front Artif Intell"},{"key":"2741_CR3","doi-asserted-by":"publisher","unstructured":"Ammar A, Koubaa A, Benjdira B, Najar O, Sibaee S (2023) Prediction of arabic rulings using large language models. https:\/\/doi.org\/10.48550\/arXiv.2310.10260","DOI":"10.48550\/arXiv.2310.10260"},{"key":"2741_CR4","doi-asserted-by":"publisher","unstructured":"An C, Gong S, Zhong M et al (2024) L-Eval: Instituting standardized evaluation for long context language models. In: Ku L.-W, Martins A, Srikumar V (eds) 62nd annual meeting of association for computational linguistics. https:\/\/doi.org\/10.18653\/v1\/2024.acl-long.776","DOI":"10.18653\/v1\/2024.acl-long.776"},{"key":"2741_CR6","doi-asserted-by":"publisher","first-page":"96","DOI":"10.1007\/s10664-024-10491-3","volume":"29","author":"MI Azeem","year":"2024","unstructured":"Azeem MI, Abualhaija S (2024) A multi-solution study on GDPR AI-enabled completeness checking of DPAs. Empir Softw Eng 29:96. https:\/\/doi.org\/10.1007\/s10664-024-10491-3","journal-title":"Empir Softw Eng"},{"key":"2741_CR7","doi-asserted-by":"publisher","unstructured":"Barandoni S, Chiarello F, Coscone L, Marrale E, Puccio S (2024) Automating customer needs analysis: a comparative study of large language models in the travel industry. https:\/\/doi.org\/10.48550\/arXiv.2404.17975","DOI":"10.48550\/arXiv.2404.17975"},{"key":"2741_CR8","doi-asserted-by":"crossref","unstructured":"Baresi L, Camilli M, Dolci G (2024) A conceptual framework for quality assurance of LLM-based socio-critical systems. In: 39th IEEE\/ACM international conference on automated software engineering. pp 2314\u20132318. https:\/\/ieeexplore.ieee.org\/document\/10765021.","DOI":"10.1145\/3691620.3695306"},{"key":"2741_CR9","unstructured":"Baron J, Rollings N, Oard D (2023) Using ChatGPT for the FOIA exemption 5 deliberative process privilege. Third international workshop on artificial intelligence and intelligent assistance for legal professionals in the digital workplace (LegalAIIA 2023)"},{"key":"2741_CR10","doi-asserted-by":"publisher","DOI":"10.1007\/s10506-024-09397-8","author":"I Benedetto","year":"2024","unstructured":"Benedetto I, Koudounas A, Vaiani L, Pastor E, Cagliero C, Tarasconi F, Baralis E (2024) Boosting court judgment prediction and explanation using legal entities. Artif Intell Law. https:\/\/doi.org\/10.1007\/s10506-024-09397-8","journal-title":"Artif Intell Law"},{"key":"2741_CR11","doi-asserted-by":"publisher","unstructured":"Berger\u00a0A, Hillebrank L, Leonhard D, et al. (2023) Towards automated regulatory compliance verification in financial auditing with large language models. In: IEEE international conference on big data. pp 4626\u20134635. https:\/\/doi.org\/10.1109\/BigData59044.2023.10386518.","DOI":"10.1109\/BigData59044.2023.10386518"},{"key":"2741_CR12","doi-asserted-by":"publisher","first-page":"3196","DOI":"10.3233\/FAIA230641","volume":"372","author":"M Calamo","year":"2023","unstructured":"Calamo M, Luzi F, Marci M et al (2023) CICERO: a GPT2-based writing assistant to investigate the effectiveness of speclaized LLMs\u2019 applications in e-Justice. Front Artif Intell Appl 372:3196\u20133203. https:\/\/doi.org\/10.3233\/FAIA230641","journal-title":"Front Artif Intell Appl"},{"issue":"3","key":"2741_CR13","doi-asserted-by":"publisher","first-page":"181","DOI":"10.1177\/1037969X241269079","volume":"49","author":"W Cesta","year":"2024","unstructured":"Cesta W (2024) Large language models and community legal centres: could chatbots help reduce Australia\u2019s justice gap? Altern Law J 49(3):181\u2013187. https:\/\/doi.org\/10.1177\/1037969X241269079","journal-title":"Altern Law J"},{"key":"2741_CR14","doi-asserted-by":"crossref","unstructured":"Chen H, Zhang L, Liu Y, Yu Y (2024) Rethinking the development of large language models from the causal perspective: a legal text prediction case. In: Proceedings of the 38ths AAAI conference on artificial intelligence. 28(19):20958\u201320966","DOI":"10.1609\/aaai.v38i19.30086"},{"key":"2741_CR15","doi-asserted-by":"publisher","unstructured":"Cheng Z, Wohnig S, Gupta R, Wolff R (2025) Position: benchmarking is broken \u2013 don\u2019t let AI be its own judge. [preprint]. https:\/\/doi.org\/10.13140\/RG.2.2.33834.94408\/1","DOI":"10.13140\/RG.2.2.33834.94408\/1"},{"key":"2741_CR16","doi-asserted-by":"publisher","unstructured":"Cheong I, Xia J, Feng K, Chen Q, Zhang A (2024) (A)I am not a lawyer, but...: engaging legal experts towards responsible LLM policies for legal advice. In: proceedings of the 2024 ACM conference on fairness, accountability, and transparency (FAccT \u201824). pp 2454\u20132469. https:\/\/doi.org\/10.1145\/3630106.3659048.","DOI":"10.1145\/3630106.3659048"},{"key":"2741_CR17","unstructured":"Chien C, Kim M (2025) Generative AI and legal aid: results from a field study and 100 use cases to bridge the access to justice gap. Loyola of los angeles law review: 903. https:\/\/digitalcommons.lmu.edu\/llr\/vol57\/iss4\/2"},{"key":"2741_CR18","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/12549.001.0001","volume-title":"AI ethics","author":"M Coeckelbergh","year":"2020","unstructured":"Coeckelbergh M (2020) AI ethics. MIT Press, Massachusetts"},{"key":"2741_CR19","doi-asserted-by":"crossref","unstructured":"Cohan A, Goharian N (2016) Revisiting summarization evaluation for scientific articles. In: Calzolari N, Choukri K, Declerck T et al (eds) Proceedings of the tenth international conference on language resources and evaluation. pp 806\u2013813. https:\/\/aclanthology.org\/L16-1130\/","DOI":"10.63317\/3uxkgihvmbtw"},{"key":"2741_CR20","doi-asserted-by":"crossref","unstructured":"Deng W, Pei J, Kong K, et al (2023) Syllogistic reasoning for legal judgment analysis. In: Proceedings of the 2023 conference on empirical methods in natural language processing. pp 13997\u201314009","DOI":"10.18653\/v1\/2023.emnlp-main.864"},{"issue":"7","key":"2741_CR21","doi-asserted-by":"publisher","first-page":"1557","DOI":"10.21275\/SR24728223118","volume":"13","author":"D Dev","year":"2024","unstructured":"Dev D (2024) Streamlining criminal justice: using AI for effective case backlog management. Int J Sci Res 13(7):1557\u20131561. https:\/\/doi.org\/10.21275\/SR24728223118","journal-title":"Int J Sci Res"},{"key":"2741_CR22","doi-asserted-by":"publisher","unstructured":"Dhole K (2023) Large language models as socio-technical systems. In: Proceedings of the big picture workshop. pp 66\u201379. https:\/\/doi.org\/10.18653\/v1\/2023.bigpicture-1.6","DOI":"10.18653\/v1\/2023.bigpicture-1.6"},{"key":"2741_CR23","unstructured":"Dickerson J (2020) Fairness in machine learning is tricky. https:\/\/www.arthur.ai\/blog\/fairness-in-ml. Accessed 31 July 2025"},{"key":"2741_CR24","doi-asserted-by":"publisher","unstructured":"Dodge J, Gururangan S, Card D et al (2019) Show your work: improved reporting of experimental results. In: Proceedings of the 2019 conference on empirical methods in natural language processing and the 9th international joint conference on natural language processing. pp 2185\u2013219. https:\/\/doi.org\/10.48550\/arXiv.1909.03004","DOI":"10.48550\/arXiv.1909.03004"},{"key":"2741_CR25","unstructured":"Dorr B, Monz C, President S, et al (2005) A methodology for extrinsic evaluation of text summarization: Does ROUGE correlate?. In: Goldstein J, Lavie A, Lin CY et al (eds) Proceedings of the ACL Workshop On Intrinsic And Extrinsic Evaluation Measures For Machine Translation And\/Or Summarization. pp 1\u20138.\u00a0https:\/\/aclanthology.org\/W05-0901\/"},{"key":"2741_CR26","doi-asserted-by":"crossref","unstructured":"Dougrez-Lewis J, Akhter M, Ruggeri, F et al (2025) Assessing the reasoning capabilities of LLMs in the context of evidence-based claim verification. In: Che W, Nabende J, Shutova E, Pilehvar MT (eds) Findings of the association for computational linguistics: ACL 2025. pp 20604\u201320628\u00a0https:\/\/aclanthology.org\/2025.findings-acl.1059\/","DOI":"10.18653\/v1\/2025.findings-acl.1059"},{"key":"2741_CR27","doi-asserted-by":"publisher","first-page":"197","DOI":"10.3233\/FAIA230965","volume":"379","author":"J Dr\u00e1pal","year":"2023","unstructured":"Dr\u00e1pal J, Westermann H, Savelka J (2023) Using large language models to support thematic analysis in empirical legal studies. Front Artif Intell Appl 379:197\u2013206. https:\/\/doi.org\/10.3233\/FAIA230965","journal-title":"Front Artif Intell Appl"},{"key":"2741_CR28","unstructured":"Epps M, Njoo L, Willey C, Forney A (2023) Adapting abstractive summarization to court examinations in a zero-shot setting: a short technical paper. CEUR Workshop Proceedings. 3435"},{"key":"2741_CR29","doi-asserted-by":"publisher","unstructured":"Eriksson M, Purificato E, Noroozian A, Vinagre J (2025) Can we trust AI benchmarks? An interdisciplinary review of current issues in AI evaluation. Artificial Intelligence. https:\/\/doi.org\/10.48550\/arXiv.2502.06559.","DOI":"10.48550\/arXiv.2502.06559"},{"key":"2741_CR30","doi-asserted-by":"publisher","first-page":"391","DOI":"10.1162\/tacl_a_00373","volume":"9","author":"AR Fabbri","year":"2021","unstructured":"Fabbri AR, Kry\u015bci\u0144ski W, McCann B et al (2021) SummEval: re-evaluating summarization evaluation. Trans Assoc Comput Linguist 9:391\u2013409. https:\/\/doi.org\/10.1162\/tacl_a_00373","journal-title":"Trans Assoc Comput Linguist"},{"key":"2741_CR31","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1613\/jair.1.13715","volume":"77","author":"S Gehrmann","year":"2023","unstructured":"Gehrmann S, Clark E, Sellam T (2023) Repairing the cracked foundation: a survey of obstacles in evaluation practices for generated text. J Artif Intell Res 77:1\u201364. https:\/\/doi.org\/10.1613\/jair.1.13715","journal-title":"J Artif Intell Res"},{"issue":"11","key":"2741_CR32","doi-asserted-by":"publisher","first-page":"665","DOI":"10.1038\/s42256-020-00257-z","volume":"2","author":"R Geirhos","year":"2020","unstructured":"Geirhos R, Jacobsen JH, Michaelis C et al (2020) Shortcut learning in deep neural networks. Nat Mach Intell 2(11):665\u2013673. https:\/\/doi.org\/10.1038\/s42256-020-00257-z","journal-title":"Nat Mach Intell"},{"key":"2741_CR33","doi-asserted-by":"publisher","unstructured":"Golgoon A, Filom K, Kannan A (2024) Mechanistic interpretability of large language models with applications to the financial service industry. In: 5th acm international conference on AI in finance. https:\/\/doi.org\/10.1145\/3677052.3698612","DOI":"10.1145\/3677052.3698612"},{"key":"2741_CR34","doi-asserted-by":"publisher","unstructured":"Goutte C, Gaussier E (2005) a probabilistic interpretation of precision, recall and F-Score, with implication for evaluation. In: Losada DE, Fern\u00e1ndez-Luna JM (eds) Advances in information retrieval. ECIR 2005. 3408. https:\/\/doi.org\/10.1007\/978-3-540-31865-1_25.","DOI":"10.1007\/978-3-540-31865-1_25"},{"issue":"2","key":"2741_CR35","doi-asserted-by":"publisher","first-page":"91","DOI":"10.1111\/j.1471-1842.2009.00848.x","volume":"26","author":"MJ Grant","year":"2009","unstructured":"Grant MJ, Booth A (2009) A typology of reviews: an analysis of 14 review types and associated methodologies. Health Info Library 26(2):91\u2013108. https:\/\/doi.org\/10.1111\/j.1471-1842.2009.00848.x","journal-title":"Health Info Library"},{"key":"2741_CR36","doi-asserted-by":"publisher","first-page":"60","DOI":"10.3233\/FAIA241234","volume":"395","author":"M Gray","year":"2024","unstructured":"Gray M, Savelka J, Oliver W, Ashley K (2024) Using LLMs to discover legal factors. Front Artif Intell Appl 395:60\u201371. https:\/\/doi.org\/10.3233\/FAIA241234","journal-title":"Front Artif Intell Appl"},{"issue":"2270","key":"2741_CR37","doi-asserted-by":"publisher","first-page":"20230157","DOI":"10.1098\/rsta.2023.0157","volume":"382","author":"M Hagan","year":"2024","unstructured":"Hagan M (2024) Towards human-centred standards for legal help AI. Philos Trans R Soc Lond A Math Phys Eng Sci 382(2270):20230157. https:\/\/doi.org\/10.1098\/rsta.2023.0157","journal-title":"Philos Trans R Soc Lond A Math Phys Eng Sci"},{"key":"2741_CR38","doi-asserted-by":"publisher","unstructured":"Hamdani R, Bonald T, Malliaros F et al. (2024) The factuality of large language models in the legal domain. In: International conference on information and knowledge management. pp 3741\u20133746. https:\/\/doi.org\/10.48550\/arXiv.2409.11798.","DOI":"10.48550\/arXiv.2409.11798"},{"key":"2741_CR39","unstructured":"Harris J, Laurence T, Loman L, et al (2024). Evaluating large language models for public health classification and extraction tasks https:\/\/researchportal.ukhsa.gov.uk\/en\/publications\/evaluating-large-language-models-for-public-health-classification. Accessed 30 Apr 2025"},{"key":"2741_CR40","doi-asserted-by":"publisher","unstructured":"Hassani S (2024) Enhancing legal compliance and regulation analysis with large language models. In: 32nd IEEE international requirements engineering 2024 conference. https:\/\/doi.org\/10.48550\/arXiv.2404.17522","DOI":"10.48550\/arXiv.2404.17522"},{"key":"2741_CR41","doi-asserted-by":"publisher","unstructured":"He M, Gu N, Shi Y, et al. (2023) FAIR: A causal framework for accurately inferring judgments reversals. In: Iliadis, Papaleonidas L, Angelov A, Jayne P (eds) Artificial neural networks and machine learning. 14254. https:\/\/doi.org\/10.1007\/978-3-031-44207-0_15","DOI":"10.1007\/978-3-031-44207-0_15"},{"key":"2741_CR42","doi-asserted-by":"publisher","unstructured":"Henderson P, Hu J, Diab M, Pineau J (2024) Rethinking machine learning benchmarks in the context of professional codes of conduct. In: CSLAW 2024 - proceedings of the 3rd symposium on computer science and law. pp 109\u2013120. https:\/\/doi.org\/10.1145\/3614407.3643708","DOI":"10.1145\/3614407.3643708"},{"key":"2741_CR43","doi-asserted-by":"publisher","first-page":"1523","DOI":"10.1007\/s00146-022-01391-5","volume":"38","author":"T Herrmann","year":"2023","unstructured":"Herrmann T, Pfeiffer S (2023) Keeping the organization in the loop: a socio-technical extension of human-centered artificial intelligence. AI Soc 38:1523\u20131542. https:\/\/doi.org\/10.1007\/s00146-022-01391-5","journal-title":"AI Soc"},{"key":"2741_CR44","doi-asserted-by":"publisher","unstructured":"Hu Y, Luo K, Feng Y (2024)\u00a0ELLA: Empowering LLMs for interpretable, accurate and informative legal advice proceedings of the 62nd annual meeting of the association for computational linguistics 374\u2013387. https:\/\/doi.org\/10.18653\/v1\/2024.acl-demos.36.","DOI":"10.18653\/v1\/2024.acl-demos.36"},{"key":"2741_CR45","doi-asserted-by":"publisher","unstructured":"Huang Q, Ouyang W (2023) improving causality explanation of judge-view generation based on counterfactual advanced intelligent computing technology and applications: 19th international conference. pp 276\u2013284. https:\/\/doi.org\/10.1007\/978-981-99-4752-2_23.","DOI":"10.1007\/978-981-99-4752-2_23"},{"key":"2741_CR46","unstructured":"Iqbal U (2023) From knowledge management to intelligence engineering \u2013 a practical approach to building AI inside the law-firm using open-source Large language models. third international workshop on artificial intelligence and intelligent assistance for legal professionals in the digital workplace."},{"key":"2741_CR47","doi-asserted-by":"publisher","unstructured":"Janatian S, Westermann H, Tan J, Savelka J, Benyeklef (2023) From text to structure: using large language models to support the development of legal expert systems. In: 36th international conference on legal knowledge and information systems: https:\/\/doi.org\/10.48550\/arXiv.2311.04911.","DOI":"10.48550\/arXiv.2311.04911"},{"key":"2741_CR48","doi-asserted-by":"publisher","unstructured":"Jiang C, Yang X (2023) Legal syllogism prompting: teaching large language models for legal judgement prediction. In: 19th international conference on artificial intelligence and law. https:\/\/doi.org\/10.48550\/arXiv.2307.08321","DOI":"10.48550\/arXiv.2307.08321"},{"key":"2741_CR49","doi-asserted-by":"publisher","unstructured":"Kang X, Qu L, Soon L, et al (2023) Can ChatGPT perform reasoning using the IRAC method in analyzing legal scenarios like a lawyer?. In: Findings of the association for computational linguistics: (EMNLP 2023), pp 13900\u201313923. https:\/\/doi.org\/10.48550\/arXiv.2310.14880","DOI":"10.48550\/arXiv.2310.14880"},{"key":"2741_CR50","doi-asserted-by":"crossref","unstructured":"Kapoor S, Henderson P, Narayanan A (2024) Promises and pitfalls of Artificial Intelligence for legal applications. Journal of Cross-Disciplinary Research in Computational Law 2(2): https:\/\/journalcrcl.org\/crcl\/article\/view\/62","DOI":"10.2139\/ssrn.4695412"},{"key":"2741_CR113","doi-asserted-by":"publisher","unstructured":"Kelsall J, Bergin A, Chen J, et al (2025) Evaluating Large Language Models in legal use cases. https:\/\/doi.org\/10.17632\/jnztrkb4f2.1","DOI":"10.17632\/jnztrkb4f2.1"},{"key":"2741_CR51","doi-asserted-by":"publisher","DOI":"10.2139\/ssrn.4389233","author":"M Katz","year":"2024","unstructured":"Katz M, Bommarito M, Gao S, Arredondo P (2024) GPT-4 passes the bar exam. Philos Trans Royal Soc. https:\/\/doi.org\/10.2139\/ssrn.4389233","journal-title":"Philos Trans Royal Soc"},{"key":"2741_CR52","doi-asserted-by":"publisher","unstructured":"Koch B, Denton E, Hanna A, Foster J (2021) Reduced, reused and recycled: the life of a dataset in machine learning research 35th conference on neural information processing systems. https:\/\/doi.org\/10.48550\/arXiv.2112.01716.","DOI":"10.48550\/arXiv.2112.01716"},{"key":"2741_CR53","doi-asserted-by":"publisher","first-page":"4029","DOI":"10.1007\/s43681-025-00703-x","volume":"5","author":"T LaCroix","year":"2025","unstructured":"LaCroix T, Luccioni AS (2025) Metaethical perspectives on \u2018benchmarking\u2019 AI ethics. AI Ethics 5:4029\u20134047. https:\/\/doi.org\/10.1007\/s43681-025-00703-x","journal-title":"AI Ethics"},{"key":"2741_CR54","unstructured":"Lam K, Cheng V, Yeong Z (2023) Applying large language models for enhancing contract drafting. The 3rd international workshop on artificial intelligence and intelligent assistance for legal professionals in the digital workspace"},{"key":"2741_CR55","doi-asserted-by":"publisher","unstructured":"Li Z, Guha N, Nyarko J (2023) Don\u2019t use a cannon to kill a fly: an efficient cascading pipeline for long documents. In: proceedings of the nineteenth international conference on artificial intelligence and law, pp 141\u2013147. https:\/\/doi.org\/10.1145\/3594536.3595142\/","DOI":"10.1145\/3594536.3595142"},{"key":"2741_CR56","doi-asserted-by":"publisher","unstructured":"Liao V, Xiao Z (2025) Rethinking model evaluation as narrowing the socio-technical gap. Human Computer Interaction. https:\/\/doi.org\/10.48550\/arXiv.2306.03100","DOI":"10.48550\/arXiv.2306.03100"},{"key":"2741_CR57","unstructured":"Lightbody E (2025) Why AI could be critical in reducing the court backlog. https:\/\/technative.io\/why-ai-could-be-critical-in-reducing-the-court-backlog\/?utm_source=chatgpt.com. Accessed 10 Mar 2025"},{"issue":"5","key":"2741_CR58","doi-asserted-by":"publisher","first-page":"103796","DOI":"10.1016\/j.ipm.2024.103796","volume":"61","author":"S Liu","year":"2024","unstructured":"Liu S, Cao J, Li Y, Yang R, Wen Z (2024) Low-resource court judgment summarization for common law systems. Inf Process Manage 61(5):103796. https:\/\/doi.org\/10.1016\/j.ipm.2024.103796","journal-title":"Inf Process Manage"},{"key":"2741_CR59","doi-asserted-by":"publisher","unstructured":"Liu Y, Iter D, Xu Y, et al (2023) G-Eval: NLG evaluation using GPT-4 with better human alignment. In: H. Bouamor, J. Pino, & K. Bali (eds) Proceedings of the 2023 conference on empirical methods in natural language processing, pp 2511\u20132522. https:\/\/doi.org\/10.18653\/v1\/2023.emnlp-main.153","DOI":"10.18653\/v1\/2023.emnlp-main.153"},{"issue":"1","key":"2741_CR60","doi-asserted-by":"publisher","first-page":"21","DOI":"10.14512\/tatup.33.1.21","volume":"33","author":"B Long","year":"2024","unstructured":"Long B, Palmer A (2024) AI and access to justice: how AI legal advisors can reduce economic and shame-based barriers to justice. TATuP - Zeitschrift F\u00fcr Technikfolgenabsch\u00e4tzung in Theorie und Praxis 33(1):21\u201327. https:\/\/doi.org\/10.14512\/tatup.33.1.21","journal-title":"TATuP - Zeitschrift F\u00fcr Technikfolgenabsch\u00e4tzung in Theorie und Praxis"},{"key":"2741_CR61","doi-asserted-by":"crossref","unstructured":"Luo C, Bhambhoria R, Dahan S, Zhu X (2023) Legally enforceable hate speech detection for public forums findings of the association for computational linguistics. pp 10948\u201310963","DOI":"10.18653\/v1\/2023.findings-emnlp.730"},{"key":"2741_CR62","doi-asserted-by":"publisher","unstructured":"Ma M, Waldon B, Nyarko J (2023) Conceptual questions in developing expert-annotated data. In: Proceedings of the nineteenth international conference on artificial intelligence and law, pp 427\u2013431. https:\/\/doi.org\/10.1145\/3594536.3595139.","DOI":"10.1145\/3594536.3595139"},{"key":"2741_CR63","doi-asserted-by":"publisher","unstructured":"Malic V, Kumari A, Liu X (2023) Racial skew in fine-tuned legal AI language models. In: 2023 IEEE international conference on data mining workshops, pp 245-252. https:\/\/doi.org\/10.1109\/ICDMW60847.2023.00037","DOI":"10.1109\/ICDMW60847.2023.00037"},{"key":"2741_CR64","doi-asserted-by":"publisher","unstructured":"Mavi V, Saparov A, Zhao C (2023) Retrieval-augmented chain-of-thought in semi-structured domains. NLLP 2023. https:\/\/doi.org\/10.48550\/arXiv.2310.14435","DOI":"10.48550\/arXiv.2310.14435"},{"key":"2741_CR65","doi-asserted-by":"publisher","DOI":"10.1109\/TAI.2025.3569516","author":"T McIntosh","year":"2024","unstructured":"McIntosh T, Sunsjak T, Arachchilage N et al (2024) Inadequacies of large language model benchmarks in the era of generative Artificial Intelligence. Artif Intell. https:\/\/doi.org\/10.1109\/TAI.2025.3569516","journal-title":"Artif Intell"},{"key":"2741_CR66","doi-asserted-by":"publisher","unstructured":"Min S, Krishna K, Lyu X et al (2023) FActScore: Fine-grained atomic evaluation of factual precision in long form text generation. In: Bouamor H, Pino J, Bali K (eds) Proceedings of the 2023 conference on empirical methods in natural language processing, pp 12076\u201312100. https:\/\/doi.org\/10.18653\/v1\/2023.emnlp-main.741","DOI":"10.18653\/v1\/2023.emnlp-main.741"},{"key":"2741_CR67","doi-asserted-by":"publisher","unstructured":"Minaee S, Mikolov T, Nikzad N et al (2024) Large language models: a survey. https:\/\/doi.org\/10.48550\/arXiv.2402.06196","DOI":"10.48550\/arXiv.2402.06196"},{"key":"2741_CR68","doi-asserted-by":"publisher","first-page":"411","DOI":"10.1007\/s00146-021-01308-8","volume":"38","author":"J Morley","year":"2023","unstructured":"Morley J, Kinsey L, Elhalal A et al (2023) Operationalising AI ethics: barriers, enablers and next steps. AI Soc 38:411\u2013423. https:\/\/doi.org\/10.1007\/s00146-021-01308-8","journal-title":"AI Soc"},{"key":"2741_CR69","doi-asserted-by":"publisher","unstructured":"Mumford J, Atkinson K, Bench-Capon T (2024) Unravelling the ECHR: components of legal case analysis. In: 37th international conference on legal knowledge and information systems. https:\/\/doi.org\/10.3233\/faia241238","DOI":"10.3233\/faia241238"},{"issue":"2270","key":"2741_CR70","doi-asserted-by":"publisher","first-page":"20230159","DOI":"10.1098\/rsta.2023.0159","volume":"382","author":"J Nay","year":"2024","unstructured":"Nay J, Karamardian D, Lawsky SB (2024) Large language models as tax attorneys: a case study in legal capabilities emergence. Philos Trans Royal Soc a: Mathematical, Physical and Engineering Sciences 382(2270):20230159. https:\/\/doi.org\/10.1098\/rsta.2023.0159","journal-title":"Philos Trans Royal Soc a: Mathematical, Physical and Engineering Sciences"},{"key":"2741_CR71","doi-asserted-by":"publisher","first-page":"217","DOI":"10.3233\/FAIA230967","volume":"379","author":"H Nguyen","year":"2023","unstructured":"Nguyen H, Fungwacharakron W, Satoh K (2023) Logilaw dataset towards reinforcement learning from logical feedback (RLLF). Front Artif Intell Appl 379:217\u2013226. https:\/\/doi.org\/10.3233\/FAIA230967","journal-title":"Front Artif Intell Appl"},{"key":"2741_CR72","doi-asserted-by":"publisher","first-page":"217","DOI":"10.3233\/FAIA230967","volume":"379","author":"H Nguyen","year":"2024","unstructured":"Nguyen H, Goebel R, Toni F et al (2024) How well do SOTA legal reasoning models support abductive reasoning? Front Artif Intell Appl 379:217\u2013226. https:\/\/doi.org\/10.3233\/FAIA230967","journal-title":"Front Artif Intell Appl"},{"key":"2741_CR73","doi-asserted-by":"publisher","unstructured":"Novikova J, Du\u0161ek O, Cercas et al (2017) Why we need new evaluation metrics for NLG. In M Palmer, R Hwa, S Riedel (eds) Proceedings of the 2017 conference on empirical methods in natural language processing, pp 2241\u20132252. https:\/\/doi.org\/10.18653\/v1\/D17-1238","DOI":"10.18653\/v1\/D17-1238"},{"key":"2741_CR74","doi-asserted-by":"publisher","unstructured":"Orr W, Kang E (2024) AI as a Sport: On the Competitive Epistemologies of Benchmarking. In: Proceedings of the 2024 ACM conference on fairness, accountability, and transparency: 1875\u20131884. https:\/\/doi.org\/10.1145\/3630106.3659012.","DOI":"10.1145\/3630106.3659012"},{"key":"2741_CR75","doi-asserted-by":"publisher","unstructured":"Parizi A, Liu Y, Nokku P, et al. (2023)\u00a0A comparative study of prompting strategies for legal text classification. In: Proceedings of the natural legal language processing workshop, pp 258\u2013265. https:\/\/doi.org\/10.18653\/v1\/2023.nllp-1.25","DOI":"10.18653\/v1\/2023.nllp-1.25"},{"key":"2741_CR76","doi-asserted-by":"publisher","unstructured":"Phan L, Gatti A, Han Z et al (2025) Humanity\u2019s last exam https:\/\/doi.org\/10.48550\/arXiv.2501.14249.","DOI":"10.48550\/arXiv.2501.14249"},{"issue":"4","key":"2741_CR77","doi-asserted-by":"publisher","first-page":"601","DOI":"10.1103\/RevModPhys.34.601","volume":"34","author":"M Polanyi","year":"1962","unstructured":"Polanyi M (1962) Tacit knowing: its bearing on some problems of philosophy. Rev Mod Phys 34(4):601\u2013616. https:\/\/doi.org\/10.1103\/RevModPhys.34.601","journal-title":"Rev Mod Phys"},{"key":"2741_CR78","doi-asserted-by":"publisher","unstructured":"Prasad N, Boughanem M, Dkaki T (2024) Exploring large language models and hierarchical frameworks for classification of large unstructured legal documents. In: Advances in information retrieval conference. https:\/\/doi.org\/10.1007\/978-3-031-56060-6_15.","DOI":"10.1007\/978-3-031-56060-6_15"},{"key":"2741_CR79","doi-asserted-by":"publisher","unstructured":"Ramprasad S, Krishna K, Lipton Z, Wallace B (2024) Evaluating the factuality of zero-shot summarizers across varied domains. In: Proceedings of the 18th conference of the European chapter of the association for computational linguistics. https:\/\/doi.org\/10.48550\/arXiv.2402.03509.","DOI":"10.48550\/arXiv.2402.03509"},{"key":"2741_CR80","doi-asserted-by":"publisher","unstructured":"Recht B, Roelofs R, Schmidt L, Shankar V (2019) Do ImageNet classifiers generalize to ImageNet?. In: Proceedings of the 36 th international conference on machine learning. https:\/\/doi.org\/10.48550\/arXiv.1902.10811","DOI":"10.48550\/arXiv.1902.10811"},{"issue":"3","key":"2741_CR81","doi-asserted-by":"publisher","first-page":"393","DOI":"10.1162\/coli_a_00322","volume":"44","author":"E Reiter","year":"2018","unstructured":"Reiter E (2018) A structured review of the validity of BLEU. Comput Linguist 44(3):393\u2013401. https:\/\/doi.org\/10.1162\/coli_a_00322","journal-title":"Comput Linguist"},{"issue":"4","key":"2741_CR82","doi-asserted-by":"publisher","first-page":"529","DOI":"10.1162\/coli.2009.35.4.35405","volume":"35","author":"E Reiter","year":"2009","unstructured":"Reiter E, Belz A (2009) An investigation into the validity of some metrics for automatically evaluating natural language generation systems. Comput Linguist 35(4):529\u2013558. https:\/\/doi.org\/10.1162\/coli.2009.35.4.35405","journal-title":"Comput Linguist"},{"key":"2741_CR83","doi-asserted-by":"crossref","unstructured":"Roegiest A, Chitta R, Donnelly J, et al (2023) Questions about contracts: prompt templates for structured answer generation. In: Proceedings of the natural legal language processing workshop, pp 62\u201372.","DOI":"10.18653\/v1\/2023.nllp-1.8"},{"key":"2741_CR84","doi-asserted-by":"publisher","unstructured":"Savelka J (2023) unlocking practical applications in legal domain: evaluation of GPT for zero-shot semantic annotation of legal texts. In: Proceedings of the nineteenth international conference on artificial intelligence and law: https:\/\/doi.org\/10.1145\/3594536.3595161","DOI":"10.1145\/3594536.3595161"},{"issue":"6","key":"2741_CR85","doi-asserted-by":"publisher","first-page":"1279794","DOI":"10.3389\/frai.2023","volume":"17","author":"J Savelka","year":"2023","unstructured":"Savelka J, Ashley KD (2023) The unreasonable effectiveness of large language models in zero-shot semantic annotation of legal texts. Front Artif Intell 17(6):1279794. https:\/\/doi.org\/10.3389\/frai.2023","journal-title":"Front Artif Intell"},{"key":"2741_CR86","unstructured":"Schindler E (2025) Judicial systems are turning to AI to help manage vast quantities of data and expedite case resolution. https:\/\/www.ibm.com\/case-studies\/blog\/judicial-systems-are-turning-to-ai-to-help-manage-its-vast-quantities-of-data-and-expedite-case-resolution?utm_source=chatgpt.com. Accessed 10 Mar 2025"},{"key":"2741_CR87","doi-asserted-by":"publisher","unstructured":"Scialom T, Dray PA, Lamprier S et al (2021) QuestEval: Summarization asks for fact-based evaluation. In: Moens MF, Huang X, Specia L, Yih SW (eds) Proceedings of the 2021 conference on empirical methods in natural language processing, pp 6594\u20136604. https:\/\/doi.org\/10.18653\/v1\/2021.emnlp-main.529","DOI":"10.18653\/v1\/2021.emnlp-main.529"},{"key":"2741_CR88","doi-asserted-by":"publisher","first-page":"121","DOI":"10.1007\/s11063-024-11574-4","volume":"56","author":"R Sheik","year":"2024","unstructured":"Sheik R, Siva S, Nirmala SJ (2024) neural data augmentation for legal overruling task: small deep learning models vs large language models. Neural Process Lett 56:121. https:\/\/doi.org\/10.1007\/s11063-024-11574-4","journal-title":"Neural Process Lett"},{"key":"2741_CR89","doi-asserted-by":"publisher","DOI":"10.1201\/9781003530244","volume-title":"Debiasing AI: rethinking the intersection of innovation and sustainability","author":"D Shin","year":"2025","unstructured":"Shin D (2025) Debiasing AI: rethinking the intersection of innovation and sustainability. Routledge, New York"},{"key":"2741_CR90","doi-asserted-by":"publisher","unstructured":"Song J, Chim J, Tsakalidis A, et al. (2024) Combining hierarchical VAEs with LLMs for clinically meaningful timeline summarisation in social media. In: Ku LW, Martins A, Srikumar V (eds) Findings of the association for computational linguistics: ACL 2024, Pp. 14651\u201314672. https:\/\/doi.org\/10.18653\/v1\/2024.findings-acl.873","DOI":"10.18653\/v1\/2024.findings-acl.873"},{"key":"2741_CR91","volume-title":"AI and tools for expanding access to justice in the Cambridge handbook of AI in civil dispute resolution","author":"Q Steenhuis","year":"2024","unstructured":"Steenhuis Q (2024) AI and tools for expanding access to justice in the Cambridge handbook of AI in civil dispute resolution. Cambridge University Press, Cambridge"},{"key":"2741_CR92","doi-asserted-by":"publisher","unstructured":"Tan J, Westermann H, Pottanigari N, et al (2024) Robots in the middle: evaluating LLMs in dispute resolution. Legal knowledge and information systems https:\/\/doi.org\/10.48550\/arXiv.2410.07053.","DOI":"10.48550\/arXiv.2410.07053"},{"key":"2741_CR93","doi-asserted-by":"publisher","unstructured":"Tannery S, Ley D, Agarwal C, Lakkaraju H (2024) On the hardness of faithful chain-of-thought reasoning in large language models. Computer Science. 10625. https:\/\/doi.org\/10.48550\/arXiv.2406.10625","DOI":"10.48550\/arXiv.2406.10625"},{"key":"2741_CR94","doi-asserted-by":"publisher","first-page":"329","DOI":"10.3233\/FAIA230983","volume":"379","author":"G Terr\u00f3n","year":"2023","unstructured":"Terr\u00f3n G, Chozas P, Doncel V (2023) Event extraction and semantic representation from Spanish workers\u2019 statute using large language models. Front Artif Intell Appl 379:329\u2013334. https:\/\/doi.org\/10.3233\/FAIA230983","journal-title":"Front Artif Intell Appl"},{"key":"2741_CR95","unstructured":"Tobin S (2025) Lawyers face sanctions for citing fake cases with AI, warns UK judge https:\/\/www.reuters.com\/world\/uk\/lawyers-face-sanctions-citing-fake-cases-with-ai-warns-uk-judge-2025-06-06\/. Accessed 31 July 2025"},{"key":"2741_CR96","doi-asserted-by":"publisher","DOI":"10.1080\/0144929X.2024.2431068","author":"H Torkamaan","year":"2024","unstructured":"Torkamaan H, Steinert S, Pera MS et al (2024) Challenges and future directions for integration of large language models into socio-technical systems. Behaviour Information Technol. https:\/\/doi.org\/10.1080\/0144929X.2024.2431068","journal-title":"Behaviour Information Technol"},{"key":"2741_CR97","doi-asserted-by":"publisher","first-page":"224","DOI":"10.1186\/s12916-015-0465-6","volume":"13","author":"AC Tricco","year":"2015","unstructured":"Tricco AC, Antony J, Zarin W, Strifler L, Ghassemi M, Ivory J et al (2015) A scoping review of rapid review methods. BMC Med 13:224. https:\/\/doi.org\/10.1186\/s12916-015-0465-6","journal-title":"BMC Med"},{"key":"2741_CR98","unstructured":"Tricco AC, Langlois EV, Straus SE (2017) Rapid reviews to strengthen health policy and systems: a practical guide. The alliance for health policy and systems research. https:\/\/ahpsr.who.int\/docs\/librariesprovider11\/publications\/supplementarymaterial\/alliancehpsr_rrguide_trainingslides.pdf Accessed 26 Nov 2024"},{"key":"2741_CR99","first-page":"344","volume":"395","author":"Y Tripathi","year":"2024","unstructured":"Tripathi Y, Donakanti R, Girhepuje S et al (2024) InSaAF: incorporating safety through accuracy and fairness: are LLMs ready for the Indian legal domain? Frontiers in Artificial Intell Appl 395:344\u2013351","journal-title":"Frontiers in Artificial Intell Appl"},{"issue":"3","key":"2741_CR100","doi-asserted-by":"publisher","first-page":"691","DOI":"10.1007\/s10506-024-09399-6","volume":"33","author":"A Trozze","year":"2024","unstructured":"Trozze A, Davies T, Kleinberg B (2024) Large language models in cryptocurrency securities cases: can a GPT model meaningfully assist lawyers? Artif Intell Law 33(3):691\u2013737. https:\/\/doi.org\/10.1007\/s10506-024-09399-6","journal-title":"Artif Intell Law"},{"key":"2741_CR101","doi-asserted-by":"publisher","unstructured":"Turpin M, Michael J, Perz E, Bowman S (2023) Language models don\u2019t always say what they think: unfaithful explanations in chain-of-thought prompting. In: 37th conference on neural processing systems. https:\/\/doi.org\/10.48550\/arXiv.2305.04388","DOI":"10.48550\/arXiv.2305.04388"},{"key":"2741_CR102","doi-asserted-by":"publisher","first-page":"102588","DOI":"10.1016\/j.ijinfomgt.2022.102588","volume":"68","author":"V Uren","year":"2023","unstructured":"Uren V, Edwards J (2023) Technology readiness and the organizational journey towards AI adoption: an empirical study. Int J Inf Manage 68:102588. https:\/\/doi.org\/10.1016\/j.ijinfomgt.2022.102588","journal-title":"Int J Inf Manage"},{"key":"2741_CR103","doi-asserted-by":"crossref","unstructured":"Vats S, Zope A, De S, et al (2023) LLMs \u2013 the Good, the Bad or the Indispensable?: a use case on legal statute prediction and legal judgment prediction on Indian court cases. Findings of the association for computational linguistics, Pp. 12451\u201312474","DOI":"10.18653\/v1\/2023.findings-emnlp.831"},{"key":"2741_CR104","doi-asserted-by":"publisher","unstructured":"Wang Alex, Singh Amanpreet, Michael Julian, et al (2018) GLUE: a multi-task benchmark and analysis platform for natural language understanding. In: 7th international conference on learning representations. https:\/\/doi.org\/10.48550\/arXiv.1804.07461","DOI":"10.48550\/arXiv.1804.07461"},{"key":"2741_CR106","doi-asserted-by":"publisher","unstructured":"Westermann H, Savelka J, Benyeklef K (2023) LLMediator: GPT-4 assisted online dispute resolution. ICAIL 2023 workshop on artificial intelligence for access to justice. https:\/\/doi.org\/10.48550\/arXiv.2307.16732","DOI":"10.48550\/arXiv.2307.16732"},{"key":"2741_CR107","doi-asserted-by":"publisher","unstructured":"Xiang Z, Jiang F, Xiong Z et al (2024) BadChain: backdoor chain-of-thought prompting for large language models. In: International conference on learning representations. https:\/\/doi.org\/10.48550\/arXiv.2401.12242","DOI":"10.48550\/arXiv.2401.12242"},{"key":"2741_CR108","doi-asserted-by":"publisher","unstructured":"Xie Y, Zhang S, Cheng H, et al (2024) DocLens: multi-aspect fine-grained evaluation for medical text generation. In: Ku LW, Martins A, Srikumar V (eds) Proceedings of the 62nd annual meeting of the association for computational linguistics, Pp. 649\u2013679. https:\/\/doi.org\/10.18653\/v1\/2024.acl-long.39","DOI":"10.18653\/v1\/2024.acl-long.39"},{"key":"2741_CR109","doi-asserted-by":"crossref","unstructured":"Yu F, Quartey L Schilder F (2023) Exploring the effectiveness of prompt engineering for legal reasoning tasks. In: Findings of the association for computational linguistics: (ACL 2023), Pp. 13582\u201313596","DOI":"10.18653\/v1\/2023.findings-acl.858"},{"key":"2741_CR110","unstructured":"Yuan W, Neubig G, Liu P (2021) BARTScore: Evaluating generated text as text generation. In: Ranzato M, Beygelzimer A, Dauphin Y et al. (eds) Advances in neural information processing systems. 34: 27263\u201327277 https:\/\/proceedings.neurips.cc\/paper\/2021\/file\/e4d2b6e6fdeca3e60e0f1a62fee3d9dd-Paper.pdf"},{"key":"2741_CR111","doi-asserted-by":"publisher","first-page":"308","DOI":"10.1016\/j.procs.2024.10.204","volume":"244","author":"Y Zhang","year":"2024","unstructured":"Zhang Y, Radishian C, Brunswicker S et al (2024) Empathetic language in LLMs under prompt engineering: a comparative study in the legal field. Procedia Comput Sci 244:308\u2013317. https:\/\/doi.org\/10.1016\/j.procs.2024.10.204","journal-title":"Procedia Comput Sci"},{"key":"2741_CR112","doi-asserted-by":"publisher","first-page":"117","DOI":"10.3233\/FAIA230963","volume":"379","author":"M Zin","year":"2023","unstructured":"Zin M, Nguyen H, Satoh K et al (2023) Information extraction from lengthy legal contracts: leveraging query-based summarization and GPT-3.5. Legal Knowl Inf Syst 379:117\u2013186. https:\/\/doi.org\/10.3233\/FAIA230963","journal-title":"Legal Knowl Inf Syst"}],"container-title":["AI &amp; SOCIETY"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00146-025-02741-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00146-025-02741-9","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00146-025-02741-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,18]],"date-time":"2026-05-18T10:25:01Z","timestamp":1779099901000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00146-025-02741-9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,11,21]]},"references-count":111,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2026,4]]}},"alternative-id":["2741"],"URL":"https:\/\/doi.org\/10.1007\/s00146-025-02741-9","relation":{},"ISSN":["0951-5666","1435-5655"],"issn-type":[{"value":"0951-5666","type":"print"},{"value":"1435-5655","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,11,21]]},"assertion":[{"value":"13 May 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 November 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 November 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"This work was supported by the Engineering and Physical Sciences Research Council [grant number EP\/Y009800\/1], through funding from Responsible Ai UK (KP0016).","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}