{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,12,6]],"date-time":"2024-12-06T05:23:53Z","timestamp":1733462633924,"version":"3.30.1"},"reference-count":0,"publisher":"IOS Press","isbn-type":[{"value":"9781643685625","type":"electronic"}],"license":[{"start":{"date-parts":[[2024,12,5]],"date-time":"2024-12-05T00:00:00Z","timestamp":1733356800000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024,12,5]]},"abstract":"<jats:p>This paper analyses automated and human-driven evaluation approaches for Large Language Models (LLMs) performance in the legal domain, stressing the need to combine both into hybrid evaluation frameworks. This conclusion is reinforced by a qualitative case study that uncovers assessment factors considered by lawyers when using LLMs. The diverse nature of these factors, requiring distinct evaluation approaches, underscores the need for adopting a hybrid methodology.<\/jats:p>","DOI":"10.3233\/faia241279","type":"book-chapter","created":{"date-parts":[[2024,12,6]],"date-time":"2024-12-06T00:01:26Z","timestamp":1733443286000},"source":"Crossref","is-referenced-by-count":0,"title":["Towards Hybrid Evaluation Methodologies for Large Language Models in the Legal Domain"],"prefix":"10.3233","author":[{"ORCID":"https:\/\/orcid.org\/0009-0005-3264-2168","authenticated-orcid":false,"given":"Marco","family":"Sanchi","sequence":"first","affiliation":[{"name":"University of Bologna, University of Pisa"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2089-2216","authenticated-orcid":false,"given":"Tereza","family":"Novotn\u00e1","sequence":"additional","affiliation":[{"name":"Masaryk University of Brno"}]}],"member":"7437","container-title":["Frontiers in Artificial Intelligence and Applications","Legal Knowledge and Information Systems"],"original-title":[],"link":[{"URL":"https:\/\/ebooks.iospress.nl\/pdf\/doi\/10.3233\/FAIA241279","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,12,6]],"date-time":"2024-12-06T00:01:26Z","timestamp":1733443286000},"score":1,"resource":{"primary":{"URL":"https:\/\/ebooks.iospress.nl\/doi\/10.3233\/FAIA241279"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,12,5]]},"ISBN":["9781643685625"],"references-count":0,"URL":"https:\/\/doi.org\/10.3233\/faia241279","relation":{},"ISSN":["0922-6389","1879-8314"],"issn-type":[{"value":"0922-6389","type":"print"},{"value":"1879-8314","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,12,5]]}}}