{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,29]],"date-time":"2026-05-29T10:41:51Z","timestamp":1780051311605,"version":"3.53.1"},"reference-count":0,"publisher":"IOS Press","isbn-type":[{"value":"9781643685625","type":"electronic"}],"license":[{"start":{"date-parts":[[2024,12,5]],"date-time":"2024-12-05T00:00:00Z","timestamp":1733356800000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024,12,5]]},"abstract":"<jats:p>Mediation is a dispute resolution method featuring a neutral third-party (mediator) who intervenes to help the individuals resolve their dispute. In this paper, we investigate to what extent large language models (LLMs) are able to act as mediators. We investigate whether LLMs are able to analyze dispute conversations, select suitable intervention types, and generate appropriate intervention messages. Using a novel, manually created dataset of 50 dispute scenarios, we conduct a blind evaluation comparing LLMs with human annotators across several key metrics. Overall, the LLMs showed strong performance, even outperforming our human annotators across key dimensions. Specifically, in 62% of the cases, the LLMs chose intervention types that were rated as better than or equivalent to those chosen by humans. Moreover, in 84% of the cases, the intervention messages generated by the LLMs were rated as better than or equal to the intervention messages written by humans. LLMs likewise performed favourably on metrics such as impartiality, understanding and contextualization. Our results demonstrate the potential of integrating AI in online dispute resolution (ODR) platforms.<\/jats:p>","DOI":"10.3233\/faia241243","type":"book-chapter","created":{"date-parts":[[2024,12,6]],"date-time":"2024-12-06T00:00:45Z","timestamp":1733443245000},"source":"Crossref","is-referenced-by-count":3,"title":["Robots in the Middle: Evaluating LLMs in Dispute Resolution"],"prefix":"10.3233","author":[{"given":"Jinzhe","family":"Tan","sequence":"first","affiliation":[{"name":"Cyberjustice Laboratory, University of Montreal, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hannes","family":"Westermann","sequence":"additional","affiliation":[{"name":"Maastricht Law and Tech Lab, Maastricht University, Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nikhil Reddy","family":"Pottanigari","sequence":"additional","affiliation":[{"name":"Mila - Quebec AI Institute, University of Montreal, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jarom\u00edr","family":"\u0160avelka","sequence":"additional","affiliation":[{"name":"School of Computer Science, Carnegie Mellon University, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"S\u00e9bastien","family":"Mee\u00f9s","sequence":"additional","affiliation":[{"name":"Cyberjustice Laboratory, University of Montreal, Canada"},{"name":"Faculty of Law and Criminology, Universit\u00e9 Libre de Bruxelles, Belgium"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mia","family":"Godet","sequence":"additional","affiliation":[{"name":"Cyberjustice Laboratory, University of Montreal, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Karim","family":"Benyekhlef","sequence":"additional","affiliation":[{"name":"Cyberjustice Laboratory, University of Montreal, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"7437","container-title":["Frontiers in Artificial Intelligence and Applications","Legal Knowledge and Information Systems"],"original-title":[],"link":[{"URL":"https:\/\/ebooks.iospress.nl\/pdf\/doi\/10.3233\/FAIA241243","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,12,6]],"date-time":"2024-12-06T00:00:45Z","timestamp":1733443245000},"score":1,"resource":{"primary":{"URL":"https:\/\/ebooks.iospress.nl\/doi\/10.3233\/FAIA241243"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,12,5]]},"ISBN":["9781643685625"],"references-count":0,"URL":"https:\/\/doi.org\/10.3233\/faia241243","relation":{},"ISSN":["0922-6389","1879-8314"],"issn-type":[{"value":"0922-6389","type":"print"},{"value":"1879-8314","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,12,5]]}}}