{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,13]],"date-time":"2026-01-13T22:26:15Z","timestamp":1768343175755,"version":"3.49.0"},"publisher-location":"New York, NY, USA","reference-count":58,"publisher":"ACM","funder":[{"DOI":"10.13039\/100010661","name":"Horizon 2020 Framework Programme","doi-asserted-by":"publisher","award":["833647"],"award-info":[{"award-number":["833647"]}],"id":[{"id":"10.13039\/100010661","id-type":"DOI","asserted-by":"publisher"}]},{"name":"PRIN","award":["20224TPEYC - CUP J53D23005130001"],"award-info":[{"award-number":["20224TPEYC - CUP J53D23005130001"]}]},{"name":"PRIN","award":["2022KFLF3E_001 - CUP J53D23005560001"],"award-info":[{"award-number":["2022KFLF3E_001 - CUP J53D23005560001"]}]},{"DOI":"10.13039\/501100000780","name":"European Commission","doi-asserted-by":"publisher","award":["NextGeneration EU programme, PNRR -- M4C2 -- Inv. 1.3, PE00000013"],"award-info":[{"award-number":["NextGeneration EU programme, PNRR -- M4C2 -- Inv. 1.3, PE00000013"]}],"id":[{"id":"10.13039\/501100000780","id-type":"DOI","asserted-by":"publisher"}]},{"name":"National Science Centre Poland","award":["2022\/45\/B\/HS5\/01419"],"award-info":[{"award-number":["2022\/45\/B\/HS5\/01419"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2025,6,16]]},"DOI":"10.1145\/3769126.3769218","type":"proceedings-article","created":{"date-parts":[[2026,1,13]],"date-time":"2026-01-13T14:50:37Z","timestamp":1768315837000},"page":"139-149","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Is It Worth Using LLMs for Unfair Clause Detection in Terms of Service?"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0009-0004-9866-3482","authenticated-orcid":false,"given":"Marco","family":"Panarelli","sequence":"first","affiliation":[{"name":"University of Bologna, Bologna, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9711-7042","authenticated-orcid":false,"given":"Andrea","family":"Galassi","sequence":"additional","affiliation":[{"name":"DISI, University of Bologna, Bologna, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7083-3487","authenticated-orcid":false,"given":"Francesca","family":"Lagioia","sequence":"additional","affiliation":[{"name":"AlmaAI, University of Bologna, Bologna, Italy and European University Institute, Fiesole, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2417-3219","authenticated-orcid":false,"given":"R\u016bta","family":"Liepi\u0146a","sequence":"additional","affiliation":[{"name":"AlmaAI, University of Bologna, Bologna, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9663-1071","authenticated-orcid":false,"given":"Marco","family":"Lippi","sequence":"additional","affiliation":[{"name":"DINFO, University of Florence, Florence, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6879-1596","authenticated-orcid":false,"given":"Przemys\u0142aw","family":"Pa\u0142ka","sequence":"additional","affiliation":[{"name":"Jagiellonian University, Krak\u00f3w, Poland"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2210-0398","authenticated-orcid":false,"given":"Giovanni","family":"Sartor","sequence":"additional","affiliation":[{"name":"AlmaAI, University of Bologna, Bologna, Italy and European University Institute, Fiesole, Italy"}]}],"member":"320","published-online":{"date-parts":[[2026,1,13]]},"reference":[{"key":"e_1_3_3_2_2_2","doi-asserted-by":"crossref","unstructured":"Orlando Amaral Sallam Abualhaija Damiano Torre Mehrdad Sabetzadeh and Lionel\u00a0C Briand. 2021. AI-enabled automation for completeness checking of privacy policies. IEEE Trans. on Software Engineering 48 11 (2021) 4647\u20134674.","DOI":"10.1109\/TSE.2021.3124332"},{"key":"e_1_3_3_2_3_2","doi-asserted-by":"crossref","unstructured":"Quentin Andr\u00e9 Ziv Carmon Klaus Wertenbroch Alia Crum Douglas Frank William Goldstein Joel Huber Leaf Van\u00a0Boven Bernd Weber and Haiyang Yang. 2018. Consumer choice and autonomy in the age of artificial intelligence and big data. Customer Needs and Solutions 5 1 (2018) 28\u201337.","DOI":"10.1007\/s40547-017-0085-8"},{"key":"e_1_3_3_2_4_2","doi-asserted-by":"crossref","unstructured":"Yannis Bakos Florencia Marotta-Wurgler and David\u00a0R Trossen. 2014. Does anyone read the fine print? Consumer attention to standard-form contracts. The Journal of Legal Studies 43 1 (2014) 1\u201335.","DOI":"10.1086\/674424"},{"key":"e_1_3_3_2_5_2","doi-asserted-by":"crossref","unstructured":"Omri Ben-Shahar. 2013. Regulation through boilerplate: an apologia. Mich. L. Rev. 112 (2013) 883.","DOI":"10.2139\/ssrn.2255161"},{"key":"e_1_3_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1145\/3709025.3712215"},{"key":"e_1_3_3_2_7_2","unstructured":"Tom Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared\u00a0D Kaplan Prafulla Dhariwal Arvind Neelakantan Pranav Shyam Girish Sastry Amanda Askell et\u00a0al. 2020. Language models are few-shot learners. Advances in neural information processing systems 33 (2020) 1877\u20131901."},{"key":"e_1_3_3_2_8_2","doi-asserted-by":"crossref","unstructured":"Ilias Chalkidis. 2023. ChatGPT may Pass the Bar Exam soon but has a Long Way to Go for the LexGLUE benchmark.","DOI":"10.2139\/ssrn.4385460"},{"key":"e_1_3_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2022.acl-long.297"},{"key":"e_1_3_3_2_10_2","volume-title":"ICLR","author":"Cheng Daixuan","year":"2024","unstructured":"Daixuan Cheng, Shaohan Huang, and Furu Wei. 2024. Adapting Large Language Models via Reading Comprehension. In ICLR. OpenReview.net."},{"key":"e_1_3_3_2_11_2","doi-asserted-by":"crossref","unstructured":"Jose\u00a0M Del\u00a0Alamo Danny\u00a0S Guaman Boni Garc\u00eda and Ana Diez. 2022. A systematic mapping study on automated analysis of privacy policies. Computing 104 9 (2022) 2053\u20132076.","DOI":"10.1007\/s00607-022-01076-3"},{"key":"e_1_3_3_2_12_2","volume-title":"NeurIPS","author":"Dettmers Tim","year":"2022","unstructured":"Tim Dettmers, Mike Lewis, Younes Belkada, and Luke Zettlemoyer. 2022. GPT3.int8(): 8-bit Matrix Multiplication for Transformers at Scale. In NeurIPS."},{"key":"e_1_3_3_2_13_2","volume-title":"NeurIPS","author":"Dettmers Tim","year":"2023","unstructured":"Tim Dettmers, Artidoro Pagnoni, Ari Holtzman, and Luke Zettlemoyer. 2023. QLoRA: Efficient Finetuning of Quantized LLMs. In NeurIPS."},{"key":"e_1_3_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.nllp-1.1"},{"key":"e_1_3_3_2_15_2","unstructured":"Abhimanyu Dubey and Abhinav\u00a0Jauhri et al. 2024. The Llama 3 Herd of Models."},{"key":"e_1_3_3_2_16_2","doi-asserted-by":"publisher","unstructured":"Andrea Galassi Francesca Lagioia Agnieszka Jab\u0142onowska and Marco Lippi. 2024. Unfair clause detection in terms of service across multiple languages. Artificial Intelligence and Law (2024) 1\u201349. 10.1007\/s10506-024-09398-7","DOI":"10.1007\/s10506-024-09398-7"},{"key":"e_1_3_3_2_17_2","first-page":"1","volume-title":"PACLIC","author":"Gan Chengguang","year":"2023","unstructured":"Chengguang Gan and Tatsunori Mori. 2023. Sensitivity and Robustness of Large Language Models to Prompt Template in Japanese Text Classification Tasks. In PACLIC. Association for Computational Linguistics, 1\u201311."},{"key":"e_1_3_3_2_18_2","unstructured":"Sofia Grafanaki. 2016. Autonomy challenges in the age of big data. Fordham Intell. Prop. Media & Ent. LJ 27 (2016) 803."},{"key":"e_1_3_3_2_19_2","doi-asserted-by":"crossref","unstructured":"Alfonso Guarino Nicola Lettieri Delfina Malandrino and Rocco Zaccagnino. 2021. A machine learning-based approach to identify unlawful practices in online terms of service: analysis implementation and evaluation. Neural Computing and Applications 33 (2021) 17569\u201317587.","DOI":"10.1007\/s00521-021-06343-6"},{"key":"e_1_3_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.2139\/ssrn.4583531"},{"key":"e_1_3_3_2_21_2","first-page":"531","volume-title":"USENIX Security Symposium","author":"Harkous Hamza","year":"2018","unstructured":"Hamza Harkous, Kassem Fawaz, R\u00e9mi Lebret, Florian Schaub, Kang\u00a0G. Shin, and Karl Aberer. 2018. Polisis: Automated Analysis and Presentation of Privacy Policies Using Deep Learning. In USENIX Security Symposium. 531\u2013548."},{"key":"e_1_3_3_2_22_2","volume-title":"EU Consumer Protection 2.0: Structural Asymmetries in Digital Consumer Markets","author":"Helberger Natali","year":"2021","unstructured":"Natali Helberger, Orla Lynskey, Hans-W. Micklitz, Peter Rott, Marijn Sax, and Joanna Strycharz. 2021. EU Consumer Protection 2.0: Structural Asymmetries in Digital Consumer Markets. Technical Report."},{"key":"e_1_3_3_2_23_2","volume-title":"ICLR","author":"Hu Edward\u00a0J.","year":"2022","unstructured":"Edward\u00a0J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, and Weizhu Chen. 2022. LoRA: Low-Rank Adaptation of Large Language Models. In ICLR. OpenReview.net."},{"key":"e_1_3_3_2_24_2","unstructured":"Binyuan Hui Jian Yang Zeyu Cui Jiaxi Yang Dayiheng Liu Lei Zhang Tianyu Liu Jiajun Zhang Bowen Yu Kai Dang An Yang Rui Men Fei Huang Xingzhang Ren Xuancheng Ren Jingren Zhou and Junyang Lin. 2024. Qwen2.5-Coder Technical Report."},{"key":"e_1_3_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.3233\/FAIA210318"},{"key":"e_1_3_3_2_26_2","unstructured":"Albert\u00a0Q. Jiang Alexandre Sablayrolles Arthur Mensch Chris Bamford Devendra\u00a0Singh Chaplot Diego de\u00a0las Casas Florian Bressand Gianna Lengyel Guillaume Lample Lucile Saulnier L\u00e9lio\u00a0Renard Lavaud Marie-Anne Lachaux Pierre Stock Teven\u00a0Le Scao Thibaut Lavril Thomas Wang Timoth\u00e9e Lacroix and William\u00a0El Sayed. 2023. Mistral 7B."},{"key":"e_1_3_3_2_27_2","unstructured":"Daniel Jurafsky and James\u00a0H. Martin. 2000. Speech and language processing."},{"key":"e_1_3_3_2_28_2","doi-asserted-by":"crossref","unstructured":"Francesca Lagioia Agnieszka Jab\u0142onowska Ruta Liepina and Kasper Drazewski. 2022. AI in search of unfairness in consumer contracts: the terms of service landscape. Journal of Consumer Policy 45 3 (2022) 481\u2013536.","DOI":"10.1007\/s10603-022-09520-9"},{"key":"e_1_3_3_2_29_2","doi-asserted-by":"crossref","unstructured":"Marco Lippi Giuseppe Contissa Agnieszka Jablonowska Francesca Lagioia Hans-Wolfgang Micklitz Przemyslaw Palka Giovanni Sartor and Paolo Torroni. 2020. The force awakens: Artificial intelligence for consumer law. Journal of artificial intelligence research 67 (2020) 169\u2013190.","DOI":"10.1613\/jair.1.11519"},{"key":"e_1_3_3_2_30_2","doi-asserted-by":"publisher","unstructured":"Marco Lippi Przemyslaw Palka Giuseppe Contissa Francesca Lagioia Hans-Wolfgang Micklitz Giovanni Sartor and Paolo Torroni. 2019. CLAUDETTE: an automated detector of potentially unfair clauses in online terms of service. Artif. Intell. Law 27 2 (2019) 117\u2013139. 10.1007\/S10506-019-09243-2","DOI":"10.1007\/S10506-019-09243-2"},{"key":"e_1_3_3_2_31_2","doi-asserted-by":"crossref","unstructured":"Marco Loos and Joasia Luzak. 2016. Wanted: a bigger stick. On unfair terms in consumer contracts with online service providers. Journal of consumer policy 39 (2016) 63\u201390.","DOI":"10.1007\/s10603-015-9303-7"},{"key":"e_1_3_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2022.acl-long.556"},{"key":"e_1_3_3_2_33_2","unstructured":"Yuxuan Lu Bingsheng Yao Shao Zhang Yun Wang Peng Zhang Tun Lu Toby\u00a0Jia-Jun Li and Dakuo Wang. 2023. Human Still Wins over LLM: An Empirical Study of Active Learning on Domain-Specific Annotation Tasks. CoRR abs\/2311.09825 (2023)."},{"key":"e_1_3_3_2_34_2","unstructured":"Alexandra\u00a0Sasha Luccioni Sylvain Viguier and Anne-Laure Ligozat. 2023. Estimating the carbon footprint of bloom a 176b parameter language model. Journal of Machine Learning Research 24 253 (2023) 1\u201315."},{"key":"e_1_3_3_2_35_2","unstructured":"Thomas\u00a0J Maronick. 2014. Do consumers read terms of service agreements when installing software?-a two-study empirical analysis. International Journal of Business and Social Research 4 6 (2014) 137\u2013145."},{"key":"e_1_3_3_2_36_2","doi-asserted-by":"crossref","unstructured":"Eric Mart\u00ednez. 2024. Re-evaluating GPT-4\u2019s bar exam performance. Artificial Intelligence and Law (2024).","DOI":"10.2139\/ssrn.4441311"},{"key":"e_1_3_3_2_37_2","doi-asserted-by":"crossref","unstructured":"Hans-W Micklitz Przemys\u0142aw Pa\u0142ka and Yannis Panagis. 2017. The empire strikes back: digital control of unfair terms of online services. Journal of consumer policy 40 (2017) 367\u2013388.","DOI":"10.1007\/s10603-017-9353-0"},{"key":"e_1_3_3_2_38_2","doi-asserted-by":"crossref","unstructured":"Eliza Mik. 2016. The erosion of autonomy in online consumer transactions. Law Innovation and Technology 8 1 (2016) 1\u201338.","DOI":"10.1080\/17579961.2016.1161893"},{"key":"e_1_3_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2023.findings-emnlp.200"},{"key":"e_1_3_3_2_40_2","doi-asserted-by":"crossref","unstructured":"Jonathan\u00a0A Obar and Anne Oeldorf-Hirsch. 2020. The biggest lie on the internet: Ignoring the privacy policies and terms of service policies of social networking services. Information Communication & Society 23 1 (2020) 128\u2013147.","DOI":"10.1080\/1369118X.2018.1486870"},{"key":"e_1_3_3_2_41_2","doi-asserted-by":"crossref","unstructured":"Przemyslaw Palka. 2023. Terms of injustice. W. Va. L. Rev. 126 (2023) 133.","DOI":"10.2139\/ssrn.4391666"},{"key":"e_1_3_3_2_42_2","doi-asserted-by":"crossref","unstructured":"Przemys\u0142aw Pa\u0142ka Rados\u0142aw Pa\u0142osz Andrzej Por\u0119bski and Katarzyna Wi\u015bniewska. 2024. A dataset on the contents of 100 terms of service of online platforms analyzed and evaluated under the EU consumer law. Data in Brief 53 (2024) 110136.","DOI":"10.1016\/j.dib.2024.110136"},{"key":"e_1_3_3_2_43_2","first-page":"258","volume-title":"NLLP","author":"Parizi Ali\u00a0Hakimi","year":"2023","unstructured":"Ali\u00a0Hakimi Parizi, Yuyang Liu, Prudhvi Nokku, Sina Gholamian, and David Emerson. 2023. A Comparative Study of Prompting Strategies for Legal Text Classification. In NLLP. 258\u2013265."},{"key":"e_1_3_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.4337\/9781802208030.00032"},{"key":"e_1_3_3_2_45_2","doi-asserted-by":"crossref","unstructured":"David Rodriguez Ian Yang Jose\u00a0M Del\u00a0Alamo and Norman Sadeh. 2024. Large language models: a new approach for privacy policy analysis at scale. Computing 106 12 (2024) 3879\u20133903.","DOI":"10.1007\/s00607-024-01331-9"},{"key":"e_1_3_3_2_46_2","doi-asserted-by":"crossref","unstructured":"Federico Ruggeri Francesca Lagioia Marco Lippi and Paolo Torroni. 2022. Detecting and explaining unfairness in consumer contracts through memory networks. Artificial Intelligence and Law 30 1 (2022) 59\u201392.","DOI":"10.1007\/s10506-021-09288-2"},{"key":"e_1_3_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2024.findings-acl.275"},{"key":"e_1_3_3_2_48_2","first-page":"2339","volume-title":"NAACL-HLT","author":"Schick Timo","year":"2021","unstructured":"Timo Schick and Hinrich Sch\u00fctze. 2021. It\u2019s Not Just Size That Matters: Small Language Models Are Also Few-Shot Learners. In NAACL-HLT. Association for Computational Linguistics, 2339\u20132352."},{"key":"e_1_3_3_2_49_2","volume-title":"ICLR","author":"Sclar Melanie","year":"2024","unstructured":"Melanie Sclar, Yejin Choi, Yulia Tsvetkov, and Alane Suhr. 2024. Quantifying Language Models\u2019 Sensitivity to Spurious Features in Prompt Design or: How I learned to start worrying about prompt formatting. In ICLR. OpenReview.net."},{"key":"e_1_3_3_2_50_2","volume-title":"AI4AJ@ICAIL","author":"Tan Jinzhe","year":"2023","unstructured":"Jinzhe Tan, Hannes Westermann, and Karim Benyekhlef. 2023. ChatGPT as an Artificial Lawyer?. In AI4AJ@ICAIL , Vol.\u00a03435. CEUR-WS.org."},{"key":"e_1_3_3_2_51_2","unstructured":"Chenhao Tang Zhengliang Liu Chong Ma Zihao Wu Yiwei Li Wei Liu Dajiang Zhu Quanzheng Li Xiang Li Tianming Liu and Lei Fan. 2023. PolicyGPT: Automated Analysis of Privacy Policies with Large Language Models. CoRR abs\/2309.10238 (2023)."},{"key":"e_1_3_3_2_52_2","unstructured":"Mistral\u00a0AI team. 2024. Codestral. https:\/\/mistral.ai\/news\/codestral\/"},{"key":"e_1_3_3_2_53_2","unstructured":"Mistral\u00a0AI team. 2024. Mistral nemo. https:\/\/mistral.ai\/news\/mistral-nemo\/"},{"key":"e_1_3_3_2_54_2","unstructured":"Microsoft Phi-3 team. 2024. Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone."},{"key":"e_1_3_3_2_55_2","doi-asserted-by":"publisher","DOI":"10.1145\/3180445.3180447"},{"key":"e_1_3_3_2_56_2","first-page":"990","volume-title":"WWW","author":"Tsai Elisa","year":"2025","unstructured":"Elisa Tsai, Neal Mangaokar, Boyuan Zheng, Haizhong Zheng, and Atul Prakash. 2025. Harmful Terms and Where to Find Them: Measuring and Modeling Unfavorable Financial Terms and Conditions in Shopping Websites at Scale. In WWW. ACM, 990\u20131003."},{"key":"e_1_3_3_2_57_2","unstructured":"Fangyi Yu Lee Quartey and Frank Schilder. 2022. Legal Prompting: Teaching a Language Model to Think Like a Lawyer. CoRR abs\/2212.01326 (2022)."},{"key":"e_1_3_3_2_58_2","first-page":"12697","volume-title":"International conference on machine learning","author":"Zhao Zihao","year":"2021","unstructured":"Zihao Zhao, Eric Wallace, Shi Feng, Dan Klein, and Sameer Singh. 2021. Calibrate before use: Improving few-shot performance of language models. In International conference on machine learning. PMLR, 12697\u201312706."},{"key":"e_1_3_3_2_59_2","volume-title":"ICLR","author":"Zheng Chujie","year":"2024","unstructured":"Chujie Zheng, Hao Zhou, Fandong Meng, Jie Zhou, and Minlie Huang. 2024. Large Language Models Are Not Robust Multiple Choice Selectors. In ICLR."}],"event":{"name":"ICAIL 2025: 20th International Conference on Artificial Intelligence and Law","location":"Chicago , IL , USA","acronym":"ICAIL 2025"},"container-title":["Proceedings of the Twentieth International Conference on Artificial Intelligence and Law"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3769126.3769218","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,1,13]],"date-time":"2026-01-13T15:45:56Z","timestamp":1768319156000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3769126.3769218"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,16]]},"references-count":58,"alternative-id":["10.1145\/3769126.3769218","10.1145\/3769126"],"URL":"https:\/\/doi.org\/10.1145\/3769126.3769218","relation":{},"subject":[],"published":{"date-parts":[[2025,6,16]]},"assertion":[{"value":"2026-01-13","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}