{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,9]],"date-time":"2026-03-09T18:10:12Z","timestamp":1773079812174,"version":"3.50.1"},"reference-count":23,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2024,7,1]],"date-time":"2024-07-01T00:00:00Z","timestamp":1719792000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,7,1]],"date-time":"2024-07-01T00:00:00Z","timestamp":1719792000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Hochschule Reutlingen \/ Reutlingen University"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Artif Intell Law"],"published-print":{"date-parts":[[2025,9]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>In the evolving landscape of legal information systems, ChatGPT-4 and other advanced conversational agents (CAs) offer the potential to disruptively transform the law industry. This study evaluates commercially available CAs within the German legal context, thereby assessing the generalizability of previous U.S.-based findings. Employing a unique corpus of 200 distinct legal tasks, ChatGPT-4 was benchmarked against Google\u00a0Bard, Google Gemini, and its predecessor, ChatGPT-3.5. Human-expert and automated assessments of 4000 CA-generated responses reveal ChatGPT-4 to be the first CA to surpass the threshold of solving realistic legal tasks and passing a German business law exam. While ChatGPT-4 outperforms ChatGPT-3.5, Google Bard, and Google Gemini in both consistency and quality, the results demonstrate a considerable degree of variability, especially in complex cases with no predefined response options. Based on these findings, legal professionals should manually verify all texts produced by CAs before use. Novices must exercise caution with CA-generated legal advice, given the expertise needed for its assessment.<\/jats:p>","DOI":"10.1007\/s10506-024-09406-w","type":"journal-article","created":{"date-parts":[[2024,7,1]],"date-time":"2024-07-01T16:31:32Z","timestamp":1719851492000},"page":"847-871","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["The digital transformation of jurisprudence: an evaluation of ChatGPT-4\u2019s applicability to solve cases in business law"],"prefix":"10.1007","volume":"33","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4154-6010","authenticated-orcid":false,"given":"Sascha","family":"Schweitzer","sequence":"first","affiliation":[]},{"given":"Markus","family":"Conrads","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2024,7,1]]},"reference":[{"key":"9406_CR1","first-page":"1","volume":"2022","author":"M Abdullah","year":"2022","unstructured":"Abdullah M, Mubin O, Javed A (2022) ChatGPT: fundamentals, applications and social impacts. Syst Netw Algorithms (SNAMS) 2022:1\u20138","journal-title":"Syst Netw Algorithms (SNAMS)"},{"key":"9406_CR2","unstructured":"Abramson J, Ahuja A, Carnevale F, Georgiev P, Goldin A, Hung A, Landon J, Lhotka J, Lillicrap T, Muldal A, Powell G, Santoro A, Scully G, Srivastava S, von Glehn T, Wayne G, Wong N, Yan C, Zhu R (2022) Improving multimodal interactive agents with reinforcement learning from human feedback. pp 1\u201326. Working Paper. http:\/\/arxiv.org\/abs\/2211.11602"},{"key":"9406_CR3","doi-asserted-by":"publisher","unstructured":"Bommarito MJ, Katz DM (2023) GPT takes the bar exam. SSRN Electronic Journal, pp 1\u20137. Working Paper. https:\/\/doi.org\/10.2139\/ssrn.4314839","DOI":"10.2139\/ssrn.4314839"},{"issue":"3","key":"9406_CR4","doi-asserted-by":"publisher","first-page":"1","DOI":"10.53761\/1.20.3.02","volume":"20","author":"A Bryant","year":"2023","unstructured":"Bryant A, Bryant R (2023) Leadership is needed for ethical ChatGPT: character, assessment, and learning using artificial intelligence (AI). J Educ Leadersh 20(3):1\u201315. https:\/\/doi.org\/10.53761\/1.20.3.02","journal-title":"J Educ Leadersh"},{"key":"9406_CR5","unstructured":"Bubeck S, Chandrasekaran V, Eldan R, Gehrke J, Horvitz E, Kamar E, Lee P, Lee YT, Li Y, Lundberg S, Nori H, Palangi H, Ribeiro MT, Zhang Y (2023) Sparks of artificial general intelligence: early experiments with GPT-4. Technical Report. http:\/\/arxiv.org\/abs\/2303.12712"},{"key":"9406_CR6","doi-asserted-by":"crossref","unstructured":"Choi JH, Hickman KE, Monahan AB, Schwarcz D (2023) ChatGPT goes to law school. Working Paper. https:\/\/ssrn.com\/abstract=4335905","DOI":"10.2139\/ssrn.4335905"},{"key":"9406_CR7","doi-asserted-by":"publisher","unstructured":"Gillingham K, Rapson D, Wagner G (2016) Designing policies to make cars greener: a review of the literature. In: National Bureau of Economic Research. Working Paper. https:\/\/doi.org\/10.3386\/W22242","DOI":"10.3386\/W22242"},{"key":"9406_CR8","unstructured":"Haque MU, Dharmadasa I, Sworna ZT, Rajapakse RN, Ahmad H (2022) I think this is the most disruptive technology: exploring sentiments of ChatGPT early adopters using twitter data. arXiv:2212.05856"},{"key":"9406_CR9","doi-asserted-by":"crossref","unstructured":"Hsu H, Hsu K, Hou S, Wu C, Hsieh Y, Cheng Y-D (2023, forthcoming) Examining real-world medication consultations and drug-herb interactions in Taiwan: an evaluation of ChatGPT\u2019s performance. JMIR Med Educ","DOI":"10.2196\/preprints.48433"},{"issue":"2023","key":"9406_CR10","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.inffus.2023.101861","volume":"99","author":"J Koco\u0144","year":"2023","unstructured":"Koco\u0144 J, Cichecki I, Kaszyca O, Kochanek M, Szyd\u0142o D, Baran J, Bielaniewicz J, Gruza M, Janz A, Kanclerz K, Koco\u0144 A, Koptyra B, Mieleszczenko-Kowszewicz W, Mi\u0142kowski P, Oleksy M, Piasecki M, Radli\u0144ski \u0141, Wojtasik K, Wo\u017aniak S, Kazienko P (2023) ChatGPT: jack of all trades, master of none. Inf Fusion 99(2023):1\u201337. https:\/\/doi.org\/10.1016\/j.inffus.2023.101861","journal-title":"Inf Fusion"},{"issue":"4","key":"9406_CR11","doi-asserted-by":"publisher","first-page":"45","DOI":"10.1093\/OSO\/9780190080365.003.0004","volume":"12","author":"B Light","year":"2020","unstructured":"Light B (2020) The ELIZA effect. J Comput Hist 12(4):45\u201360. https:\/\/doi.org\/10.1093\/OSO\/9780190080365.003.0004","journal-title":"J Comput Hist"},{"key":"9406_CR12","unstructured":"Liu H, Ning R, Teng Z, Liu J, Zhou Q, Zhang Y (2023) Evaluating the logical reasoning ability of ChatGPT and GPT-4. Working Paper. http:\/\/arxiv.org\/abs\/2304.03439"},{"key":"9406_CR13","unstructured":"OpenAI (2023) GPT-4 technical report. White Paper. http:\/\/arxiv.org\/abs\/2303.08774"},{"key":"9406_CR14","unstructured":"Paris M (2023) ChatGPT Hits 100 million users, Google invests in AI bot and CatGPT goes viral. https:\/\/www.forbes.com\/sites\/martineparis\/2023\/02\/03\/chatgpt-hits-100-million-microsoft-unleashes-ai-bots-and-catgpt-goes-viral\/"},{"key":"9406_CR15","doi-asserted-by":"publisher","DOI":"10.1007\/s10796-023-10375-9","author":"S Sch\u00f6bel","year":"2023","unstructured":"Sch\u00f6bel S, Schmitt A, Benner D, Saqr M, Janson A, Leimeister JM (2023) Charting the evolution and future of conversational agents: a research agenda along five waves and new frontiers. Inf Syst Front. https:\/\/doi.org\/10.1007\/s10796-023-10375-9","journal-title":"Inf Syst Front"},{"key":"9406_CR23","unstructured":"Shen X, Chen Z, Backes M, Zhang Y (2023) In ChatGPT We Trust? Measuring and Characterizing the Reliability of ChatGPT. Working Paper, arXiv:2304.08979"},{"key":"9406_CR16","doi-asserted-by":"publisher","DOI":"10.1108\/ijshe.2009.24910cae.004","author":"S Sorrell","year":"2009","unstructured":"Sorrell S (2009) Energy efficiency and sustainable consumption: the rebound effect. Energy, Clim Environ. https:\/\/doi.org\/10.1108\/ijshe.2009.24910cae.004","journal-title":"Energy, Clim Environ"},{"key":"9406_CR17","unstructured":"StackOverflow (2022) Temporary policy: generative AI (e.g., ChatGPT) is banned. https:\/\/meta.stackoverflow.com\/questions\/421831\/temporary-policy-chatgpt-is-banned"},{"issue":"2","key":"9406_CR18","doi-asserted-by":"publisher","first-page":"95","DOI":"10.1007\/s12599-023-00795-x","volume":"65","author":"T Teubner","year":"2023","unstructured":"Teubner T, Flath CM, Weinhardt C, van der Aalst W, Hinz O (2023) Welcome to the Era of ChatGPT et al.: the prospects of large language models. Bus Inf Syst Eng 65(2):95\u2013101. https:\/\/doi.org\/10.1007\/s12599-023-00795-x","journal-title":"Bus Inf Syst Eng"},{"key":"9406_CR19","unstructured":"Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser \u0141, Polosukhin I (2017) Attention is all you need. In: 31st conference on neural information processing systems (NIPS 2017), vol 2017, pp 5999\u20136009"},{"key":"9406_CR20","unstructured":"West CG (2023) AI and the FCI: can ChatGPT project an understanding of introductory physics? Working Paper. http:\/\/arxiv.org\/abs\/2303.01067"},{"key":"9406_CR21","unstructured":"Xuan-Quy D, Ngoc-Bich L, Xuan-Dung P, Bac-Bien N, The-Duy V (2023) Evaluation of ChatGPT and microsoft bing AI chat performances on physics exams of Vietnamese national high school graduation examination. Working Paper. http:\/\/arxiv.org\/abs\/2306.04538"},{"issue":"4","key":"9406_CR22","doi-asserted-by":"publisher","first-page":"502","DOI":"10.18178\/ijmerr.9.4.502-510","volume":"9","author":"L Zhang","year":"2020","unstructured":"Zhang L (2020) An overview of machine learning in chatbots. Int J Mech Eng Robot Res 9(4):502\u2013510. https:\/\/doi.org\/10.18178\/ijmerr.9.4.502-510","journal-title":"Int J Mech Eng Robot Res"}],"updated-by":[{"DOI":"10.1007\/s10506-024-09417-7","type":"correction","label":"Correction","source":"publisher","updated":{"date-parts":[[2024,10,9]],"date-time":"2024-10-09T00:00:00Z","timestamp":1728432000000}}],"container-title":["Artificial Intelligence and Law"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10506-024-09406-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10506-024-09406-w\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10506-024-09406-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,9,23]],"date-time":"2025-09-23T08:05:54Z","timestamp":1758614754000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10506-024-09406-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7,1]]},"references-count":23,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2025,9]]}},"alternative-id":["9406"],"URL":"https:\/\/doi.org\/10.1007\/s10506-024-09406-w","relation":{"correction":[{"id-type":"doi","id":"10.1007\/s10506-024-09417-7","asserted-by":"object"}]},"ISSN":["0924-8463","1572-8382"],"issn-type":[{"value":"0924-8463","type":"print"},{"value":"1572-8382","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,7,1]]},"assertion":[{"value":"2 May 2024","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"1 July 2024","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 October 2024","order":3,"name":"change_date","label":"Change Date","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Correction","order":4,"name":"change_type","label":"Change Type","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"A Correction to this paper has been published:","order":5,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"https:\/\/doi.org\/10.1007\/s10506-024-09417-7","URL":"https:\/\/doi.org\/10.1007\/s10506-024-09417-7","order":6,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"All authors have reviewed the final version of the manuscript and consent to its publication.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}}]}}