{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,6]],"date-time":"2026-03-06T18:20:25Z","timestamp":1772821225313,"version":"3.50.1"},"reference-count":53,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2022,10,21]],"date-time":"2022-10-21T00:00:00Z","timestamp":1666310400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,10,21]],"date-time":"2022-10-21T00:00:00Z","timestamp":1666310400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"JST","award":["Fusion Oriented REsearch for disruptive Science and Technology"],"award-info":[{"award-number":["Fusion Oriented REsearch for disruptive Science and Technology"]}]},{"DOI":"10.13039\/501100004721","name":"University of Tokyo","doi-asserted-by":"publisher","award":["FSI Research Grant"],"award-info":[{"award-number":["FSI Research Grant"]}],"id":[{"id":"10.13039\/501100004721","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Artif Intell Law"],"published-print":{"date-parts":[[2023,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Court judgments contain valuable information on how statutory laws and past court precedents are interpreted and how the interdependence structure among them evolves in the courtroom. Data-mining the evolving structure of such customs and norms that reflect myriad social values from a large-scale court judgment corpus is an essential task from both the academic and industrial perspectives. In this paper, using data from approximately 110,000 court judgments from Japan spanning the period 1998\u20132018 from the district to the supreme court level, we propose two tasks that grasp such a structure from court judgments and highlight the strengths and weaknesses of major machine learning models. One is a prediction task based on masked language modeling that connects textual information to legal codes and past court precedents. Another is a dynamic link prediction task where we predict the hidden interdependence structure in the law. We make quantitative and qualitative comparisons among major machine learning models to obtain insights for future developments.<\/jats:p>","DOI":"10.1007\/s10506-022-09336-5","type":"journal-article","created":{"date-parts":[[2022,10,21]],"date-time":"2022-10-21T08:04:59Z","timestamp":1666339499000},"page":"739-771","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Masked prediction and interdependence network of the law using data from large-scale Japanese court judgments"],"prefix":"10.1007","volume":"31","author":[{"given":"Ryoma","family":"Kondo","sequence":"first","affiliation":[]},{"given":"Takahiro","family":"Yoshida","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4452-0302","authenticated-orcid":false,"given":"Ryohei","family":"Hisano","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2022,10,21]]},"reference":[{"key":"9336_CR1","doi-asserted-by":"crossref","unstructured":"Adamic E, Adar LA (2003) Friends and neighbors on the web (3):211\u2013230","DOI":"10.1016\/S0378-8733(03)00009-1"},{"key":"9336_CR2","unstructured":"Alex L, Haven L, Michel S, Slater D (2020) Policy disruption early warning system. Google Patents. US Patent 10,776,891"},{"key":"9336_CR3","first-page":"339","volume":"2019","author":"AB Badawi","year":"2019","unstructured":"Badawi AB, Dari-Mattiacci G (2019) Reference networks and civil codes. See Livermore Rockmore 2019:339\u2013365","journal-title":"See Livermore Rockmore"},{"key":"9336_CR4","first-page":"993","volume":"3","author":"DM Blei","year":"2003","unstructured":"Blei DM, Ng AY, Jordan MI (2003) Latent dirichlet allocation. J Mach Learn Res 3:993\u20131022","journal-title":"J Mach Learn Res"},{"issue":"4","key":"9336_CR5","doi-asserted-by":"publisher","first-page":"333","DOI":"10.1007\/s10506-011-9116-1","volume":"19","author":"R Boulet","year":"2011","unstructured":"Boulet R, Mazzega P, Bourcier D (2011) A network approach to the french system of legal codes-part i: analysis of a dense network. Artif Intell Law 19(4):333\u2013355","journal-title":"Artif Intell Law"},{"issue":"1","key":"9336_CR6","doi-asserted-by":"publisher","first-page":"23","DOI":"10.1007\/s10506-017-9204-y","volume":"26","author":"R Boulet","year":"2018","unstructured":"Boulet R, Mazzega P, Bourcier D (2018) Network approach to the french system of legal codes part ii: the role of the weights in a network. Artif Intell Law 26(1):23\u201347","journal-title":"Artif Intell Law"},{"issue":"2","key":"9336_CR7","doi-asserted-by":"publisher","first-page":"171","DOI":"10.1007\/s10506-018-9238-9","volume":"27","author":"I Chalkidis","year":"2019","unstructured":"Chalkidis I, Kampas D (2019) Deep learning in law: early adaptation and legal word embeddings trained on large corpora. Artif Intell Law 27(2):171\u2013198","journal-title":"Artif Intell Law"},{"key":"9336_CR8","doi-asserted-by":"crossref","unstructured":"Chalkidis I, Fergadiotis M, Malakasiotis P, Aletras N, Androutsopoulos I (2020) Legal-bert: The muppets straight out of law school. arXiv preprint arXiv:2010.02559","DOI":"10.18653\/v1\/2020.findings-emnlp.261"},{"key":"9336_CR9","doi-asserted-by":"crossref","unstructured":"Chen T, Guestrin C (2016) Xgboost: A scalable tree boosting system. In: Proceedings of the 22nd Acm Sigkdd International Conference on Knowledge Discovery and Data Mining, pp. 785\u2013794","DOI":"10.1145\/2939672.2939785"},{"key":"9336_CR10","doi-asserted-by":"publisher","first-page":"269","DOI":"10.3389\/fphy.2021.658463","volume":"9","author":"C Coupette","year":"2021","unstructured":"Coupette C, Beckedorf J, Hartung D, Bommarito M, Katz DM (2021) Measuring law over time: a network analytical framework with an application to statutes and regulations in the united states and germany. Front Phys 9:269","journal-title":"Front Phys"},{"key":"9336_CR11","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1007\/s10506-020-09261-5","volume":"29","author":"F Dadgostari","year":"2020","unstructured":"Dadgostari F, Guim M, Beling PA, Livermore MA, Rockmore DN (2020) Modeling law search as prediction. Artif Intell Law 29:3\u201334","journal-title":"Artif Intell Law"},{"issue":"1","key":"9336_CR12","doi-asserted-by":"publisher","first-page":"16","DOI":"10.1016\/j.socnet.2007.05.001","volume":"30","author":"JH Fowler","year":"2008","unstructured":"Fowler JH, Jeon S (2008) The authority of supreme court precedent. Soc Netw 30(1):16\u201330","journal-title":"Soc Netw"},{"key":"9336_CR13","unstructured":"Grand bench of the supreme court of 1973 (a) no. 910 of september 10, 1975, keishu vol.29, no.8, at 489"},{"key":"9336_CR14","doi-asserted-by":"crossref","unstructured":"Grover A, Leskovec J (2016) node2vec scalable feature learning for networks. Proceedings of the 22nd ACM SIGKDD international conference on Knowledge discovery and data mining, pp 855\u2013864","DOI":"10.1145\/2939672.2939754"},{"key":"9336_CR15","unstructured":"Hayek FA (1973) Law, legislation and liberty, volume 1: Rules and order"},{"key":"9336_CR16","doi-asserted-by":"publisher","first-page":"109","DOI":"10.1016\/0378-8733(83)90021-7","volume":"5","author":"P Holland","year":"1983","unstructured":"Holland P, Laskey KB, Leinhardt S (1983) Stochastic blockmodels: first steps. Soc Netw 5:109\u2013137","journal-title":"Soc Netw"},{"key":"9336_CR17","doi-asserted-by":"crossref","unstructured":"Hustler magazine, inc. v. falwell, 485 u.s. 46 (1988)","DOI":"10.2307\/4611955"},{"issue":"6","key":"9336_CR18","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1371\/journal.pone.0098679","volume":"9","author":"M Jacomy","year":"2014","unstructured":"Jacomy M, Venturini T, Heymann S, Bastian M (2014) Forceatlas2, a continuous graph layout algorithm for handy network visualization designed for the gephi software. PLoS ONE 9(6):1\u201312. https:\/\/doi.org\/10.1371\/journal.pone.0098679","journal-title":"PLoS ONE"},{"key":"9336_CR53","unstructured":"Japanese law translation. http:\/\/www.japaneselawtranslation.go.jp\/"},{"key":"9336_CR19","unstructured":"Jones CPA (2020) The Japanese legal system in a nutshell. The Japanese legal system. West Academic, St. Paul, Minn., United States"},{"key":"9336_CR20","unstructured":"Judgment of the second petty bench of 2004 (ju) 1518 of january 13, 2006, minshu vol. 60, no. 1"},{"key":"9336_CR21","unstructured":"Judgment of the second petty bench of 2005 (ju) 1970 of july 13, 2007, minshu vol. 61, no. 5"},{"key":"9336_CR22","unstructured":"Judgment of the grand bench of 2016 (a) 442 of march 15, 2017, keishu vol. 71, no. 3"},{"key":"9336_CR23","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevE.83.016107","volume":"83","author":"B Karrer","year":"2011","unstructured":"Karrer B, Newman MEJ (2011) Stochastic blockmodels and community structure in networks. Phys Rev E 83:016107","journal-title":"Phys Rev E"},{"key":"9336_CR24","unstructured":"Kipf TN, Welling M (2017) Semi-supervised classification with graph convolutional networks. ICLR"},{"issue":"2","key":"9336_CR25","doi-asserted-by":"publisher","first-page":"243","DOI":"10.1093\/comnet\/cnx029","volume":"6","author":"M Koniaris","year":"2018","unstructured":"Koniaris M, Anagnostopoulos I, Vassiliou Y (2018) Network analysis in the legal domain: a complex model for European union legal sources. J Complex Netw 6(2):243\u2013268","journal-title":"J Complex Netw"},{"key":"9336_CR26","unstructured":"La\u00a0Cava L, Simeri A, Tagarelli A (2021) The Italian civil code network analysis"},{"key":"9336_CR27","unstructured":"Le Q, Mikolov T (2014) Distributed representations of sentences and documents. In: International Conference on Machine Learning, pp. 1188\u20131196. PMLR"},{"issue":"1","key":"9336_CR28","doi-asserted-by":"publisher","first-page":"194","DOI":"10.1016\/j.ipm.2014.07.003","volume":"51","author":"Y-H Liu","year":"2015","unstructured":"Liu Y-H, Chen Y-L, Ho W-L (2015) Predicting associated statutes for legal problems. Inf Process Manag 51(1):194\u2013211","journal-title":"Inf Process Manag"},{"key":"9336_CR29","unstructured":"Lyte A, Slater D, Michel S (2015) Network measures of the united states code. Technical report, MITRE CORP MCLEAN VA"},{"key":"9336_CR30","first-page":"2579","volume":"9","author":"L van der Maaten","year":"2008","unstructured":"van der Maaten L, Hinton G (2008) Visualizing data using t-SNE. J Mach Learn Res 9:2579\u20132605","journal-title":"J Mach Learn Res"},{"key":"9336_CR31","doi-asserted-by":"crossref","unstructured":"Mazzega P, Bourcier D, Boulet R (2009) The network of french legal codes. In: Proceedings of the 12th International Conference on Artificial Intelligence and Law, pp. 236\u2013237","DOI":"10.1145\/1568234.1568271"},{"issue":"2","key":"9336_CR32","doi-asserted-by":"publisher","first-page":"237","DOI":"10.1007\/s10506-019-09255-y","volume":"28","author":"M Medvedeva","year":"2020","unstructured":"Medvedeva M, Vols M, Wieling M (2020) Using machine learning to predict decisions of the european court of human rights. Artif Intell Law 28(2):237\u2013266","journal-title":"Artif Intell Law"},{"key":"9336_CR33","unstructured":"Morimoto A, Kubo D, Sato M, Shindo H, Matsumoto Y (2017) Legal question answering system using neural attention. COLIEE@ ICAIL 2017:79\u201389"},{"key":"9336_CR34","unstructured":"Nanda R, Adebayo KJ, Di\u00a0Caro L, Boella G, Robaldo L (2017) Legal information retrieval using topic clustering and neural networks. In: COLIEE@ ICAIL, pp. 68\u201378"},{"issue":"2","key":"9336_CR35","doi-asserted-by":"publisher","first-page":"169","DOI":"10.1007\/s10506-018-9225-1","volume":"26","author":"T-S Nguyen","year":"2018","unstructured":"Nguyen T-S, Nguyen L-M, Tojo S, Satoh K, Shimazu A (2018) Recurrent neural network-based models for recognizing requisite and effectuation parts in legal texts. Artif Intell Law 26(2):169\u2013199","journal-title":"Artif Intell Law"},{"key":"9336_CR36","unstructured":"Nguyen H-T, Nguyen PM, Vuong T-H-Y, Bui QM, Nguyen CM, Dang BT, Tran V, Nguyen ML, Satoh K (2021) Jnlp team: Deep learning approaches for legal processing tasks in coliee 2021. arXiv preprint arXiv:2106.13405"},{"key":"9336_CR37","unstructured":"Page L, Brin S, Motwani R, Winograd T (1998) The pagerank citation ranking: Bringing order to the web. In: Proceedings of the 7th International World Wide Web Conference, Brisbane, Australia, pp. 161\u2013172. http:\/\/citeseer.nj.nec.com\/page98pagerank.html"},{"key":"9336_CR38","unstructured":"Raffel C, Shazeer N, Roberts A, Lee K, Narang S, Matena M, Zhou Y, Li W, Liu PJ (2019) Exploring the limits of transfer learning with a unified text-to-text transformer. arXiv preprint arXiv:1910.10683"},{"issue":"2","key":"9336_CR39","doi-asserted-by":"publisher","first-page":"127","DOI":"10.1007\/s10506-018-9217-1","volume":"26","author":"A Sadeghian","year":"2018","unstructured":"Sadeghian A, Sundaram L, Wang DZ, Hamilton WF, Branting K, Pfeifer C (2018) Automatic semantic edge labeling over legal citation graphs. Artif Intell Law 26(2):127\u2013144","journal-title":"Artif Intell Law"},{"issue":"1","key":"9336_CR40","doi-asserted-by":"publisher","first-page":"35","DOI":"10.1007\/s10506-020-09263-3","volume":"29","author":"N Sakhaee","year":"2021","unstructured":"Sakhaee N, Wilson MC (2021) Information extraction framework to build legislation network. Artif Intell Law 29(1):35\u201358","journal-title":"Artif Intell Law"},{"issue":"1","key":"9336_CR41","doi-asserted-by":"publisher","first-page":"107","DOI":"10.1007\/s10506-017-9197-6","volume":"25","author":"O Shulayeva","year":"2017","unstructured":"Shulayeva O, Siddharthan A, Wyner A (2017) Recognizing cited facts and principles in legal judgements. Artif Intell Law 25(1):107\u2013126","journal-title":"Artif Intell Law"},{"key":"9336_CR42","doi-asserted-by":"crossref","unstructured":"Smith A, Meek RL, Raphael DD, Stein P (1982) The Glasgow Edition of the Works and Correspondence of Adam Smith: Lectures on Jurisprudence. The Glasgow Edition of the Works and Correspondence of Adam Smith. Liberty Fund. https:\/\/books.google.co.jp\/books?id=YTmgngEACAAJ","DOI":"10.1093\/actrade\/9780198281863.book.1"},{"key":"9336_CR43","unstructured":"Sulea O-M, Zampieri M, Malmasi S, Vela M, Dinu LP, Van\u00a0Genabith J (2017) Exploring the use of text classification in the legal domain. arXiv preprint arXiv:1710.09306"},{"key":"9336_CR44","doi-asserted-by":"crossref","unstructured":"Tagarelli A, Simeri A (2021) Unsupervised law article mining based on deep pre-trained language representation models with application to the italian civil code. Artif Intell Law, 1\u201357","DOI":"10.1007\/s10506-021-09301-8"},{"key":"9336_CR45","doi-asserted-by":"publisher","DOI":"10.1017\/9781316979778","volume-title":"A realistic theory of law","author":"BZ Tamanaha","year":"2017","unstructured":"Tamanaha BZ (2017) A realistic theory of law. Cambridge University Press, Cambridge"},{"key":"9336_CR46","doi-asserted-by":"crossref","unstructured":"Tamanaha BZ, Z TB (2004) On the rule of law: history, politics, theory","DOI":"10.1017\/CBO9780511812378"},{"key":"9336_CR47","doi-asserted-by":"crossref","unstructured":"Wang P, Yang Z, Niu S, Zhang Y, Zhang L, Niu S (2018) Modeling dynamic pairwise attention for crime classification over legal articles. In: the 41st International ACM SIGIR Conference on Research & Development in Information Retrieval, pp. 485\u2013494","DOI":"10.1145\/3209978.3210057"},{"key":"9336_CR48","doi-asserted-by":"crossref","unstructured":"Yamakoshi T, Komamizu T, Ogawa Y, Toyama K (2019) Japanese mistakable legal term correction using infrequency-aware bert classifier. In: 2019 IEEE International Conference on Big Data (Big Data), pp. 4342\u20134351. IEEE","DOI":"10.1109\/BigData47090.2019.9006511"},{"key":"9336_CR49","doi-asserted-by":"crossref","unstructured":"Yang Y, Cer D, Ahmad A, Guo M, Law J, Constant N, Abrego GH, Yuan S, Tar C, Sung Y-H, et al. (2019) Multilingual universal sentence encoder for semantic retrieval. arXiv preprint arXiv:1907.04307","DOI":"10.18653\/v1\/2020.acl-demos.12"},{"key":"9336_CR50","doi-asserted-by":"crossref","unstructured":"Yoshioka M, Aoki Y, Suzuki Y (2021) Bert-based ensemble methods with data augmentation for legal textual entailment in coliee statute law task. In: Proceedings of the Eighteenth International Conference on Artificial Intelligence and Law, pp. 278\u2013284","DOI":"10.1145\/3462757.3466105"},{"key":"9336_CR51","doi-asserted-by":"publisher","first-page":"1953","DOI":"10.1007\/s10618-019-00650-2","volume":"33","author":"D Zhang","year":"2019","unstructured":"Zhang D, Yin J, Zhu X, Zhang C (2019) Attributed network embedding via subspace discovery. Data Min Knowl Discov. 33: 1953","journal-title":"Data Min Knowl Discov"},{"key":"9336_CR52","doi-asserted-by":"crossref","unstructured":"Zhang P, Koppaka L (2007) Semantics-based legal citation network, 123\u2013130","DOI":"10.1145\/1276318.1276342"}],"container-title":["Artificial Intelligence and Law"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10506-022-09336-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10506-022-09336-5\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10506-022-09336-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,10,21]],"date-time":"2023-10-21T07:05:53Z","timestamp":1697871953000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10506-022-09336-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,21]]},"references-count":53,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2023,12]]}},"alternative-id":["9336"],"URL":"https:\/\/doi.org\/10.1007\/s10506-022-09336-5","relation":{},"ISSN":["0924-8463","1572-8382"],"issn-type":[{"value":"0924-8463","type":"print"},{"value":"1572-8382","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,10,21]]},"assertion":[{"value":"26 September 2022","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 October 2022","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors have no competing interests to declare that are relevant to the content of this article.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}