{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,18]],"date-time":"2026-11-18T08:32:17Z","timestamp":1794990737708,"version":"4.9.1"},"reference-count":66,"publisher":"Association for Computing Machinery (ACM)","issue":"5","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Inf. Syst."],"published-print":{"date-parts":[[2025,9,30]]},"abstract":"<jats:p>Legal case retrieval aims to help legal workers find relevant cases related to their cases at hand, which is important for the guarantee of fairness and justice in legal judgments. While recent advances in neural retrieval methods have significantly improved the performance of open-domain retrieval tasks (e.g., Web search), their advantages haven\u2019t been observed in legal case retrieval due to their thirst for annotated data. As annotating large-scale training data in legal domains is prohibitive due to the need for domain expertise, traditional search techniques based on lexical matching such as TF-IDF, BM25, and Query Likelihood are still prevalent in legal case retrieval systems. While previous studies have designed several pre-training methods for IR models in open-domain tasks, these methods are usually suboptimal in legal case retrieval because they cannot understand and capture the key knowledge and data structures in the legal corpus. To this end, we propose a novel pre-training framework named Caseformer that enables the pre-trained models to learn legal knowledge and domain-specific relevance-matching patterns in legal case retrieval without any human-labeled data. This framework is designed to support both dense retrieval models and neural re-ranking models. Through three unsupervised learning tasks, Caseformer is able to capture the special language, document structure, and relevance-matching patterns of legal case documents, making it a strong backbone for downstream legal case retrieval tasks. Experimental results show that our model has achieved state-of-the-art performance in both zero-shot and fine-tuning settings. Also, experiments on both Chinese and English legal datasets demonstrate that the effectiveness of Caseformer is language-independent in legal case retrieval.<\/jats:p>","DOI":"10.1145\/3735127","type":"journal-article","created":{"date-parts":[[2025,6,4]],"date-time":"2025-06-04T13:25:31Z","timestamp":1749043531000},"page":"1-27","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["Pre-training for Legal Case Retrieval Based on Inter-Case Distinctions"],"prefix":"10.1145","volume":"43","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8718-9402","authenticated-orcid":false,"given":"Weihang","family":"Su","sequence":"first","affiliation":[{"name":"Quan Cheng Laboratory, Department of Computer Science and Technology, Institute for Internet Judiciary, Tsinghua University, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5030-709X","authenticated-orcid":false,"given":"Qingyao","family":"Ai","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Technology, Institute for Internet Judiciary, Tsinghua University, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2539-8954","authenticated-orcid":false,"given":"Yueyue","family":"Wu","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Technology, Institute for Internet Judiciary, Tsinghua University, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-1121-1227","authenticated-orcid":false,"given":"Anzhe","family":"Xie","sequence":"additional","affiliation":[{"name":"School of Electronics Engineering and Computer Science, Peking University, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-5460-5279","authenticated-orcid":false,"given":"Changyue","family":"Wang","sequence":"additional","affiliation":[{"name":"Quan Cheng Laboratory, Department of Computer Science and Technology, Institute for Internet Judiciary, Tsinghua University, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2107-7408","authenticated-orcid":false,"given":"Yixiao","family":"Ma","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Technology, Institute for Internet Judiciary, Tsinghua University, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-8766-8610","authenticated-orcid":false,"given":"Haitao","family":"Li","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Technology, Institute for Internet Judiciary, Tsinghua University, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2473-3746","authenticated-orcid":false,"given":"Zhijing","family":"Wu","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Beijing Institute of Technology, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0140-4512","authenticated-orcid":false,"given":"Yiqun","family":"Liu","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Technology, Institute for Internet Judiciary, Tsinghua University, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3158-1920","authenticated-orcid":false,"given":"Min","family":"Zhang","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Technology, Institute for Internet Judiciary, Tsinghua University, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2025,7,22]]},"reference":[{"key":"e_1_3_2_2_2","first-page":"135","volume-title":"Proceedings of the 41st International ACM SIGIR Conference on Research & Development in Information Retrieval","author":"Ai Qingyao","year":"2018","unstructured":"Qingyao Ai, Keping Bi, Jiafeng Guo, and W. Bruce Croft. 2018. Learning a deep listwise context model for ranking refinement. In Proceedings of the 41st International ACM SIGIR Conference on Research & Development in Information Retrieval, 135\u2013144."},{"key":"e_1_3_2_3_2","unstructured":"Iz Beltagy Matthew E. Peters and Arman Cohan. 2020. Longformer: The long-document transformer. arXiv:2004.05150. Retrieved from https:\/\/arxiv.org\/abs\/2004.05150"},{"key":"e_1_3_2_4_2","volume-title":"Statistics for Experimenters","author":"Box George E. P.","year":"1978","unstructured":"George E. P. Box, William H. Hunter, Stuart Hunter. 1978. Statistics for Experimenters. Vol. 664. John Wiley and Sons, New York."},{"key":"e_1_3_2_5_2","first-page":"129","volume-title":"Proceedings of the 24th International Conference on Machine Learning","author":"Cao Zhe","year":"2007","unstructured":"Zhe Cao, Tao Qin, Tie-Yan Liu, Ming-Feng Tsai, and Hang Li. 2007. Learning to rank: From pairwise approach to listwise approach. In Proceedings of the 24th International Conference on Machine Learning, 129\u2013136."},{"key":"e_1_3_2_6_2","doi-asserted-by":"crossref","unstructured":"Ilias Chalkidis Manos Fergadiotis Prodromos Malakasiotis Nikolaos Aletras and Ion Androutsopoulos. 2020. LEGAL-BERT: The muppets straight out of law school. arXiv:2010.02559. Retrieved from https:\/\/arxiv.org\/abs\/2010.02559","DOI":"10.18653\/v1\/2020.findings-emnlp.261"},{"key":"e_1_3_2_7_2","unstructured":"Wei-Cheng Chang Felix X. Yu Yin-Wen Chang Yiming Yang and Sanjiv Kumar. 2020. Pre-training tasks for embedding-based large-scale retrieval. arXiv:2002.03932. Retrieved from https:\/\/arxiv.org\/abs\/2002.03932"},{"key":"e_1_3_2_8_2","unstructured":"Jia Chen Haitao Li Weihang Su Qingyao Ai and Yiqun Liu. 2023. THUIR at WSDM cup 2023 task 1: Unbiased learning to rank. arXiv:2304.12650. Retrieved from https:\/\/arxiv.org\/abs\/2304.12650"},{"key":"e_1_3_2_9_2","doi-asserted-by":"crossref","first-page":"1524","DOI":"10.1145\/3477495.3531943","volume-title":"Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval","author":"Chen Jia","year":"2022","unstructured":"Jia Chen, Yiqun Liu, Yan Fang, Jiaxin Mao, Hui Fang, Shenghao Yang, Xiaohui Xie, Min Zhang, and Shaoping Ma. 2022. Axiomatically regularized pre-training for ad hoc search. In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, 1524\u20131534."},{"key":"e_1_3_2_10_2","first-page":"1569","volume-title":"Proceedings of the 15th ACM International Conference on Web Search and Data Mining","author":"Chen Xuesong","year":"2022","unstructured":"Xuesong Chen, Ziyi Ye, Xiaohui Xie, Yiqun Liu, Xiaorong Gao, Weihang Su, Shuqi Zhu, Yike Sun, Min Zhang, and Shaoping Ma. 2022. Web search via an efficient and effective brain-machine interface. In Proceedings of the 15th ACM International Conference on Web Search and Data Mining, 1569\u20131572."},{"key":"e_1_3_2_11_2","volume-title":"Empirical Methods for Artificial Intelligence","author":"Cohen Paul R.","year":"1995","unstructured":"Paul R. Cohen. 1995. Empirical Methods for Artificial Intelligence. Vol. 139. MIT Press Cambridge, MA."},{"key":"e_1_3_2_12_2","unstructured":"Alexis Conneau and Douwe Kiela. 2018. Senteval: An evaluation toolkit for universal sentence representations. arXiv:1803.05449. Retrieved from https:\/\/arxiv.org\/abs\/1803.05449"},{"key":"e_1_3_2_13_2","doi-asserted-by":"crossref","first-page":"3504","DOI":"10.1109\/TASLP.2021.3124365","article-title":"Pre-training with whole word masking for Chinese BERT","volume":"29","author":"Cui Yiming","year":"2021","unstructured":"Yiming Cui, Wanxiang Che, Ting Liu, Bing Qin, and Ziqing Yang. 2021. Pre-training with whole word masking for Chinese BERT. IEEE\/ACM Transactions on Audio, Speech, and Language Processing 29 (2021), 3504\u20133514.","journal-title":"IEEE\/ACM Transactions on Audio, Speech, and Language Processing"},{"key":"e_1_3_2_14_2","first-page":"985","volume-title":"Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval","author":"Dai Zhuyun","year":"2019","unstructured":"Zhuyun Dai and Jamie Callan. 2019. Deeper text understanding for IR with contextual neural language modeling. In Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval, 985\u2013988."},{"key":"e_1_3_2_15_2","unstructured":"Jacob Devlin Ming-Wei Chang Kenton Lee and Kristina Toutanova. 2018. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv:1810.04805. Retrieved from https:\/\/arxiv.org\/abs\/1810.04805"},{"key":"e_1_3_2_16_2","unstructured":"Yixing Fan Xiaohui Xie Yinqiong Cai Jia Chen Xinyu Ma Xiangsheng Li Ruqing Zhang Jiafeng Guo and Yiqun Liu. 2021. Pre-training methods in information retrieval. arXiv:2111.13853. Retrieved from https:\/\/arxiv.org\/abs\/2111.13853"},{"key":"e_1_3_2_17_2","doi-asserted-by":"crossref","unstructured":"Yan Fang Jingtao Zhan Qingyao Ai Jiaxin Mao Weihang Su Jia Chen and Yiqun Liu. 2024. Scaling laws for dense retrieval. arXiv:2403.18684. Retrieved from https:\/\/arxiv.org\/abs\/2403.18684","DOI":"10.1145\/3626772.3657743"},{"issue":"3923","key":"e_1_3_2_18_2","doi-asserted-by":"crossref","first-page":"554","DOI":"10.1136\/bmj.1.3923.554-a","article-title":"Design of experiments","volume":"1","author":"Fisher Ronald Aylmer","year":"1936","unstructured":"Ronald Aylmer Fisher. 1936. Design of experiments. British Medical Journal 1, 3923 (1936), 554.","journal-title":"British Medical Journal"},{"key":"e_1_3_2_19_2","doi-asserted-by":"crossref","unstructured":"Luyu Gao and Jamie Callan. 2021. Condenser: A pre-training architecture for dense retrieval. arXiv:2104.08253. Retrieved from https:\/\/arxiv.org\/abs\/2104.08253","DOI":"10.18653\/v1\/2021.emnlp-main.75"},{"key":"e_1_3_2_20_2","doi-asserted-by":"crossref","unstructured":"Luyu Gao and Jamie Callan. 2021. Unsupervised corpus aware language model pre-training for dense passage retrieval. arXiv:2108.05540. Retrieved from https:\/\/arxiv.org\/abs\/2108.05540","DOI":"10.18653\/v1\/2022.acl-long.203"},{"key":"e_1_3_2_21_2","first-page":"280","volume-title":"Proceedings of the 43rd European Conference on IR Research on Advances in Information Retrieval (ECIR \u201921)","author":"Gao Luyu","year":"2021","unstructured":"Luyu Gao, Zhuyun Dai, and Jamie Callan. 2021. Rethink training of BERT rerankers in multi-stage retrieval pipeline. In Proceedings of the 43rd European Conference on IR Research on Advances in Information Retrieval (ECIR \u201921). Springer, 280\u2013286."},{"key":"e_1_3_2_22_2","unstructured":"Yunfan Gao Yun Xiong Xinyu Gao Kangxiang Jia Jinliu Pan Yuxi Bi Yi Dai Jiawei Sun and Haofen Wang. 2023. Retrieval-augmented generation for large language models: A survey. arXiv:2312.10997. Retrieved from https:\/\/arxiv.org\/abs\/2312.10997"},{"key":"e_1_3_2_23_2","doi-asserted-by":"crossref","first-page":"1502","DOI":"10.1145\/3477495.3532086","volume-title":"Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval","author":"Guo Yu","year":"2022","unstructured":"Yu Guo, Zhengyi Ma, Jiaxin Mao, Hongjin Qian, Xinyu Zhang, Hao Jiang, Zhao Cao, and Zhicheng Dou. 2022. Webformer: Pre-training with web pages for information retrieval. In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, 1502\u20131512."},{"key":"e_1_3_2_24_2","doi-asserted-by":"crossref","unstructured":"Zhengbao Jiang Frank F. Xu Luyu Gao Zhiqing Sun Qian Liu Jane Dwivedi-Yu Yiming Yang Jamie Callan and Graham Neubig. 2023. Active retrieval augmented generation. arXiv:2305.06983. Retrieved from https:\/\/arxiv.org\/abs\/2305.06983","DOI":"10.18653\/v1\/2023.emnlp-main.495"},{"key":"e_1_3_2_25_2","doi-asserted-by":"crossref","unstructured":"Vladimir Karpukhin Barlas O\u011fuz Sewon Min Patrick Lewis Ledell Wu Sergey Edunov Danqi Chen and Wen-tau Yih. 2020. Dense passage retrieval for open-domain question answering. arXiv:2004.04906. Retrieved from https:\/\/arxiv.org\/abs\/2004.04906","DOI":"10.18653\/v1\/2020.emnlp-main.550"},{"key":"e_1_3_2_26_2","first-page":"9459","article-title":"Retrieval-augmented generation for knowledge-intensive nlp tasks","volume":"33","author":"Lewis Patrick","year":"2020","unstructured":"Patrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal, Heinrich K\u00fcttler, Mike Lewis, Wen-tau Yih, Tim Rockt\u00e4schel, et\u00a0al. 2020. Retrieval-augmented generation for knowledge-intensive nlp tasks. In Advances in Neural Information Processing Systems, Vol. 33, 9459\u20139474.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_27_2","unstructured":"Haitao Li Qingyao Ai Jia Chen Qian Dong Yueyue Wu Yiqun Liu Chong Chen and Qi Tian. 2023. SAILER: Structure-aware pre-trained language model for legal case retrieval. arXiv:2304.11370. Retrieved from https:\/\/arxiv.org\/abs\/2304.11370"},{"key":"e_1_3_2_28_2","unstructured":"Haitao Li Qingyao Ai Jingtao Zhan Jiaxin Mao Yiqun Liu Zheng Liu and Zhao Cao. 2023. Constructing tree-based index for efficient and effective dense retrieval. arXiv:2304.11943. Retrieved from https:\/\/arxiv.org\/abs\/2304.11943"},{"key":"e_1_3_2_29_2","unstructured":"Haitao Li Jia Chen Weihang Su Qingyao Ai and Yiqun\u00a0Liu. 2023. Towards better web search performance: Pre-training fine-tuning and learning to rank. arXiv:2303.04710. Retrieved from https:\/\/arxiv.org\/abs\/2303.04710"},{"key":"e_1_3_2_30_2","unstructured":"Haitao Li Weihang Su Changyue Wang Yueyue Wu Qingyao Ai and Yiqun Liu. 2023. THUIR@ COLIEE 2023: Incorporating structural knowledge into pre-trained language models for legal case retrieval. arXiv:2305.06812. Retrieved from https:\/\/arxiv.org\/abs\/2305.06812"},{"key":"e_1_3_2_31_2","unstructured":"Haitao Li Changyue Wang Weihang Su Yueyue Wu Qingyao Ai and Yiqun Liu. 2023. THUIR@ COLIEE 2023: More parameters and legal knowledge for legal case entailment. arXiv:2305.06817. Retrieved from https:\/\/arxiv.org\/abs\/2305.06817"},{"key":"e_1_3_2_32_2","unstructured":"Yinhan Liu Myle Ott Naman Goyal Jingfei Du Mandar Joshi Danqi Chen Omer Levy Mike Lewis Luke Zettlemoyer and Veselin Stoyanov. 2019. Roberta: A robustly optimized bert pretraining approach. arXiv:1907.11692. Retrieved from https:\/\/arxiv.org\/abs\/1907.11692"},{"key":"e_1_3_2_33_2","first-page":"2780","volume-title":"Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing","author":"Lu Shuqi","year":"2021","unstructured":"Shuqi Lu, Di He, Chenyan Xiong, Guolin Ke, Waleed Malik, Zhicheng Dou, Paul Bennett, Tie-Yan Liu, and Arnold Overwijk. 2021. Less is more: Pretrain a strong Siamese encoder for dense text retrieval using a weak decoder. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, 2780\u20132791."},{"key":"e_1_3_2_34_2","first-page":"283","volume-title":"Proceedings of the 14th ACM International Conference on Web Search and Data Mining","author":"Ma Xinyu","year":"2021","unstructured":"Xinyu Ma, Jiafeng Guo, Ruqing Zhang, Yixing Fan, Xiang Ji, and Xueqi Cheng. 2021. Prop: Pre-training with representative words prediction for ad-hoc retrieval. In Proceedings of the 14th ACM International Conference on Web Search and Data Mining, 283\u2013291."},{"key":"e_1_3_2_35_2","first-page":"1513","volume-title":"Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval","author":"Ma Xinyu","year":"2021","unstructured":"Xinyu Ma, Jiafeng Guo, Ruqing Zhang, Yixing Fan, Yingyan Li, and Xueqi Cheng. 2021. B-PROP: Bootstrapped pre-training with representative words prediction for ad-hoc retrieval. In Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, 1513\u20131522."},{"key":"e_1_3_2_36_2","volume-title":"Proceedings of the 8th International Competition on Legal Information Extraction\/Entailment (COLIEE \u201921)","author":"Ma Yixiao","year":"2021","unstructured":"Yixiao Ma, Yunqiu Shao, Bulou Liu, Yiqun Liu, Min Zhang, and Shaoping Ma. 2021. Retrieving legal cases from a large-scale candidate corpus. In Proceedings of the 8th International Competition on Legal Information Extraction\/Entailment (COLIEE \u201921)."},{"key":"e_1_3_2_37_2","first-page":"2342","volume-title":"Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval","author":"Ma Yixiao","year":"2021","unstructured":"Yixiao Ma, Yunqiu Shao, Yueyue Wu, Yiqun Liu, Ruizhe Zhang, Min Zhang, and Shaoping Ma. 2021. LeCaRD: A legal case retrieval dataset for Chinese law system. In Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval. 2342\u20132348."},{"key":"e_1_3_2_38_2","unstructured":"Yixiao Ma Yueyue Wu Weihang Su Qingyao Ai and Yiqun Liu. 2023. CaseEncoder: A knowledge-enhanced pre-trained model for legal case encoding. arXiv:2305.05393. Retrieved from https:\/\/arxiv.org\/abs\/2305.05393"},{"key":"e_1_3_2_39_2","first-page":"1212","volume-title":"Proceedings of the 30th ACM International Conference on Information & Knowledge Management","author":"Ma Zhengyi","year":"2021","unstructured":"Zhengyi Ma, Zhicheng Dou, Wei Xu, Xinyu Zhang, Hao Jiang, Zhao Cao, and Ji-Rong Wen. 2021. Pre-training for ad-hoc retrieval: Hyperlink is also you need. In Proceedings of the 30th ACM International Conference on Information & Knowledge Management, 1212\u20131221."},{"key":"e_1_3_2_40_2","unstructured":"Rodrigo Nogueira and Kyunghyun Cho. 2019. Passage re-ranking with BERT. arXiv:1901.04085. Retrieved from https:\/\/arxiv.org\/abs\/1901.04085"},{"key":"e_1_3_2_41_2","first-page":"11139","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence","volume":"36","author":"Paul Shounak","year":"2022","unstructured":"Shounak Paul, Pawan Goyal, and Saptarshi Ghosh. 2022. LeSICiN: A heterogeneous graph-based approach for automatic legal statute identification from Indian legal documents. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 36, 11139\u201311146."},{"key":"e_1_3_2_42_2","doi-asserted-by":"crossref","first-page":"196","DOI":"10.1007\/978-3-030-79942-7_13","volume-title":"New Frontiers in Artificial Intelligence: JSAI-isAI 2020 Workshops, JURISIN, LENLS 2020 Workshops","author":"Rabelo Juliano","year":"2021","unstructured":"Juliano Rabelo, Mi-Young Kim, Randy Goebel, Masaharu Yoshioka, Yoshinobu Kano, and Ken Satoh. 2021. COLIEE 2020: Methods for legal document retrieval and entailment. In New Frontiers in Artificial Intelligence: JSAI-isAI 2020 Workshops, JURISIN, LENLS 2020 Workshops. Springer, 196\u2013210."},{"key":"e_1_3_2_43_2","first-page":"29","volume-title":"Proceedings of the First Instructional Conference on Machine Learning","volume":"242","author":"Ramos Juan","year":"2003","unstructured":"Juan Ramos. 2003. Using tf-idf to determine word relevance in document queries. In Proceedings of the First Instructional Conference on Machine Learning, Vol. 242. Citeseer, 29\u201348."},{"issue":"4","key":"e_1_3_2_44_2","doi-asserted-by":"crossref","first-page":"333","DOI":"10.1561\/1500000019","article-title":"The probabilistic relevance framework: BM25 and beyond","volume":"3","author":"Robertson Stephen","year":"2009","unstructured":"Stephen Robertson and Hugo Zaragoza. 2009. The probabilistic relevance framework: BM25 and beyond. Foundations and Trends\u00ae in Information Retrieval 3, 4 (2009), 333\u2013389.","journal-title":"Foundations and Trends\u00ae in Information Retrieval"},{"key":"e_1_3_2_45_2","unstructured":"Guilherme Moraes Rosa Ruan Chaves Rodrigues Roberto Lotufo and Rodrigo Nogueira. 2021. Yes bm25 is a strong baseline for legal case retrieval. arXiv:2105.05686. Retrieved from https:\/\/arxiv.org\/abs\/2105.05686"},{"issue":"3","key":"e_1_3_2_46_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3569929","article-title":"Understanding relevance judgments in legal case retrieval","volume":"41","author":"Shao Yunqiu","year":"2023","unstructured":"Yunqiu Shao, Yueyue Wu, Yiqun Liu, Jiaxin Mao, and Shaoping Ma. 2023. Understanding relevance judgments in legal case retrieval. ACM Transactions on Information Systems 41, 3 (2023), 1\u201332.","journal-title":"ACM Transactions on Information Systems"},{"key":"e_1_3_2_47_2","first-page":"623","volume-title":"Proceedings of the 16th ACM Conference on Conference on Information and Knowledge Management","author":"Smucker Mark D.","year":"2007","unstructured":"Mark D. Smucker, James Allan, and Ben Carterette. 2007. A comparison of statistical significance tests for information retrieval evaluation. In Proceedings of the 16th ACM Conference on Conference on Information and Knowledge Management, 623\u2013632."},{"key":"e_1_3_2_48_2","unstructured":"Weihang Su Qingyao Ai Xiangsheng Li Jia Chen Yiqun Liu Xiaolong Wu and Shengluan Hou. 2023. Wikiformer: Pre-training with structured information of Wikipedia for ad-hoc retrieval. arXiv:2312.10661. Retrieved from https:\/\/arxiv.org\/abs\/2312.10661"},{"key":"e_1_3_2_49_2","first-page":"19026","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence","volume":"38","author":"Su Weihang","year":"2024","unstructured":"Weihang Su, Qingyao Ai, Xiangsheng Li, Jia Chen, Yiqun Liu, Xiaolong Wu, and Shengluan Hou. 2024. Wikiformer: Pre-training with structured information of Wikipedia for ad-hoc retrieval. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 38, 19026\u201319034."},{"key":"e_1_3_2_50_2","unstructured":"Weihang Su Qingyao Ai Yueyue Wu Yixiao Ma Haitao Li and Yiqun Liu. 2023. Caseformer: Pre-training for legal case retrieval. arXiv:2311.00333. Retrieved from https:\/\/arxiv.org\/abs\/2311.00333"},{"key":"e_1_3_2_51_2","unstructured":"Weihang Su Yiran Hu Anzhe Xie Qingyao Ai Zibing Que Ning Zheng Yun Liu Weixing Shen and Yiqun Liu. 2024. STARD: A Chinese statute retrieval dataset with real queries issued by non-professionals. arXiv:2406.15313. Retrieved from https:\/\/arxiv.org\/abs\/2406.15313"},{"key":"e_1_3_2_52_2","unstructured":"Weihang Su Xiangsheng Li Yiqun Liu Min Zhang and Shaoping Ma. 2023. THUIR2 at NTCIR-16 Session Search (SS) Task. arXiv:2307.00250. Retrieved from https:\/\/arxiv.org\/abs\/2307.00250"},{"key":"e_1_3_2_53_2","unstructured":"Weihang Su Yichen Tang Qingyao Ai Changyue Wang Zhijing Wu and Yiqun Liu. 2024. Mitigating entity-level hallucination in large language models. arXiv:2407.09417. Retrieved from https:\/\/arxiv.org\/abs\/2407.09417"},{"key":"e_1_3_2_54_2","unstructured":"Weihang Su Yichen Tang Qingyao Ai Zhijing Wu and Yiqun Liu. 2024. Dragin: Dynamic retrieval augmented generation based on the real-time information needs of large language models. arXiv:2403.10081. Retrieved from https:\/\/arxiv.org\/abs\/2403.10081"},{"key":"e_1_3_2_55_2","unstructured":"Weihang Su Changyue Wang Qingyao Ai Yiran Hu Zhijing Wu Yujia Zhou and Yiqun Liu. 2024. Unsupervised real-time hallucination detection based on the internal states of large language models. arXiv:2403.06448. Retrieved from https:\/\/arxiv.org\/abs\/2403.06448"},{"key":"e_1_3_2_56_2","unstructured":"Nandan Thakur Nils Reimers Andreas R\u00fcckl\u00e9 Abhishek Srivastava and Iryna Gurevych. 2021. BEIR: A heterogenous benchmark for zero-shot evaluation of information retrieval models. arXiv:2104.08663. Retrieved from https:\/\/arxiv.org\/abs\/2104.08663"},{"key":"e_1_3_2_57_2","first-page":"11","article-title":"Visualizing data using t-SNE","volume":"9","author":"Van der Maaten Laurens","year":"2008","unstructured":"Laurens Van der Maaten and Geoffrey Hinton. 2008. Visualizing data using t-SNE. Journal of Machine Learning Research 9, 11 (2008), 2579\u20132605.","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_3_2_58_2","first-page":"30","article-title":"Attention is all you need. In","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, \u0141ukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In Advances in Neural Information Processing Systems, Vol. 30.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_59_2","unstructured":"Changyue Wang Weihang Su Hu Yiran Qingyao Ai Yueyue Wu Cheng Luo Yiqun Liu Min Zhang and Shaoping Ma. 2024. LeKUBE: A legal knowledge update benchmark. arXiv:2407.14192. Retrieved from https:\/\/arxiv.org\/abs\/2407.14192"},{"key":"e_1_3_2_60_2","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1016\/j.aiopen.2021.06.003","article-title":"Lawformer: A pre-trained language model for Chinese legal long documents","volume":"2","author":"Xiao Chaojun","year":"2021","unstructured":"Chaojun Xiao, Xueyu Hu, Zhiyuan Liu, Cunchao Tu, and Maosong Sun. 2021. Lawformer: A pre-trained language model for Chinese legal long documents. AI Open 2 (2021), 79\u201384.","journal-title":"AI Open"},{"key":"e_1_3_2_61_2","unstructured":"Chaojun Xiao Haoxi Zhong Zhipeng Guo Cunchao Tu Zhiyuan Liu Maosong Sun Tianyang Zhang Xianpei Han Heng Wang Jianfeng Xu et\u00a0al. 2019. CAIL2019-SCM: A dataset of similar case matching in legal domain. arXiv:1911.08962. Retrieved from https:\/\/arxiv.org\/abs\/1911.08962"},{"key":"e_1_3_2_62_2","unstructured":"Shitao Xiao Zheng Liu Peitian Zhang and Niklas Muennighoff. 2023. C-Pack: Packaged resources to advance general Chinese embedding. arXiv:2309.07597. Retrieved from https:\/\/arxiv.org\/abs\/2309.07597"},{"key":"e_1_3_2_63_2","unstructured":"An Yang Baosong Yang Binyuan Hui Bo Zheng Bowen Yu Chang Zhou Chengpeng Li Chengyuan Li Dayiheng Liu Fei Huang et\u00a0al. 2024. Qwen2 technical report. arXiv:2407.10671. Retrieved from https:\/\/arxiv.org\/abs\/2407.10671"},{"key":"e_1_3_2_64_2","first-page":"32","article-title":"Xlnet: Generalized autoregressive pretraining for language understanding","author":"Yang Zhilin","year":"2019","unstructured":"Zhilin Yang, Zihang Dai, Yiming Yang, Jaime Carbonell, Russ R. Salakhutdinov, and Quoc V. Le. 2019. Xlnet: Generalized autoregressive pretraining for language understanding. In Advances in Neural Information Processing Systems, Vol. 32.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_65_2","doi-asserted-by":"crossref","unstructured":"Michihiro Yasunaga Jure Leskovec and Percy Liang. 2022. LinkBERT: Pretraining language models with document links. arXiv:2203.15827. Retrieved from https:\/\/arxiv.org\/abs\/2203.15827","DOI":"10.18653\/v1\/2022.acl-long.551"},{"key":"e_1_3_2_66_2","first-page":"1","article-title":"Relevance feedback with brain signals","author":"Ye Ziyi","year":"2023","unstructured":"Ziyi Ye, Xiaohui Xie, Qingyao Ai, Yiqun Liu, Zhihong Wang, Weihang Su, and Min Zhang. 2023. Relevance feedback with brain signals. ACM Transactions on Information Systems 42 (2023), 1\u201337.","journal-title":"ACM Transactions on Information Systems 42"},{"issue":"1","key":"e_1_3_2_67_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/978-3-031-02130-5","article-title":"Statistical language models for information retrieval","volume":"1","author":"Zhai ChengXiang","year":"2008","unstructured":"ChengXiang Zhai. 2008. Statistical language models for information retrieval. Synthesis Lectures on Human Language Technologies 1, 1 (2008), 1\u2013141.","journal-title":"Synthesis Lectures on Human Language Technologies"}],"container-title":["ACM Transactions on Information Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3735127","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,22]],"date-time":"2025-07-22T19:29:49Z","timestamp":1753212589000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3735127"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,7,22]]},"references-count":66,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2025,9,30]]}},"alternative-id":["10.1145\/3735127"],"URL":"https:\/\/doi.org\/10.1145\/3735127","relation":{},"ISSN":["1046-8188","1558-2868"],"issn-type":[{"value":"1046-8188","type":"print"},{"value":"1558-2868","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,7,22]]},"assertion":[{"value":"2024-01-04","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-01-08","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-07-22","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}