{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,18]],"date-time":"2026-07-18T02:41:38Z","timestamp":1784342498602,"version":"3.55.0"},"publisher-location":"New York, NY, USA","reference-count":63,"publisher":"ACM","license":[{"start":{"date-parts":[[2024,9,11]],"date-time":"2024-09-11T00:00:00Z","timestamp":1726012800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2024,9,11]]},"DOI":"10.1145\/3650212.3652123","type":"proceedings-article","created":{"date-parts":[[2024,9,11]],"date-time":"2024-09-11T11:44:25Z","timestamp":1726055065000},"page":"223-234","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":68,"title":["A Large-Scale Evaluation for Log Parsing Techniques: How Far Are We?"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0009-0003-1988-6219","authenticated-orcid":false,"given":"Zhihan","family":"Jiang","sequence":"first","affiliation":[{"name":"Chinese University of Hong Kong, Hong Kong, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0037-1912","authenticated-orcid":false,"given":"Jinyang","family":"Liu","sequence":"additional","affiliation":[{"name":"Chinese University of Hong Kong, Hong Kong, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-6962-5292","authenticated-orcid":false,"given":"Junjie","family":"Huang","sequence":"additional","affiliation":[{"name":"Chinese University of Hong Kong, Hong Kong, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-8370-644X","authenticated-orcid":false,"given":"Yichen","family":"Li","sequence":"additional","affiliation":[{"name":"Chinese University of Hong Kong, Hong Kong, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-8798-5667","authenticated-orcid":false,"given":"Yintong","family":"Huo","sequence":"additional","affiliation":[{"name":"Chinese University of Hong Kong, Hong Kong, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5831-9474","authenticated-orcid":false,"given":"Jiazhen","family":"Gu","sequence":"additional","affiliation":[{"name":"Chinese University of Hong Kong, Hong Kong, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5158-6716","authenticated-orcid":false,"given":"Zhuangbin","family":"Chen","sequence":"additional","affiliation":[{"name":"Sun Yat-sen University, Zhuhai, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5666-8320","authenticated-orcid":false,"given":"Jieming","family":"Zhu","sequence":"additional","affiliation":[{"name":"Huawei Ark Lab, Shenzhen, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3666-5798","authenticated-orcid":false,"given":"Michael R.","family":"Lyu","sequence":"additional","affiliation":[{"name":"Chinese University of Hong Kong, Hong Kong, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2024,9,11]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"The replication repository of our evaluation artifacts. https:\/\/github.com\/logpai\/Loghub-2.0 [Online","year":"2023","unstructured":"2023. The replication repository of our evaluation artifacts. https:\/\/github.com\/logpai\/Loghub-2.0 [Online; accessed 1 Dec 2023]"},{"key":"e_1_3_2_1_2_1","volume-title":"https:\/\/scipy.org\/ [Online","year":"2023","unstructured":"2023. Scipy. https:\/\/scipy.org\/ [Online; accessed 1 July 2023]"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2019.00031"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.1998.732614"},{"key":"e_1_3_2_1_5_1","volume-title":"Proceedings of the International Conference on Research in Adaptive and Convergent Systems. 181\u2013187","author":"Bushong Vincent","year":"2020","unstructured":"Vincent Bushong, Russell Sanders, Jacob Curtis, Mark Du, Tomas Cerny, Karel Frajtak, Miroslav Bures, Pavel Tisnovsky, and Dongwan Shin. 2020. On matching log analysis to source code: A systematic mapping study. In Proceedings of the International Conference on Research in Adaptive and Convergent Systems. 181\u2013187."},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2021.3071473"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3238147.3238214"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3569932","article-title":"Exploring better black-Box test case prioritization via log analysis","volume":"32","author":"Chen Zhichao","year":"2023","unstructured":"Zhichao Chen, Junjie Chen, Weijing Wang, Jianyi Zhou, Meng Wang, Xiang Chen, Shan Zhou, and Jianmin Wang. 2023. Exploring better black-Box test case prioritization via log analysis. ACM Transactions on Software Engineering and Methodology, 32, 3 (2023), 1\u201332.","journal-title":"ACM Transactions on Software Engineering and Methodology"},{"key":"e_1_3_2_1_9_1","first-page":"879","article-title":"Logram: Efficient Log Parsing Using n n-Gram Dictionaries","volume":"48","author":"Dai Hetong","year":"2020","unstructured":"Hetong Dai, Heng Li, Che-Shao Chen, Weiyi Shang, and Tse-Hsun Chen. 2020. Logram: Efficient Log Parsing Using n n-Gram Dictionaries. IEEE Transactions on Software Engineering (TSE), 48, 3 (2020), 879\u2013892.","journal-title":"IEEE Transactions on Software Engineering (TSE)"},{"key":"e_1_3_2_1_10_1","volume-title":"PILAR: Studying and Mitigating the Influence of Configurations on Log Parsing. In 2023 IEEE\/ACM 45th International Conference on Software Engineering (ICSE). 818\u2013829","author":"Dai Hetong","year":"2023","unstructured":"Hetong Dai, Yiming Tang, Heng Li, and Weiyi Shang. 2023. PILAR: Studying and Mitigating the Influence of Configurations on Log Parsing. In 2023 IEEE\/ACM 45th International Conference on Software Engineering (ICSE). 818\u2013829."},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDM.2016.0103"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3133956.3134015"},{"key":"e_1_3_2_1_13_1","unstructured":"Qiang Fu Jian-Guang Lou Yi Wang and Jiang Li. 2009. Execution anomaly detection in distributed systems through unstructured log analysis. In 2009 ninth IEEE international conference on data mining (ICDM). 149\u2013158."},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2591062.2591175"},{"key":"e_1_3_2_1_15_1","volume-title":"Proceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (FSE). 1566\u20131577","author":"Fu Ying","year":"2022","unstructured":"Ying Fu, Meng Yan, Jian Xu, Jianguo Li, Zhongxin Liu, Xiaohong Zhang, and Dan Yang. 2022. Investigating and improving log parsing in practice. In Proceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (FSE). 1566\u20131577."},{"key":"e_1_3_2_1_16_1","volume-title":"Proceedings of the 25th ACM International on Conference on Information and Knowledge Management (CIKM). 1573\u20131582","author":"Hamooni Hossein","year":"2016","unstructured":"Hossein Hamooni, Biplob Debnath, Jianwu Xu, Hui Zhang, Guofei Jiang, and Abdullah Mueen. 2016. Logmine: Fast pattern recognition for log analytics. In Proceedings of the 25th ACM International on Conference on Information and Knowledge Management (CIKM). 1573\u20131582."},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICWS.2017.13"},{"key":"e_1_3_2_1_18_1","volume-title":"A survey on automated log analysis for reliability engineering. ACM computing surveys (CSUR), 54, 6","author":"He Shilin","year":"2021","unstructured":"Shilin He, Pinjia He, Zhuangbin Chen, Tianyi Yang, Yuxin Su, and Michael R Lyu. 2021. A survey on automated log analysis for reliability engineering. ACM computing surveys (CSUR), 54, 6 (2021), 1\u201337."},{"key":"e_1_3_2_1_19_1","volume-title":"Proceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (FSE). 1465\u20131476","author":"He Shilin","year":"2022","unstructured":"Shilin He, Xu Zhang, Pinjia He, Yong Xu, Liqun Li, Yu Kang, Minghua Ma, Yining Wei, Yingnong Dang, and Saravanakumar Rajmohan. 2022. An empirical study of log analysis at Microsoft. In Proceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (FSE). 1465\u20131476."},{"key":"e_1_3_2_1_20_1","volume-title":"Loghub: A large collection of system log datasets towards automated log analytics. arXiv preprint arXiv:2008.06448.","author":"He Shilin","year":"2020","unstructured":"Shilin He, Jieming Zhu, Pinjia He, and Michael R Lyu. 2020. Loghub: A large collection of system log datasets towards automated log analytics. arXiv preprint arXiv:2008.06448."},{"key":"e_1_3_2_1_21_1","volume-title":"Semparser: A semantic parser for log analysis. arXiv preprint arXiv:2112.12636.","author":"Huo Yintong","year":"2021","unstructured":"Yintong Huo, Yuxin Su, Cheryl Lee, and Michael R Lyu. 2021. Semparser: A semantic parser for log analysis. arXiv preprint arXiv:2112.12636."},{"key":"e_1_3_2_1_22_1","volume-title":"2017 IEEE 10th International Conference on Cloud Computing (CLOUD). 447\u2013455","author":"Jia Tong","year":"2017","unstructured":"Tong Jia, Lin Yang, Pengfei Chen, Ying Li, Fanjing Meng, and Jingmin Xu. 2017. Logsed: Anomaly diagnosis through mining time-weighted control flow graph in logs. In 2017 IEEE 10th International Conference on Cloud Computing (CLOUD). 447\u2013455."},{"key":"e_1_3_2_1_23_1","volume-title":"Llmparser: A llm-based log parsing framework. arXiv preprint arXiv:2310.01796.","author":"Jiang Zhihan","year":"2023","unstructured":"Zhihan Jiang, Jinyang Liu, Zhuangbin Chen, Yichen Li, Junjie Huang, Yintong Huo, Pinjia He, Jiazhen Gu, and Michael R Lyu. 2023. Llmparser: A llm-based log parsing framework. arXiv preprint arXiv:2310.01796."},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/QSIC.2008.50"},{"key":"e_1_3_2_1_25_1","volume-title":"Proceedings of the 44th International Conference on Software Engineering (ICSE). 1095\u20131106","author":"Khan Zanis Ali","year":"2022","unstructured":"Zanis Ali Khan, Donghwan Shin, Domenico Bianculli, and Lionel Briand. 2022. Guidelines for assessing the accuracy of log message template identification techniques. In Proceedings of the 44th International Conference on Software Engineering (ICSE). 1095\u20131106."},{"key":"e_1_3_2_1_26_1","unstructured":"Zanis Ali Khan Donghwan Shin Domenico Bianculli and Lionel Briand. 2023. Impact of Log Parsing on Log-based Anomaly Detection. arXiv preprint arXiv:2305.15897."},{"key":"e_1_3_2_1_27_1","volume-title":"Proceedings of the 44th international conference on software engineering (ICSE). 1356\u20131367","author":"Le Van-Hoang","year":"2022","unstructured":"Van-Hoang Le and Hongyu Zhang. 2022. Log-based anomaly detection with deep learning: How far are we? In Proceedings of the 44th international conference on software engineering (ICSE). 1356\u20131367."},{"key":"e_1_3_2_1_28_1","unstructured":"Van-Hoang Le and Hongyu Zhang. 2023. Log Parsing with Prompt-based Few-shot Learning. arXiv preprint arXiv:2302.07435."},{"key":"e_1_3_2_1_29_1","unstructured":"Yichen Li Yintong Huo Zhihan Jiang Renyi Zhong Pinjia He Yuxin Su and Michael R Lyu. 2023. Exploring the Effectiveness of LLMs in Automated Logging Generation: An Empirical Study. arXiv preprint arXiv:2307.05950."},{"key":"e_1_3_2_1_30_1","volume-title":"Go Static: Contextualized Logging Statement Generation. arXiv preprint arXiv:2402.12958.","author":"Li Yichen","year":"2024","unstructured":"Yichen Li, Yintong Huo, Renyi Zhong, Zhihan Jiang, Jinyang Liu, Junjie Huang, Jiazhen Gu, Pinjia He, and Michael R Lyu. 2024. Go Static: Contextualized Logging Statement Generation. arXiv preprint arXiv:2402.12958."},{"key":"e_1_3_2_1_31_1","volume-title":"Studying and Exploring Variable-Aware Log Abstraction. In 2023 IEEE\/ACM 45th International Conference on Software Engineering (ICSE).","author":"Li Zhenhao","year":"2023","unstructured":"Zhenhao Li, Chuan Luo, Tse-Hsun Chen, Weiyi Shang, Shilin He, Qingwei Lin, and Dongmei Zhang. 2023. Did We Miss Something Important? Studying and Exploring Variable-Aware Log Abstraction. In 2023 IEEE\/ACM 45th International Conference on Software Engineering (ICSE)."},{"key":"e_1_3_2_1_32_1","unstructured":"Jinyang Liu Junjie Huang Yintong Huo Zhihan Jiang Jiazhen Gu Zhuangbin Chen Cong Feng Minzhi Yan and Michael R Lyu. 2023. Scalable and Adaptive Log-based Anomaly Detection with Expert in the Loop. arXiv preprint arXiv:2306.05032."},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3533767.3534379"},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.2019.00085"},{"key":"e_1_3_2_1_35_1","volume-title":"Proceedings of the ACM Web Conference 2022 (WWW). 1893\u20131901","author":"Liu Yudong","year":"2022","unstructured":"Yudong Liu, Xu Zhang, Shilin He, Hongyu Zhang, Liqun Li, Yu Kang, Yong Xu, Minghua Ma, Qingwei Lin, and Yingnong Dang. 2022. Uniparser: A unified log parser for heterogeneous log data. In Proceedings of the ACM Web Conference 2022 (WWW). 1893\u20131901."},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"crossref","first-page":"3227","DOI":"10.1109\/TSE.2021.3083715","article-title":"LogAssist: Assisting log analysis through log summarization","volume":"48","author":"Locke Steven","year":"2021","unstructured":"Steven Locke, Heng Li, Tse-Hsun Peter Chen, Weiyi Shang, and Wei Liu. 2021. LogAssist: Assisting log analysis through log summarization. IEEE Transactions on Software Engineering (TSE), 48, 9 (2021), 3227\u20133241.","journal-title":"IEEE Transactions on Software Engineering (TSE)"},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.3390\/app13084930"},{"key":"e_1_3_2_1_38_1","volume-title":"2018 USENIX Annual Technical Conference (USENIX ATC). 241\u2013254","author":"Ma Shiqing","year":"2018","unstructured":"Shiqing Ma, Juan Zhai, Yonghwi Kwon, Kyu Hyung Lee, Xiangyu Zhang, Gabriela Ciocarlie, Ashish Gehani, Vinod Yegneswaran, Dongyan Xu, and Somesh Jha. 2018. $Kernel-Supported$$Cost-Effective$ Audit Logging for Causality Tracking. In 2018 USENIX Annual Technical Conference (USENIX ATC). 241\u2013254."},{"key":"e_1_3_2_1_39_1","volume-title":"Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining (KDD). 1255\u20131264","author":"Makanju Adetokunbo AO","year":"2009","unstructured":"Adetokunbo AO Makanju, A Nur Zincir-Heywood, and Evangelos E Milios. 2009. Clustering event logs using iterative partitioning. In Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining (KDD). 1255\u20131264."},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3196321.3196340"},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/3460319.3464824"},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/SCC.2013.73"},{"key":"e_1_3_2_1_43_1","volume-title":"2010 7th IEEE Working Conference on Mining Software Repositories (MSR). 114\u2013117","author":"Nagappan Meiyappan","year":"2010","unstructured":"Meiyappan Nagappan and Mladen A Vouk. 2010. Abstracting log lines to log event types for mining software system logs. In 2010 7th IEEE Working Conference on Mining Software Repositories (MSR). 114\u2013117."},{"key":"e_1_3_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISSRE.2009.23"},{"key":"e_1_3_2_1_45_1","volume-title":"9th USENIX Symposium on Networked Systems Design and Implementation (NSDI 12)","author":"Nagaraj Karthik","year":"2012","unstructured":"Karthik Nagaraj, Charles Killian, and Jennifer Neville. 2012. Structured comparative analysis of systems logs to diagnose performance problems. In 9th USENIX Symposium on Networked Systems Design and Implementation (NSDI 12). 353\u2013366."},{"key":"e_1_3_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNSM.2023.3282270"},{"key":"e_1_3_2_1_47_1","volume-title":"2015 IEEE\/ACM 37th IEEE International Conference on Software Engineering (ICSE). 2, 169\u2013178","author":"Pecchia Antonio","year":"2015","unstructured":"Antonio Pecchia, Marcello Cinque, Gabriella Carrozza, and Domenico Cotroneo. 2015. Industry practices and event logging: Assessment of a critical software development process. In 2015 IEEE\/ACM 37th IEEE International Conference on Software Engineering (ICSE). 2, 169\u2013178."},{"key":"e_1_3_2_1_48_1","volume-title":"2019 IEEE\/ACM 16th International Conference on Mining Software Repositories (MSR). 545\u2013549","author":"Schipper Daan","year":"2019","unstructured":"Daan Schipper, Maur\u00edcio Aniche, and Arie van Deursen. 2019. Tracing back log data to its log statement: from research to practice. In 2019 IEEE\/ACM 16th International Conference on Mining Software Repositories (MSR). 545\u2013549."},{"key":"e_1_3_2_1_49_1","volume-title":"2023 IEEE\/ACM 31st International Conference on Program Comprehension (ICPC). 84\u201388","author":"Sedki Issam","year":"2023","unstructured":"Issam Sedki, Abdelwahab Hamou-Lhadj, Otmane Ait-Mohamed, and Naser Ezzati-Jivan. 2023. Towards a Classification of Log Parsing Errors. In 2023 IEEE\/ACM 31st International Conference on Program Comprehension (ICPC). 84\u201388."},{"key":"e_1_3_2_1_50_1","volume-title":"2012 34th international conference on software engineering (ICSE). 1583\u20131586","author":"Shang Weiyi","year":"2012","unstructured":"Weiyi Shang. 2012. Bridging the divide between software developers and operators using logs. In 2012 34th international conference on software engineering (ICSE). 1583\u20131586."},{"key":"e_1_3_2_1_51_1","unstructured":"Keiichi Shima. 2016. Length matters: Clustering system log messages using length of words. arXiv preprint arXiv:1611.03213."},{"key":"e_1_3_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/2063576.2063690"},{"key":"e_1_3_2_1_53_1","volume-title":"Proceedings of the 3rd IEEE Workshop on IP Operations & Management (IPOM)(IEEE Cat. No. 03EX764)","author":"Vaarandi Risto","year":"2003","unstructured":"Risto Vaarandi. 2003. A data clustering algorithm for mining patterns from event logs. In Proceedings of the 3rd IEEE Workshop on IP Operations & Management (IPOM)(IEEE Cat. No. 03EX764). 119\u2013126."},{"key":"e_1_3_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1109\/CNSM.2015.7367331"},{"key":"e_1_3_2_1_55_1","volume-title":"Proceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (FSE). 1198\u20131208","author":"Wang Xuheng","year":"2022","unstructured":"Xuheng Wang, Xu Zhang, Liqun Li, Shilin He, Hongyu Zhang, Yudong Liu, Lingling Zheng, Yu Kang, Qingwei Lin, and Yingnong Dang. 2022. SPINE: a scalable log parser with feedback guidance. In Proceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (FSE). 1198\u20131208."},{"key":"e_1_3_2_1_56_1","first-page":"2748","article-title":"Improving state-of-the-art compression techniques for log management tools","volume":"48","author":"Yao Kundi","year":"2021","unstructured":"Kundi Yao, Mohammed Sayagh, Weiyi Shang, and Ahmed E Hassan. 2021. Improving state-of-the-art compression techniques for log management tools. IEEE Transactions on Software Engineering (TSE), 48, 8 (2021), 2748\u20132760.","journal-title":"IEEE Transactions on Software Engineering (TSE)"},{"key":"e_1_3_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2023.111646"},{"key":"e_1_3_2_1_58_1","article-title":"Brain: Log Parsing with Bidirectional Parallel Tree","author":"Yu Siyu","year":"2023","unstructured":"Siyu Yu, Pinjia He, Ningjiang Chen, and Yifan Wu. 2023. Brain: Log Parsing with Bidirectional Parallel Tree. IEEE Transactions on Services Computing (TSC).","journal-title":"IEEE Transactions on Services Computing (TSC)."},{"key":"e_1_3_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/1736020.1736038"},{"key":"e_1_3_2_1_60_1","article-title":"System Log Parsing: A Survey","author":"Zhang Tianzhu","year":"2023","unstructured":"Tianzhu Zhang, Han Qiu, Gabriele Castellano, Myriana Rifai, Chung Shue Chen, and Fabio Pianese. 2023. System Log Parsing: A Survey. IEEE Transactions on Knowledge and Data Engineering (TKDE).","journal-title":"IEEE Transactions on Knowledge and Data Engineering (TKDE)."},{"key":"e_1_3_2_1_61_1","volume-title":"2019 IEEE international conference on software maintenance and evolution (ICSME). 459\u2013469","author":"Zhi Chen","year":"2019","unstructured":"Chen Zhi, Jianwei Yin, Shuiguang Deng, Maoxin Ye, Min Fu, and Tao Xie. 2019. An exploratory study of logging configuration practice in java. In 2019 IEEE international conference on software maintenance and evolution (ICSME). 459\u2013469."},{"key":"e_1_3_2_1_62_1","volume-title":"2023 IEEE 34th International Symposium on Software Reliability Engineering (ISSRE). 355\u2013366","author":"Zhu Jieming","year":"2023","unstructured":"Jieming Zhu, Shilin He, Pinjia He, Jinyang Liu, and Michael R Lyu. 2023. Loghub: A large collection of system log datasets for ai-driven log analytics. In 2023 IEEE 34th International Symposium on Software Reliability Engineering (ISSRE). 355\u2013366."},{"key":"e_1_3_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE-SEIP.2019.00021"}],"event":{"name":"ISSTA '24: 33rd ACM SIGSOFT International Symposium on Software Testing and Analysis","location":"Vienna Austria","acronym":"ISSTA '24","sponsor":["SIGSOFT ACM Special Interest Group on Software Engineering","AITO"]},"container-title":["Proceedings of the 33rd ACM SIGSOFT International Symposium on Software Testing and Analysis"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3650212.3652123","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3650212.3652123","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T22:50:06Z","timestamp":1750287006000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3650212.3652123"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,9,11]]},"references-count":63,"alternative-id":["10.1145\/3650212.3652123","10.1145\/3650212"],"URL":"https:\/\/doi.org\/10.1145\/3650212.3652123","relation":{},"subject":[],"published":{"date-parts":[[2024,9,11]]},"assertion":[{"value":"2024-09-11","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}