{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,10]],"date-time":"2026-06-10T03:28:50Z","timestamp":1781062130500,"version":"3.54.1"},"reference-count":53,"publisher":"Springer Science and Business Media LLC","issue":"6","license":[{"start":{"date-parts":[[2024,8,17]],"date-time":"2024-08-17T00:00:00Z","timestamp":1723852800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,8,17]],"date-time":"2024-08-17T00:00:00Z","timestamp":1723852800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001866","name":"Fonds National de la Recherche Luxembourg","doi-asserted-by":"publisher","award":["C22\/IS\/17373407\/LOGODOR"],"award-info":[{"award-number":["C22\/IS\/17373407\/LOGODOR"]}],"id":[{"id":"10.13039\/501100001866","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000038","name":"Natural Sciences and Engineering Research Council of Canada","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100000038","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Empir Software Eng"],"published-print":{"date-parts":[[2024,11]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Software systems log massive amounts of data, recording important runtime information. Such logs are used, for example, for log-based anomaly detection, which aims to automatically detect abnormal behaviors of the system under analysis by processing the information recorded in its logs. Many log-based anomaly detection techniques based on deep learning models include a pre-processing step called log parsing. However, understanding the impact of log parsing on the accuracy of anomaly detection techniques has received surprisingly little attention so far. Investigating what are the key properties log parsing techniques should ideally have to help anomaly detection is therefore warranted. In this paper, we report on a comprehensive empirical study on the impact of log parsing on anomaly detection accuracy, using 13 log parsing techniques, seven anomly detection techniques (five based on deep learning and two based on traditional machine learning) on three publicly available log datasets. Our empirical results show that, despite what is widely assumed, there is no strong correlation between log parsing accuracy and anomaly detection accuracy, regardless of the metric used for measuring log parsing accuracy. Moreover, we experimentally confirm existing theoretical results showing that it is a property that we refer to as distinguishability in log parsing results\u2014as opposed to their accuracy\u2014that plays an essential role in achieving accurate anomaly detection.<\/jats:p>","DOI":"10.1007\/s10664-024-10533-w","type":"journal-article","created":{"date-parts":[[2024,8,17]],"date-time":"2024-08-17T08:02:26Z","timestamp":1723881746000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":33,"title":["Impact of log parsing on deep learning-based anomaly detection"],"prefix":"10.1007","volume":"29","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3935-2148","authenticated-orcid":false,"given":"Zanis Ali","family":"Khan","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0840-6449","authenticated-orcid":false,"given":"Donghwan","family":"Shin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4854-685X","authenticated-orcid":false,"given":"Domenico","family":"Bianculli","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1393-1010","authenticated-orcid":false,"given":"Lionel C.","family":"Briand","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,8,17]]},"reference":[{"issue":"1","key":"10533_CR1","first-page":"3249","volume":"13","author":"K Ali Abd Al-Hameed","year":"2022","unstructured":"Ali Abd Al-Hameed K (2022) Spearman\u2019s correlation coefficient in statistical analysis. Int J Nonlinear Anal Appl 13(1):3249\u20133255","journal-title":"Int J Nonlinear Anal Appl"},{"key":"10533_CR2","unstructured":"Backlund H, Hedblom A, Neijman N (2011) A density-based spatial clustering of application with noise. Data Mining TNM033 pp 11\u201330"},{"key":"10533_CR3","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1023\/A:1010933404324","volume":"45","author":"L Breiman","year":"2001","unstructured":"Breiman L (2001) Random forests. Mach Learn 45:5\u201332","journal-title":"Mach Learn"},{"key":"10533_CR4","unstructured":"Chen Z, Liu J, Gu W, Su Y, Lyu MR (2021) Experience report: deep learning-based system log analysis for anomaly detection. arXiv:2107.05908"},{"key":"10533_CR5","doi-asserted-by":"publisher","unstructured":"Cho K, van Merri\u00ebnboer B, Bahdanau D, Bengio Y (2014) On the properties of neural machine translation: Encoder\u2013decoder approaches. In: Proceedings of SSST-8, Eighth Workshop on Syntax, semantics and structure in statistical translation, association for computational linguistics, Doha, Qatar, pp 103\u2013111, https:\/\/doi.org\/10.3115\/v1\/W14-4012, https:\/\/aclanthology.org\/W14-4012","DOI":"10.3115\/v1\/W14-4012"},{"key":"10533_CR6","doi-asserted-by":"publisher","first-page":"879","DOI":"10.1109\/TSE.2020.3007554","volume":"48","author":"H Dai","year":"2020","unstructured":"Dai H, Li H, Chen CS, Shang W, Chen T (2020) Logram: Efficient log parsing using n-gram dictionaries. IEEE Trans Softw Eng (TSE) 48:879\u2013892. https:\/\/doi.org\/10.1109\/TSE.2020.3007554","journal-title":"IEEE Trans Softw Eng (TSE)"},{"key":"10533_CR7","unstructured":"Devlin J, Chang MW, Lee K, Toutanova K (2018) Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv:1810.04805"},{"key":"10533_CR8","doi-asserted-by":"publisher","unstructured":"Du M, Li F (2016) Spell: Streaming parsing of system event logs. In: 2016 IEEE 16th International conference on data mining (ICDM), IEEE, IEEE, Los Alamitos, CA, USA, pp 859\u2013864. https:\/\/doi.org\/10.1109\/CNSM.2015.7367331","DOI":"10.1109\/CNSM.2015.7367331"},{"key":"10533_CR9","doi-asserted-by":"publisher","unstructured":"Du M, Li F, Zheng G, Srikumar V (2017) Deeplog: Anomaly detection and diagnosis from system logs through deep learning. In: 2017 ACM Conference on computer and communications security (SIGSAC), Association for Computing Machinery, New York, NY, USA, CCS \u201917, p 1285\u20131298. https:\/\/doi.org\/10.1145\/3133956.3134015","DOI":"10.1145\/3133956.3134015"},{"key":"10533_CR10","doi-asserted-by":"publisher","first-page":"1591","DOI":"10.1109\/ICSE.2012.6227029","volume-title":"2012 34th International conference on software engineering (ICSE)","author":"A Elyasov","year":"2012","unstructured":"Elyasov A (2012) Log-based testing. 2012 34th International conference on software engineering (ICSE). IEEE, IEEE, Los Alamitos, CA, USA, pp 1591\u20131594"},{"key":"10533_CR11","doi-asserted-by":"publisher","unstructured":"Fu Q, Lou JG, Wang Y, Li J (2009) Execution anomaly detection in distributed systems through unstructured log analysis. In: 2009 IEEE international conference on data mining (ICDM), IEEE, IEEE, Los Alamitos, CA, USA, pp 149\u2013158. https:\/\/doi.org\/10.1109\/ICDM.2009.60","DOI":"10.1109\/ICDM.2009.60"},{"issue":"1","key":"10533_CR12","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s10664-022-10214-6","volume":"28","author":"Y Fu","year":"2023","unstructured":"Fu Y, Yan M, Xu Z, Xia X, Zhang X, Yang D (2023) An empirical study of the impact of log parsers on the performance of log-based anomaly detection. Empirical Softw Eng 28(1):1\u201339","journal-title":"Empirical Softw Eng"},{"key":"10533_CR13","doi-asserted-by":"publisher","unstructured":"Hamooni H, Debnath B, Xu J, Zhang H, Jiang G, Mueen A (2016) Logmine: Fast pattern recognition for log analytics. In: 25th ACM International on conference on information and knowledge management (CIKM), Association for Computing Machinery, New York, NY, USA, pp 1573\u20131582. https:\/\/doi.org\/10.1145\/2983323.2983358","DOI":"10.1145\/2983323.2983358"},{"key":"10533_CR14","doi-asserted-by":"publisher","unstructured":"He P, Zhu J, Zheng Z, Lyu MR (2017) Drain: An online log parsing approach with fixed depth tree. In: 2017 IEEE International conference on web services (ICWS), IEEE, IEEE, Los Alamitos, CA, USA, pp 33\u201340. https:\/\/doi.org\/10.1109\/ICWS.2017.13","DOI":"10.1109\/ICWS.2017.13"},{"key":"10533_CR15","unstructured":"He S, Zhu J, He P, Lyu MR (2020) Loghub: A large collection of system log datasets towards automated log analytics. arXiv:2008.06448https:\/\/arxiv.org\/pdf\/2008.06448.pdf"},{"key":"10533_CR16","doi-asserted-by":"publisher","unstructured":"He S, He P, Chen Z, Yang T, Su Y, Lyu MR (2021) A survey on automated log analysis for reliability engineering. ACM Comput Surv 54(6). https:\/\/doi.org\/10.1145\/3460345","DOI":"10.1145\/3460345"},{"issue":"4","key":"10533_CR17","doi-asserted-by":"publisher","first-page":"18","DOI":"10.1109\/5254.708428","volume":"13","author":"MA Hearst","year":"1998","unstructured":"Hearst MA, Dumais ST, Osuna E, Platt J, Scholkopf B (1998) Support vector machines. IEEE Intell Syst Appl 13(4):18\u201328","journal-title":"IEEE Intell Syst Appl"},{"key":"10533_CR18","first-page":"303","volume-title":"European conference on computer vision","author":"C Huang","year":"2022","unstructured":"Huang C, Guan H, Jiang A, Zhang Y, Spratling M, Wang YF (2022) Registration based few-shot anomaly detection. European conference on computer vision. Springer, Springer, New York, NY, USA, pp 303\u2013319"},{"issue":"1","key":"10533_CR19","doi-asserted-by":"publisher","first-page":"170","DOI":"10.1587\/transinf.2019EDL8149","volume":"103","author":"S Jeong","year":"2020","unstructured":"Jeong S, Jha AK, Shin Y, Lee WJ (2020) A log-based testing approach for detecting faults caused by incorrect assumptions about the environment. IEICE Trans Inf Syst 103(1):170\u2013173","journal-title":"IEICE Trans Inf Syst"},{"issue":"1","key":"10533_CR20","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3588918","volume":"1","author":"P Jia","year":"2023","unstructured":"Jia P, Cai S, Ooi BC, Wang P, Xiong Y (2023) Robust and transferable log-based anomaly detection. Proceed ACM on Manag Data 1(1):1\u201326","journal-title":"Proceed ACM on Manag Data"},{"key":"10533_CR21","doi-asserted-by":"publisher","unstructured":"Jiang ZM, Hassan AE, Flora P, Hamann G (2008) Abstracting execution logs to execution events for enterprise applications. In: 2008 The Eighth international conference on quality software (QSIC), IEEE, IEEE, Los Alamitos, CA, USA, pp 181\u2013186. https:\/\/doi.org\/10.1109\/QSIC.2008.50","DOI":"10.1109\/QSIC.2008.50"},{"key":"10533_CR22","unstructured":"Joulin A, Grave E, Bojanowski P, Douze M, J\u00e9gou H, Mikolov T (2016) Fasttext. zip: Compressing text classification models. arXiv:1612.03651"},{"key":"10533_CR23","unstructured":"Jurafsky D, Martin JH (2019) Vector semantics and embeddings. Speech and language processing pp 1\u201331"},{"key":"10533_CR24","doi-asserted-by":"crossref","unstructured":"Khan ZA, Shin D, Bianculli D, Briand L (2022) Guidelines for assessing the accuracy of log message template identification techniques. In: Proceedings of the 44th International conference on software engineering (ICSE\u201922), ACM, ACM, New York, NY, United States, p 1095\u20131106","DOI":"10.1145\/3510003.3510101"},{"key":"10533_CR25","doi-asserted-by":"publisher","unstructured":"Khan ZA, Shin D, Bianculli D, Briand L (2024) Replication package for \u201cimpact of log parsing on deep learning-based anomaly detection\u201d. https:\/\/doi.org\/10.6084\/m9.figshare.21995183, https:\/\/figshare.com\/articles\/software\/21995183","DOI":"10.6084\/m9.figshare.21995183"},{"key":"10533_CR26","doi-asserted-by":"crossref","unstructured":"Le VH, Zhang H (2021) Log-based anomaly detection without log parsing. In: 2021 36th IEEE\/ACM International conference on automated software engineering (ASE), IEEE, pp 492\u2013504","DOI":"10.1109\/ASE51524.2021.9678773"},{"key":"10533_CR27","first-page":"1356","volume-title":"2022 IEEE\/ACM 44th International conference on software engineering (ICSE)","author":"VH Le","year":"2022","unstructured":"Le VH, Zhang H (2022) Log-based anomaly detection with deep learning: how far are we? 2022 IEEE\/ACM 44th International conference on software engineering (ICSE). IEEE, ACM, New York, NY, USA, pp 1356\u20131367"},{"key":"10533_CR28","doi-asserted-by":"crossref","unstructured":"Le VH, Zhang H (2023) Log parsing with prompt-based few-shot learning. In: International conference on software engineering (ICSE)","DOI":"10.1109\/ICSE48619.2023.00204"},{"key":"10533_CR29","first-page":"151","volume-title":"2018 IEEE 16th Intl Conf on dependable, autonomic and secure computing, 16th Intl Conf on Pervasive Intelligence and Computing, 4th Intl Conf on Big Data Intelligence and Computing and Cyber Science and Technology Congress (DASC\/PiCom\/DataCom\/CyberSciTech)","author":"S Lu","year":"2018","unstructured":"Lu S, Wei X, Li Y, Wang L (2018) Detecting anomaly in big data system logs using convolutional neural network. 2018 IEEE 16th Intl Conf on dependable, autonomic and secure computing, 16th Intl Conf on Pervasive Intelligence and Computing, 4th Intl Conf on Big Data Intelligence and Computing and Cyber Science and Technology Congress (DASC\/PiCom\/DataCom\/CyberSciTech). IEEE, IEEE, Los Alamitos, CA, USA, pp 151\u2013158"},{"key":"10533_CR30","doi-asserted-by":"publisher","unstructured":"Makanju AA, Zincir-Heywood AN, Milios EE (2009) Clustering event logs using iterative partitioning. In: 15th ACM SIGKDD international conference on Knowledge discovery and data mining (SIGKDD), Association for Computing Machinery, New York, NY, USA, pp 1255\u20131264. https:\/\/doi.org\/10.1145\/1557019.1557154","DOI":"10.1145\/1557019.1557154"},{"key":"10533_CR31","first-page":"4739","volume":"19","author":"W Meng","year":"2019","unstructured":"Meng W, Liu Y, Zhu Y, Zhang S, Pei D, Liu Y, Chen Y, Zhang R, Tao S, Sun P et al (2019) Loganomaly: Unsupervised detection of sequential and quantitative anomalies in unstructured logs. IJCAI, ACM, New York, NY, USA 19:4739\u20134745","journal-title":"IJCAI, ACM, New York, NY, USA"},{"key":"10533_CR32","doi-asserted-by":"publisher","unstructured":"Messaoudi S, Panichella A, Bianculli D, Briand L, Sasnauskas R (2018) A search-based approach for accurate identification of log message formats. In: 2018 IEEE\/ACM 26th International conference on program comprehension (ICPC), ACM, Association for Computing Machinery, New York, NY, USA, pp 167\u201316710. https:\/\/doi.org\/10.1145\/3196321.3196340","DOI":"10.1145\/3196321.3196340"},{"key":"10533_CR33","unstructured":"Mikolov T, Chen K, Corrado G, Dean J (2013) Efficient estimation of word representations in vector space. arXiv:1301.3781"},{"key":"10533_CR34","doi-asserted-by":"publisher","unstructured":"Mizutani M (2013) Incremental mining of system log format. In: 2013 IEEE International conference on services computing (SCC), IEEE, IEEE, Los Alamitos, CA, USA, pp 595\u2013602. https:\/\/doi.org\/10.1109\/SCC.2013.73","DOI":"10.1109\/SCC.2013.73"},{"key":"10533_CR35","doi-asserted-by":"publisher","unstructured":"Mvula PK, Branco P, Jourdan GV, Viktor HL (2023) Heart: Heterogeneous log anomaly detection using robust transformers. In: International Conference on discovery science, Springer, Springer, New York, NY, USA, pp 673\u2013687. https:\/\/doi.org\/10.1007\/978-3-031-45275-8_45","DOI":"10.1007\/978-3-031-45275-8_45"},{"key":"10533_CR36","doi-asserted-by":"publisher","unstructured":"Nagappan M, Vouk MA (2010) Abstracting log lines to log event types for mining software system logs. In: 2010 7th IEEE Working conference on mining software repositories (MSR), IEEE, IEEE, Los Alamitos, CA, USA, pp 114\u2013117.https:\/\/doi.org\/10.1109\/MSR.2010.5463281","DOI":"10.1109\/MSR.2010.5463281"},{"key":"10533_CR37","doi-asserted-by":"publisher","unstructured":"Nedelkoski S, Bogatinovski J, Acker A, Cardoso J, Kao O (2020) Self-attentive classification-based anomaly detection in unstructured logs. In: 2020 IEEE International conference on data mining (ICDM), IEEE, IEEE, New York, NY, USA, pp 1196\u20131201. https:\/\/doi.org\/10.1109\/ICDM50108.2020.00148","DOI":"10.1109\/ICDM50108.2020.00148"},{"key":"10533_CR38","first-page":"575","volume-title":"37th annual IEEE\/IFIP international conference on dependable systems and networks (DSN\u201907), IEEE, IEEE\/IFIP International Conference on Dependable Systems and Networks (DSN\u201907)","author":"A Oliner","year":"2007","unstructured":"Oliner A, Stearley J (2007) What supercomputers say: A study of five system logs. 37th annual IEEE\/IFIP international conference on dependable systems and networks (DSN\u201907), IEEE, IEEE\/IFIP International Conference on Dependable Systems and Networks (DSN\u201907). Edinburgh, UK, pp 575\u2013584"},{"key":"10533_CR39","unstructured":"Pang G, Ding C, Shen C, Hengel Avd (2021) Explainable deep few-shot anomaly detection with deviation networks. arXiv:2108.00462"},{"key":"10533_CR40","first-page":"2825","volume":"12","author":"F Pedregosa","year":"2011","unstructured":"Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, Blondel M, Prettenhofer P, Weiss R, Dubourg V et al (2011) Scikit-learn: Machine learning in python. J Mach Learn Res 12:2825\u20132830","journal-title":"J Mach Learn Res"},{"key":"10533_CR41","doi-asserted-by":"publisher","unstructured":"Rong G, Xu Y, Gu S, Zhang H, Shao D (2020) Can you capture information as you intend to? a case study on logging practice in industry. In: 2020 IEEE International conference on software maintenance and evolution (ICSME), pp 12\u201322. https:\/\/doi.org\/10.1109\/ICSME46990.2020.00012","DOI":"10.1109\/ICSME46990.2020.00012"},{"issue":"5","key":"10533_CR42","doi-asserted-by":"publisher","first-page":"513","DOI":"10.1016\/0306-4573(88)90021-0","volume":"24","author":"G Salton","year":"1988","unstructured":"Salton G, Buckley C (1988) Term-weighting approaches in automatic text retrieval. Inf Process & Manag 24(5):513\u2013523","journal-title":"Inf Process & Manag"},{"key":"10533_CR43","unstructured":"Shima K (2016) Length matters: Clustering system log messages using length of words. arXiv:1611.03213"},{"key":"10533_CR44","doi-asserted-by":"publisher","first-page":"277","DOI":"10.1007\/978-3-030-88494-9_16","volume-title":"International conference on runtime verification","author":"D Shin","year":"2021","unstructured":"Shin D, Khan ZA, Bianculli D, Briand L (2021) A theoretical framework for understanding the relationship between log parsing and anomaly detection. International conference on runtime verification. Springer, Springer, Cham, pp 277\u2013287"},{"key":"10533_CR45","doi-asserted-by":"publisher","unstructured":"Tang L, Li T, Perng CS (2011) Logsig: Generating system events from raw textual logs. In: 20th ACM international conference on Information and knowledge management (CIKM), ACM, New York, NY, USA, pp 785\u2013794. https:\/\/doi.org\/10.1145\/2063576.2063690","DOI":"10.1145\/2063576.2063690"},{"key":"10533_CR46","doi-asserted-by":"crossref","unstructured":"Tao S, Liu Y, Meng W, Wang J, Zhao Y, Su C, Tian W, Zhang M, Yang H, Chen X (2023) Da-parser: A pre-trained domain-aware parsing framework for heterogeneous log analysis. In: 2023 IEEE 47th Annual computers, software, and applications conference (COMPSAC), IEEE, pp 322\u2013327","DOI":"10.1109\/COMPSAC57700.2023.00050"},{"key":"10533_CR47","doi-asserted-by":"publisher","unstructured":"Vaarandi R (2003) A data clustering algorithm for mining patterns from event logs. In: 3rd IEEE Workshop on IP operations & management (IPOM), IEEE, IEEE, Los Alamitos, CA, USA, pp 119\u2013126. https:\/\/doi.org\/10.1109\/IPOM.2003.1251233","DOI":"10.1109\/IPOM.2003.1251233"},{"key":"10533_CR48","doi-asserted-by":"publisher","unstructured":"Vaarandi R, Pihelgas M (2015) Logcluster - a data clustering and pattern mining algorithm for event logs. In: 2015 11th International conference on network and service management (CNSM), IEEE, Los Alamitos, CA, USA, pp 1\u20137. https:\/\/doi.org\/10.1109\/CNSM.2015.7367331","DOI":"10.1109\/CNSM.2015.7367331"},{"key":"10533_CR49","doi-asserted-by":"publisher","first-page":"196","DOI":"10.1007\/978-1-4612-4380-9_16","volume-title":"Breakthroughs in statistics","author":"F Wilcoxon","year":"1992","unstructured":"Wilcoxon F (1992) Individual comparisons by ranking methods. Breakthroughs in statistics. Springer, New York, NY, USA, pp 196\u2013202"},{"key":"10533_CR50","doi-asserted-by":"crossref","unstructured":"Wu X, Li H, Khomh F (2023) On the effectiveness of log representation for log-based anomaly detection. Empirical Softw Eng","DOI":"10.1007\/s10664-023-10364-1"},{"key":"10533_CR51","doi-asserted-by":"publisher","first-page":"1448","DOI":"10.1109\/ICSE43902.2021.00130","volume-title":"2021 IEEE\/ACM 43rd International conference on software engineering (ICSE)","author":"L Yang","year":"2021","unstructured":"Yang L, Chen J, Wang Z, Wang W, Jiang J, Dong X, Zhang W (2021) Semi-supervised log-based anomaly detection via probabilistic label estimation. 2021 IEEE\/ACM 43rd International conference on software engineering (ICSE). IEEE, IEEE, Madrid, Spain, pp 1448\u20131460"},{"key":"10533_CR52","doi-asserted-by":"crossref","unstructured":"Zhang X, Xu Y, Lin Q, Qiao B, Zhang H, Dang Y, Xie C, Yang X, Cheng Q, Li Z, et\u00a0al. (2019) Robust log-based anomaly detection on unstable log data. In: Proceedings of the 2019 27th ACM joint meeting on european software engineering conference and symposium on the foundations of software engineering, The ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC\/FSE), Tallin, Estonia, pp 807\u2013817","DOI":"10.1145\/3338906.3338931"},{"key":"10533_CR53","doi-asserted-by":"publisher","unstructured":"Zhu J, He S, Liu J, He P, Xie Q, Zheng Z, Lyu MR (2019) Tools and benchmarks for automated log parsing. In: 2019 IEEE\/ACM 41st International conference on software engineering: software engineering in practice (ICSE-SEIP), IEEE, IEEE, Los Alamitos, CA, USA, pp 121\u2013130. https:\/\/doi.org\/10.1109\/ICSE-SEIP.2019.00021","DOI":"10.1109\/ICSE-SEIP.2019.00021"}],"container-title":["Empirical Software Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-024-10533-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10664-024-10533-w\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-024-10533-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,6]],"date-time":"2024-11-06T04:48:51Z","timestamp":1730868531000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10664-024-10533-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,8,17]]},"references-count":53,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2024,11]]}},"alternative-id":["10533"],"URL":"https:\/\/doi.org\/10.1007\/s10664-024-10533-w","relation":{},"ISSN":["1382-3256","1573-7616"],"issn-type":[{"value":"1382-3256","type":"print"},{"value":"1573-7616","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,8,17]]},"assertion":[{"value":"22 July 2024","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 August 2024","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no Conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}],"article-number":"139"}}