{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,28]],"date-time":"2026-01-28T23:01:59Z","timestamp":1769641319437,"version":"3.49.0"},"reference-count":33,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2021,12,30]],"date-time":"2021-12-30T00:00:00Z","timestamp":1640822400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Key R&amp;D Program of China","award":["2018YFB1601502"],"award-info":[{"award-number":["2018YFB1601502"]}]},{"DOI":"10.13039\/501100018617","name":"LiaoNing Revitalization Talents Program","doi-asserted-by":"publisher","award":["XLYC1902071"],"award-info":[{"award-number":["XLYC1902071"]}],"id":[{"id":"10.13039\/501100018617","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>The log messages generated in the system reflect the state of the system at all times. The realization of autonomous detection of abnormalities in log messages can help operators find abnormalities in time and provide a basis for analyzing the causes of abnormalities. First, this paper proposes a log sequence anomaly detection method based on contrastive adversarial training and dual feature extraction. This method uses BERT (Bidirectional Encoder Representations from Transformers) and VAE (Variational Auto-Encoder) to extract the semantic features and statistical features of the log sequence, respectively, and the dual features are combined to perform anomaly detection on the log sequence, with a novel contrastive adversarial training method also used to train the model. In addition, this paper introduces the method of obtaining statistical features of log sequence and the method of combining semantic features with statistical features. Furthermore, the specific process of contrastive adversarial training is described. Finally, an experimental comparison is carried out, and the experimental results show that the method in this paper is better than the contrasted log sequence anomaly detection method.<\/jats:p>","DOI":"10.3390\/e24010069","type":"journal-article","created":{"date-parts":[[2021,12,30]],"date-time":"2021-12-30T21:41:21Z","timestamp":1640900481000},"page":"69","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":17,"title":["Log Sequence Anomaly Detection Method Based on Contrastive Adversarial Training and Dual Feature Extraction"],"prefix":"10.3390","volume":"24","author":[{"given":"Qiaozheng","family":"Wang","sequence":"first","affiliation":[{"name":"School of Information Science and Technology, Dalian Maritime University, Dalian 116026, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiuguo","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Information Science and Technology, Dalian Maritime University, Dalian 116026, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xuejie","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Information Science and Technology, Dalian Maritime University, Dalian 116026, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhiying","family":"Cao","sequence":"additional","affiliation":[{"name":"School of Information Science and Technology, Dalian Maritime University, Dalian 116026, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,12,30]]},"reference":[{"key":"ref_1","unstructured":"Chen, Z., Liu, J., and Gu, W. (2021). Experience Report: Deep Learning-based System Log Analysis for Anomaly Detection. arXiv."},{"key":"ref_2","unstructured":"Lou, J.G., Fu, Q., and Yang, S. (2010, January 23\u201325). Mining Invariants from Console Logs for System Problem Detection. Proceedings of the USENIX Annual Technical Conference, Boston, MA, USA."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Xu, W., Huang, L., and Fox, A. (2009, January 11\u201314). Detecting large-scale system problems by mining console logs. Proceedings of the 22nd ACM Symposium on Operating Systems Principles 2009, Big Sky, MT, USA.","DOI":"10.1145\/1629575.1629587"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"931","DOI":"10.1109\/TDSC.2017.2762673","article-title":"Towards Automated Log Parsing for Large-Scale Log Data Analysis","volume":"15","author":"He","year":"2017","journal-title":"IEEE Trans. Dependable Secur. Comput."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Liang, Y., Zhang, Y., and Xiong, H. (2007, January 28\u201331). Failure prediction in ibm bluegene\/l event logs. Proceedings of the 7th IEEE International Con-ference on Data Mining, Omaha, NE, USA.","DOI":"10.1109\/ICDM.2007.46"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Zhou, Z., Zhang, Y., and Wang, S. (2021). A Coordination System between Decision Making and Controlling for Autonomous Collision Avoidance of Large Intelligent Ships. J. Mar. Sci. Eng., 9.","DOI":"10.3390\/jmse9111202"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Du, M., Li, F., and Zheng, G. (November, January 30). Deeplog: Anomaly detection and diagnosis from system logs through deep learning. Proceedings of the 2017 ACM SIGSAC Conference on Computer and Communications Security, Dallas, TX, USA.","DOI":"10.1145\/3133956.3134015"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Vinayakumar, R., Soman, K.P., and Poornachandran, P. (2017, January 13\u201316). Long short-term memory based operation log anomaly detection. Proceedings of the 2017 International Conference on Advances in Computing, Communications and Informatics, Udupi, India.","DOI":"10.1109\/ICACCI.2017.8125846"},{"key":"ref_9","first-page":"1","article-title":"Recurrent neural network attention mechanisms for interpretable system log anomaly detection","volume":"12","author":"Brown","year":"2018","journal-title":"First Workshop Mach. Learn. Comput. Syst."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Lu, S., Wei, X., and Li, Y. (2018, January 12\u201315). Detecting anomaly in big data system logs using convolutional neural network. Proceedings of the 2018 IEEE 16th International Conference on Dependable, Autonomic and Secure Computing and 16th International Conference on Pervasive Intelligence and Computing and 4th International Conference on Big Data Intelligence and Computing and Cyber Science and Technology Congress, Athens, Greece.","DOI":"10.1109\/DASC\/PiCom\/DataCom\/CyberSciTec.2018.00037"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Farzad, A., and Gulliver, T.A. (2019). Log message anomaly detection and classification using auto-b\/lstm and auto-gru. arXiv.","DOI":"10.31224\/osf.io\/d4e6a"},{"key":"ref_12","unstructured":"Guo, Y., Wen, Y., and Jiang, C. (2021). Detecting Log Anomalies with Multi-Head Attention (LAMA). arXiv."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Wang, J., Tang, Y., He, S., Zhao, C., Sharma, P.K., Alfarraj, O., and Tolba, A. (2020). LogEvent2vec: LogEvent-to-Vector based anomaly detection for large-scale logs in internet of things. Sensors, 20.","DOI":"10.3390\/s20092451"},{"key":"ref_14","unstructured":"Zhang, X., Xu, Y., and Lin, Q. (2018, January 12\u201315). Robust log-based anomaly detection on unstable log data. Proceedings of the 2018 IEEE 16th International Conference on Dependable, Autonomic and Secure Computing and 16th International Conference on Pervasive Intelligence and Computing and 4th International Conference on Big Data Intelligence and Computing and Cyber Science and Technology Congress, Athens, Greece."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Li, X., Chen, P., Jing, L., He, Z., and Yu, G. (2020, January 12\u201315). SwissLog: Robust and unified deep learning based log anomaly detection for diverse faults. Proceedings of the 2020 IEEE 31st International Symposium on Software Reliability Engineering (ISSRE), Coimbra, Portugal.","DOI":"10.1109\/ISSRE5003.2020.00018"},{"key":"ref_16","first-page":"366","article-title":"A software system anomaly detection method based on log information and CNN-text","volume":"43","author":"Mei","year":"2020","journal-title":"Chin. J. Computers."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Yang, L., Chen, J., Wang, Z., Wang, W., Jiang, J., Dong, X., and Zhang, W. (, January 25\u201328). Semi-supervised log-based anomaly detection via probabilistic label estimation. Proceedings of the 2021 IEEE\/ACM 43rd International Conference on Software Engineering (ICSE), Madrid, Spain.","DOI":"10.1109\/ICSE43902.2021.00130"},{"key":"ref_18","first-page":"4739","article-title":"LogAnomaly: Unsupervised detection of sequential and quantitative anomalies in unstructured logs","volume":"19","author":"Meng","year":"2019","journal-title":"IJCAI"},{"key":"ref_19","first-page":"1","article-title":"LogGAN: A log-level generative adversarial network for anomaly detection using permutation event modeling","volume":"6","author":"Xia","year":"2020","journal-title":"Inf. Syst. Front."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"102540","DOI":"10.1016\/j.ipm.2021.102540","article-title":"QLLog: A log anomaly detection method based on Q-learning algorithm","volume":"58","author":"Duan","year":"2021","journal-title":"Inf. Process. Manag."},{"key":"ref_21","unstructured":"Miyato, T., Dai, A.M., and Goodfellow, I. (2016). Adversarial Training Methods for Semi-Supervised Text Classification. arXiv."},{"key":"ref_22","unstructured":"Devlin, J., Chang, M.W., and Lee, K. (2018). Bert: Pre-Training of Deep Bidirectional Transformers for Language Understanding. arXiv."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Gao, T., Yao, X., and Chen, D. (2021). SimCSE: Simple contrastive learning of sentence embeddings. arXiv.","DOI":"10.18653\/v1\/2021.emnlp-main.552"},{"key":"ref_24","unstructured":"Kingma, D.P., and Welling, M. (2013). Auto-Encoding Variational Bayes. arXiv."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Li, X., Li, Z., and Xie, H. (2021, January 2\u20139). Merging statistical feature via adaptive gate for improved text classification. Proceedings of the AAAI Conference on Artificial Intelligence, Shenzhen, China.","DOI":"10.1609\/aaai.v35i15.17569"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"He, P., Zhu, J., Zheng, Z., and Lyu, M.R. (2017, January 25\u201330). Drain: An Online Log Parsing Approach with Fixed Depth Tree. Proceedings of the 2017 IEEE International Conference on Web Services (ICWS), Honolulu, HI, USA.","DOI":"10.1109\/ICWS.2017.13"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"He, S., Zhu, J., and He, P. (2016, January 23\u201327). Experience report: System log analysis for anomaly detection. Proceedings of the 27th IEEE International Symposium on Software Reliability Engineering, Ottawa, ON, Canada.","DOI":"10.1109\/ISSRE.2016.21"},{"key":"ref_28","first-page":"18","article-title":"Defending Deep Neural Networks against Backdoor Attack by Using De-trigger Autoencoder","volume":"10","author":"Kwon","year":"2021","journal-title":"IEEE Access"},{"key":"ref_29","unstructured":"He, S., Zhu, J., and He, P. (2020). Loghub: A large collection of system log datasets towards automated log analytics. arXiv."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Guo, H., Yuan, S., and Wu, X. (2021). LogBERT: Log anomaly detection via BERT. arXiv.","DOI":"10.1109\/IJCNN52387.2021.9534113"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"135","DOI":"10.32604\/csse.2021.014030","article-title":"A Generative Adversarial Networks for Log Anomaly Detection","volume":"37","author":"Duan","year":"2021","journal-title":"Comput. Syst. Sci. Eng."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Oliner, A., and Stearley, J. (2007, January 25\u201328). What supercomputers say: A study of five system logs. Proceedings of the 37th Annual IEEE\/IFIP International Conference on Dependable Systems and Networks, Edinburgh, UK.","DOI":"10.1109\/DSN.2007.103"},{"key":"ref_33","unstructured":"Kingma, D.P., and Ba, J. (2014). Adam: A Method for Stochastic Optimization. arXiv."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/24\/1\/69\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:56:20Z","timestamp":1760169380000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/24\/1\/69"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12,30]]},"references-count":33,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,1]]}},"alternative-id":["e24010069"],"URL":"https:\/\/doi.org\/10.3390\/e24010069","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,12,30]]}}}