{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,12]],"date-time":"2025-11-12T14:21:03Z","timestamp":1762957263411,"version":"3.41.2"},"reference-count":21,"publisher":"World Scientific Pub Co Pte Ltd","issue":"02","funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62006016"],"award-info":[{"award-number":["62006016"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Int. J. Coop. Info. Syst."],"published-print":{"date-parts":[[2024,6]]},"abstract":"<jats:p> We consider the problem of real-time log anomaly detection for distributed system with deep neural networks by unsupervised learning. There are two challenges in this problem, including detection accuracy and analysis efficacy. To tackle these two challenges, we propose GLAD, a simple yet effective approach mining for anomalies in distributed systems. To ensure detection accuracy, we exploit the gradient features in a well-calibrated deep neural network and analyze anomalous pattern within log files. To improve the analysis efficacy, we further integrate one-class support vector machine (SVM) into anomalous analysis, which significantly reduces the cost of anomaly decision boundary delineation. This effective integration successfully solves both accuracy and efficacy in real-time log anomaly detection. Also, since anomalous analysis is based upon unsupervised learning, it significantly reduces the extra data labeling cost. We conduct a series of experiments to justify that GLAD has the best comprehensive performance balanced between accuracy and efficiency, which implies the advantage in tackling practical problems. The results also reveal that GLAD enables effective anomaly mining and consistently outperforms state-of-the-art methods on both recall and F1 scores. <\/jats:p>","DOI":"10.1142\/s0218843023500181","type":"journal-article","created":{"date-parts":[[2023,9,23]],"date-time":"2023-09-23T05:08:02Z","timestamp":1695445682000},"source":"Crossref","is-referenced-by-count":1,"title":["An Unsupervised Gradient-Based Approach for Real-Time Log Analysis From Distributed Systems"],"prefix":"10.1142","volume":"33","author":[{"given":"Minquan","family":"Wang","sequence":"first","affiliation":[{"name":"School of Software Engineering, Beijing Jiaotong University, Beijing, P. R. China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9779-7834","authenticated-orcid":false,"given":"Siyang","family":"Lu","sequence":"additional","affiliation":[{"name":"School of Computer and Information Technology, Beijing Jiaotong University, Beijing, P. R. China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sizhe","family":"Xiao","sequence":"additional","affiliation":[{"name":"Beijing Research Institute of Automation for Machinery Industry, Beijing, P. R. China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dongdong","family":"Wang","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Central Florida, Orlando, FL, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiang","family":"Wei","sequence":"additional","affiliation":[{"name":"School of Software Engineering, Beijing Jiaotong University, Beijing, P. R. China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ningning","family":"Han","sequence":"additional","affiliation":[{"name":"School of Computer and Information Technology, Beijing Jiaotong University, Beijing, P. R. China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Liqiang","family":"Wang","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Central Florida, Orlando, FL, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"219","published-online":{"date-parts":[[2023,9,22]]},"reference":[{"key":"S0218843023500181BIB001","doi-asserted-by":"publisher","DOI":"10.1145\/3133956.3134015"},{"key":"S0218843023500181BIB002","first-page":"1","volume-title":"2017 IEEE\/ACM 25th Int. Symp. Quality of Service (IWQoS)","author":"Zhang S.","year":"2017"},{"key":"S0218843023500181BIB004","volume-title":"Advances in Neural Information Processing Systems","volume":"12","author":"Sch\u00f6lkopf B.","year":"1999"},{"key":"S0218843023500181BIB005","doi-asserted-by":"publisher","DOI":"10.1145\/1629575.1629587"},{"key":"S0218843023500181BIB006","doi-asserted-by":"publisher","DOI":"10.1145\/2889160.2889232"},{"key":"S0218843023500181BIB007","doi-asserted-by":"publisher","DOI":"10.1109\/ISSRE.2016.21"},{"key":"S0218843023500181BIB008","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2019\/658"},{"key":"S0218843023500181BIB009","doi-asserted-by":"publisher","DOI":"10.1145\/2670979.2671005"},{"key":"S0218843023500181BIB010","doi-asserted-by":"publisher","DOI":"10.1109\/CNSM.2015.7367331"},{"key":"S0218843023500181BIB011","doi-asserted-by":"publisher","DOI":"10.1109\/ICAC.2004.1301345"},{"key":"S0218843023500181BIB012","doi-asserted-by":"publisher","DOI":"10.1109\/INFOCOM.2019.8737429"},{"key":"S0218843023500181BIB013","doi-asserted-by":"publisher","DOI":"10.1109\/ICDM.2007.46"},{"key":"S0218843023500181BIB014","doi-asserted-by":"publisher","DOI":"10.1016\/j.comnet.2015.07.019"},{"key":"S0218843023500181BIB015","doi-asserted-by":"publisher","DOI":"10.1109\/ICRITO48877.2020.9197818"},{"key":"S0218843023500181BIB018","doi-asserted-by":"publisher","DOI":"10.1109\/ICSME46990.2020.00069"},{"key":"S0218843023500181BIB019","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.33019428"},{"key":"S0218843023500181BIB020","doi-asserted-by":"publisher","DOI":"10.1109\/INFOCOM41043.2020.9155487"},{"key":"S0218843023500181BIB021","doi-asserted-by":"publisher","DOI":"10.1109\/ISSRE5003.2020.00013"},{"key":"S0218843023500181BIB024","doi-asserted-by":"publisher","DOI":"10.1109\/ICWS.2017.135"},{"key":"S0218843023500181BIB025","doi-asserted-by":"publisher","DOI":"10.1109\/TIFS.2021.3053371"},{"key":"S0218843023500181BIB026","doi-asserted-by":"publisher","DOI":"10.1109\/FUZZ48607.2020.9177762"}],"container-title":["International Journal of Cooperative Information Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S0218843023500181","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,12]],"date-time":"2024-06-12T09:03:36Z","timestamp":1718183016000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/10.1142\/S0218843023500181"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,22]]},"references-count":21,"journal-issue":{"issue":"02","published-print":{"date-parts":[[2024,6]]}},"alternative-id":["10.1142\/S0218843023500181"],"URL":"https:\/\/doi.org\/10.1142\/s0218843023500181","relation":{},"ISSN":["0218-8430","1793-6365"],"issn-type":[{"type":"print","value":"0218-8430"},{"type":"electronic","value":"1793-6365"}],"subject":[],"published":{"date-parts":[[2023,9,22]]},"article-number":"2350018"}}