{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,15]],"date-time":"2026-07-15T17:41:44Z","timestamp":1784137304438,"version":"3.55.0"},"reference-count":57,"publisher":"Association for Computing Machinery (ACM)","issue":"8","license":[{"start":{"date-parts":[[2024,11,21]],"date-time":"2024-11-21T00:00:00Z","timestamp":1732147200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["62102340"],"award-info":[{"award-number":["62102340"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100021171","name":"Guangdong Basic and Applied Basic Research Foundation","doi-asserted-by":"crossref","award":["2024A1515010145"],"award-info":[{"award-number":["2024A1515010145"]}],"id":[{"id":"10.13039\/501100021171","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Softw. Eng. Methodol."],"published-print":{"date-parts":[[2024,11,30]]},"abstract":"<jats:p>\n            Microservices architecture improves software scalability, resilience, and agility but also poses significant challenges to system reliability due to their complexity and dynamic nature. Identifying and resolving anomalies promptly is crucial because they can quickly propagate to other microservices and cause severe damage to the system. Existing root-cause metric localization approaches rely on metrics or metrics-anomalies correlations but overlook other monitoring data sources (e.g., traces). We are the first to identify and leverage the anomaly-aware monotonic correlation between heterogeneous monitoring data, motivated by which we propose a novel framework,\n            <jats:bold>Heterogeneous data sources in Microservice systems for Root Cause Analysis (HeMiRCA)<\/jats:bold>\n            , for hierarchical root cause analysis using Spearman correlation. HeMiRCA is based on the key observation that the microservice responsible for a particular type of fault exhibits a monotonic correlation between the trends of its associated metrics and the trace-based anomaly score of the system. HeMiRCA first calculates time-series anomaly scores using traces and then exploits the correlations between multivariate metrics and the scores to rank the suspicious metrics and microservices. HeMiRCA has been evaluated on two datasets collected from widely used microservice systems. The results show that HeMiRCA outperforms the state-of-the-art approaches by a large margin in identifying root causes at both service level and metric level, achieving a top-1 hit ratio of 82.7% and 74% on average, respectively.\n          <\/jats:p>","DOI":"10.1145\/3674726","type":"journal-article","created":{"date-parts":[[2024,7,1]],"date-time":"2024-07-01T08:26:23Z","timestamp":1719822383000},"page":"1-25","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":17,"title":["HeMiRCA: Fine-Grained Root Cause Analysis for Microservices with Heterogeneous Data Sources"],"prefix":"10.1145","volume":"33","author":[{"ORCID":"https:\/\/orcid.org\/0009-0009-1032-4715","authenticated-orcid":false,"given":"Zhouruixing","family":"Zhu","sequence":"first","affiliation":[{"name":"The Chinese University of Hong Kong, Shenzhen (CUHK-Shenzhen), China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0301-3662","authenticated-orcid":false,"given":"Cheryl","family":"Lee","sequence":"additional","affiliation":[{"name":"The Chinese University of Hong Kong (CUHK), China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3955-1195","authenticated-orcid":false,"given":"Xiaoying","family":"Tang","sequence":"additional","affiliation":[{"name":"The Chinese University of Hong Kong, Shenzhen (CUHK-Shenzhen), China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3377-8129","authenticated-orcid":false,"given":"Pinjia","family":"He","sequence":"additional","affiliation":[{"name":"The Chinese University of Hong Kong, Shenzhen (CUHK-Shenzhen), China and Shenzhen Research Institute of Big Data, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2024,11,21]]},"reference":[{"key":"e_1_3_2_2_2","first-page":"508","volume-title":"Encyclopedia of Measurement and Statistics","author":"Abdi Herv\u00e9","year":"2007","unstructured":"Herv\u00e9 Abdi. 2007. The Kendall rank correlation coefficient. Encyclopedia of Measurement and Statistics. Sage, Thousand Oaks, CA, 508\u2013510."},{"key":"e_1_3_2_3_2","unstructured":"Alibaba. 2023. Chaosblade. Retrieved from https:\/\/github.com\/chaosblade-io\/chaosblade"},{"issue":"1","key":"e_1_3_2_4_2","first-page":"1","article-title":"Variational autoencoder based anomaly detection using reconstruction probability","volume":"2","author":"An Jinwon","year":"2015","unstructured":"Jinwon An and Sungzoon Cho. 2015. Variational autoencoder based anomaly detection using reconstruction probability. Special Lecture on IE 2, 1 (2015), 1\u201318.","journal-title":"Special Lecture on IE"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10699-016-9489-4"},{"issue":"8","key":"e_1_3_2_6_2","doi-asserted-by":"crossref","first-page":"2905","DOI":"10.1109\/TSE.2021.3071473","article-title":"Pathidea: Improving information retrieval-based bug localization by re-constructing execution paths using logs","volume":"48","author":"Chen An Ran","year":"2021","unstructured":"An Ran Chen, Tse-Hsun Chen, and Shaowei Wang. 2021. Pathidea: Improving information retrieval-based bug localization by re-constructing execution paths using logs. IEEE Transactions on Software Engineering 48, 8 (2021), 2905\u20132919.","journal-title":"IEEE Transactions on Software Engineering"},{"key":"e_1_3_2_7_2","doi-asserted-by":"crossref","first-page":"1887","DOI":"10.1109\/INFOCOM.2014.6848128","volume-title":"Proceedings of the IEEE INFOCOM 2014-IEEE Conference on Computer Communications","author":"Chen Pengfei","year":"2014","unstructured":"Pengfei Chen, Yong Qi, Pengfei Zheng, and Di Hou. 2014. Causeinfer: Automatic and distributed performance diagnosis with hierarchical causality graph in large distributed systems. In Proceedings of the IEEE INFOCOM 2014-IEEE Conference on Computer Communications. IEEE, 1887\u20131895."},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1145\/3368089.3417055"},{"key":"e_1_3_2_9_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/978-3-642-00296-0","volume-title":"Noise Reduction in Speech Processing","author":"Cohen Israel","year":"2009","unstructured":"Israel Cohen, Yiteng Huang, Jingdong Chen, Jacob Benesty, Jacob Benesty. 2009. Pearson correlation coefficient. In Noise Reduction in Speech Processing. Springer, Berlin, 1\u20134."},{"key":"e_1_3_2_10_2","first-page":"336","volume-title":"Proceedings of the ICASSP 2021\u20132021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)","author":"Dohi Kota","year":"2021","unstructured":"Kota Dohi, Takashi Endo, Harsh Purohit, Ryo Tanabe, and Yohei Kawaguchi. 2021. Flow-based self-supervised density estimation for anomalous sound detection. In Proceedings of the ICASSP 2021\u20132021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 336\u2013340."},{"key":"e_1_3_2_11_2","unstructured":"Elastic. 2023. Elasticsearch. Retrieved from https:\/\/www.elastic.co\/"},{"key":"e_1_3_2_12_2","first-page":"24","volume-title":"Proceedings of the 2015 IEEE 26th International Symposium on Software Reliability Engineering (ISSRE)","author":"Farshchi Mostafa","year":"2015","unstructured":"Mostafa Farshchi, Jean-Guy Schneider, Ingo Weber, and John Grundy. 2015. Experience report: Anomaly detection of cloud application operations using log and cloud metric correlation analysis. In Proceedings of the 2015 IEEE 26th International Symposium on Software Reliability Engineering (ISSRE). IEEE, 24\u201334."},{"key":"e_1_3_2_13_2","unstructured":"Sadayuki Furuhashi. 2023. Fluentd. Retrieved from https:\/\/www.fluentd.org\/architecture"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1145\/3297858.3304013"},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.2307\/1913710"},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10710-017-9314-z"},{"key":"e_1_3_2_17_2","unstructured":"Google. 2023. Container Advisor. Retrieved from https:\/\/github.com\/google\/cadvisor"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2023.3241299"},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.1145\/3368089.3417066"},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1145\/3573074.3573091"},{"key":"e_1_3_2_21_2","first-page":"1669","volume-title":"Proceedings of the 44th International Conference on Software Engineering","author":"He Jingzhu","year":"2022","unstructured":"Jingzhu He, Yuhang Lin, Xiaohui Gu, Chin-Chia Michael Yeh, and Zhongfang Zhuang. 2022. PerfSig: Extracting performance bug signatures via multi-modality causal analysis. In Proceedings of the 44th International Conference on Software Engineering. 1669\u20131680."},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1145\/3460345"},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1109\/ISSRE.2016.21"},{"key":"e_1_3_2_24_2","unstructured":"Dan Hendrycks Mantas Mazeika and Thomas Dietterich. 2018. Deep anomaly detection with outlier exposure. arXiv:1812.04606. Retrieved from https:\/\/arxiv.org\/abs\/1812.04606"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1109\/ISPA-BDCloud-SocialCom-SustainCom52081.2021.00074"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2020.3044610"},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1145\/2494232.2465753"},{"key":"e_1_3_2_28_2","unstructured":"Diederik P. Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv:1412.6980. Retrieved from https:\/\/arxiv.org\/abs\/1412.6980"},{"key":"e_1_3_2_29_2","unstructured":"Diederik P. Kingma and Max Welling. 2013. Auto-encoding variational bayes. arXiv:1312.6114. Retrieved from https:\/\/arxiv.org\/abs\/1312.6114"},{"key":"e_1_3_2_30_2","unstructured":"Cheryl Lee Tianyi Yang Zhuangbin Chen Yuxin Su and Michael R. Lyu. 2023. Eadro: An end-to-end troubleshooting framework for microservices on multi-source data. arXiv:2302.05092. Retrieved from https:\/\/arxiv.org\/abs\/2302.05092"},{"key":"e_1_3_2_31_2","first-page":"3","volume-title":"Proceedings of the 16th International Conference on Service-Oriented Computing (ICSOC \u201918)","author":"Lin JinJin","year":"2018","unstructured":"JinJin Lin, Pengfei Chen, and Zibin Zheng. 2018. Microscope: Pinpoint performance issues with causal graphs in micro-service environments. In Proceedings of the 16th International Conference on Service-Oriented Computing (ICSOC \u201918). Springer, 3\u201320."},{"key":"e_1_3_2_32_2","first-page":"338","volume-title":"Proceedings of the 2021 IEEE\/ACM 43rd International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP)","author":"Liu Dewei","year":"2021","unstructured":"Dewei Liu, Chuan He, Xin Peng, Fan Lin, Chenxi Zhang, Shengfang Gong, Ziang Li, Jiayu Ou, and Zheshun Wu. 2021. MicroHECL: High-efficient root cause localization in large-scale microservice systems. In Proceedings of the 2021 IEEE\/ACM 43rd International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP). IEEE, 338\u2013347."},{"key":"e_1_3_2_33_2","first-page":"35","volume-title":"Proceedings of the 2019 IEEE 30th International Symposium on Software Reliability Engineering (ISSRE)","author":"Liu Ping","year":"2019","unstructured":"Ping Liu, Yu Chen, Xiaohui Nie, Jing Zhu, Shenglin Zhang, Kaixin Sui, Ming Zhang, and Dan Pei. 2019. Fluxrank: A widely-deployable framework to automatically localizing root cause machines for software service failure mitigation. In Proceedings of the 2019 IEEE 30th International Symposium on Software Reliability Engineering (ISSRE). IEEE, 35\u201346."},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1109\/ISSRE5003.2020.00014"},{"key":"e_1_3_2_35_2","first-page":"475","volume-title":"Proceedings of the 2013 28th IEEE\/ACM International Conference on Automated Software Engineering (ASE)","author":"Lou Jian-Guang","year":"2013","unstructured":"Jian-Guang Lou, Qingwei Lin, Rui Ding, Qiang Fu, Dongmei Zhang, and Tao Xie. 2013. Software analytics for incident management of online services: An experience report. In Proceedings of the 2013 28th IEEE\/ACM International Conference on Automated Software Engineering (ASE). IEEE, 475\u2013485."},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1145\/2623330.2623374"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1145\/3472883.3487003"},{"key":"e_1_3_2_38_2","first-page":"60","volume-title":"Proceedings of the 2019 IEEE International Conference on Web Services (ICWS)","author":"Ma Meng","year":"2019","unstructured":"Meng Ma, Weilan Lin, Disheng Pan, and Ping Wang. 2019. Ms-rank: Multi-metric and self-adaptive root cause diagnosis for microservice applications. In Proceedings of the 2019 IEEE International Conference on Web Services (ICWS). IEEE, 60\u201367."},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.1145\/3366423.3380111"},{"key":"e_1_3_2_40_2","first-page":"1176","volume-title":"Proceedings of the VLDB Endowment","volume":"13","author":"Ma Minghua","year":"2020","unstructured":"Minghua Ma, Zheng Yin, Shenglin Zhang, Sheng Wang, Christopher Zheng, Xinhao Jiang, Hanwen Hu, Cheng Luo, Yilin Li, Nengjun Qiu, et al. 2020b. Diagnosing root causes of intermittent slow queries in cloud databases. Proceedings of the VLDB Endowment 13, 8 (2020), 1176\u20131189."},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.1109\/IWQoS49365.2020.9213058"},{"key":"e_1_3_2_42_2","first-page":"179","volume-title":"Proceedings of the 2019 IEEE 12th International Conference on Cloud Computing (CLOUD)","author":"Nedelkoski Sasho","year":"2019","unstructured":"Sasho Nedelkoski, Jorge Cardoso, and Odej Kao. 2019. Anomaly detection from system tracing data using multimodal deep learning. In Proceedings of the 2019 IEEE 12th International Conference on Cloud Computing (CLOUD). IEEE, 179\u2013186."},{"key":"e_1_3_2_43_2","first-page":"01","article-title":"Microservices in practice, part 1: Reality check and service design","volume":"34","author":"Pautasso Cesare","year":"2017","unstructured":"Cesare Pautasso, Olaf Zimmermann, Mike Amundsen, James Lewis, and Nicolai Josuttis. 2017. Microservices in practice, part 1: Reality check and service design. IEEE Software 34, 01 (2017), 91\u201398.","journal-title":"IEEE Software"},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.conengprac.2017.09.021"},{"key":"e_1_3_2_45_2","first-page":"1278","volume-title":"Proceedings of the 31st International Conference on Machine Learning","author":"Rezende Danilo Jimenez","year":"2014","unstructured":"Danilo Jimenez Rezende, Shakir Mohamed, and Daan Wierstra. 2014. Stochastic backpropagation and approximate inference in deep generative models. In Proceedings of the 31st International Conference on Machine Learning. PMLR, 1278\u20131286."},{"key":"e_1_3_2_46_2","doi-asserted-by":"crossref","first-page":"3215","DOI":"10.1145\/3308558.3313653","volume-title":"Proceedings of the the World Wide Web Conference (WWW \u201919)","author":"Shan Huasong","year":"2019","unstructured":"Huasong Shan, Yuan Chen, Haifeng Liu, Yunpeng Zhang, Xiao Xiao, Xiaofeng He, Min Li, and Wei Ding. 2019. ?-Diagnosis: Unsupervised and real-time diagnosis of small- window long-tail latency in large-scale microservice platforms. In Proceedings of the the World Wide Web Conference (WWW \u201919). ACM, New York, NY, 3215\u20133222."},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.1145\/3501297"},{"key":"e_1_3_2_48_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICWS49710.2020.00026"},{"key":"e_1_3_2_49_2","first-page":"492","volume-title":"Proceedings of the 2018 18th IEEE\/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGRID)","author":"Wang Ping","year":"2018","unstructured":"Ping Wang, Jingmin Xu, Meng Ma, Weilan Lin, Disheng Pan, Yuan Wang, and Pengfei Chen. 2018. Cloudranger: Root cause identification for cloud native systems. In Proceedings of the 2018 18th IEEE\/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGRID). IEEE, 492\u2013502."},{"key":"e_1_3_2_50_2","doi-asserted-by":"publisher","DOI":"10.1145\/3468264.3468613"},{"key":"e_1_3_2_51_2","first-page":"31","volume-title":"Proceedings of the 2021 IEEE\/ACM International Workshop on Cloud Intelligence (CloudIntelligence)","author":"Wu Li","year":"2021","unstructured":"Li Wu, Johan Tordsson, Jasmin Bogatinovski, Erik Elmroth, and Odej Kao. 2021. Microdiag: Fine-grained performance diagnosis for microservice systems. In Proceedings of the 2021 IEEE\/ACM International Workshop on Cloud Intelligence (CloudIntelligence). IEEE, 31\u201336."},{"key":"e_1_3_2_52_2","doi-asserted-by":"publisher","DOI":"10.1109\/NOMS47738.2020.9110353"},{"key":"e_1_3_2_53_2","doi-asserted-by":"publisher","DOI":"10.1145\/3543507.3583215"},{"key":"e_1_3_2_54_2","doi-asserted-by":"publisher","DOI":"10.1145\/3442381.3449905"},{"key":"e_1_3_2_55_2","doi-asserted-by":"publisher","DOI":"10.1002\/0470011815.b2a15150"},{"key":"e_1_3_2_56_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2018.2887384"},{"key":"e_1_3_2_57_2","doi-asserted-by":"publisher","DOI":"10.1145\/3338906.3338961"},{"key":"e_1_3_2_58_2","doi-asserted-by":"publisher","DOI":"10.1145\/3183440.3194991"}],"container-title":["ACM Transactions on Software Engineering and Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3674726","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3674726","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T00:57:50Z","timestamp":1750294670000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3674726"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11,21]]},"references-count":57,"journal-issue":{"issue":"8","published-print":{"date-parts":[[2024,11,30]]}},"alternative-id":["10.1145\/3674726"],"URL":"https:\/\/doi.org\/10.1145\/3674726","relation":{},"ISSN":["1049-331X","1557-7392"],"issn-type":[{"value":"1049-331X","type":"print"},{"value":"1557-7392","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,11,21]]},"assertion":[{"value":"2023-06-20","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-05-27","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-11-21","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}