{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,24]],"date-time":"2026-10-24T17:50:13Z","timestamp":1792864213774,"version":"4.5.0"},"publisher-location":"New York, NY, USA","reference-count":37,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,11,7]],"date-time":"2022-11-07T00:00:00Z","timestamp":1667779200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,11,7]]},"DOI":"10.1145\/3542929.3563482","type":"proceedings-article","created":{"date-parts":[[2022,11,7]],"date-time":"2022-11-07T15:19:18Z","timestamp":1667834358000},"page":"126-141","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":58,"title":["How to fight production incidents?"],"prefix":"10.1145","author":[{"given":"Supriyo","family":"Ghosh","sequence":"first","affiliation":[{"name":"Microsoft"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Manish","family":"Shetty","sequence":"additional","affiliation":[{"name":"Microsoft"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chetan","family":"Bansal","sequence":"additional","affiliation":[{"name":"Microsoft"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Suman","family":"Nath","sequence":"additional","affiliation":[{"name":"Microsoft"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2022,11,7]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/3377811.3380405"},{"key":"e_1_3_2_1_2_1","volume-title":"13th USENIX Symposium on Operating Systems Design and Implementation (OSD1 18)","author":"Alquraan Ahmed","year":"2018","unstructured":"Ahmed Alquraan , Hatem Takruri , Mohammed Alfatafta , and Samer Al-Kiswany . 2018 . An Analysis of {Network-Partitioning} Failures in Cloud Systems . In 13th USENIX Symposium on Operating Systems Design and Implementation (OSD1 18) . 51--68. Ahmed Alquraan, Hatem Takruri, Mohammed Alfatafta, and Samer Al-Kiswany. 2018. An Analysis of {Network-Partitioning} Failures in Cloud Systems. In 13th USENIX Symposium on Operating Systems Design and Implementation (OSD1 18). 51--68."},{"key":"e_1_3_2_1_3_1","volume-title":"DeCaf: Diagnosing and Triaging Performance Issues in Large-Scale Cloud Services. In 2020 IEEE\/ACM 42nd International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP).","author":"Bansal Chetan","year":"2020","unstructured":"Chetan Bansal , Sundararajan Renganathan , Ashima Asudani , Olivier Midy , and Mathru Janakiraman . 2020 . DeCaf: Diagnosing and Triaging Performance Issues in Large-Scale Cloud Services. In 2020 IEEE\/ACM 42nd International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP). Chetan Bansal, Sundararajan Renganathan, Ashima Asudani, Olivier Midy, and Mathru Janakiraman. 2020. DeCaf: Diagnosing and Triaging Performance Issues in Large-Scale Cloud Services. In 2020 IEEE\/ACM 42nd International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP)."},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/DSN48987.2021.00026"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.2019.00040"},{"key":"e_1_3_2_1_6_1","volume-title":"An Empirical Investigation of Incident Triage for Online Service Systems. In 2019 IEEE\/ACM 41st International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP). 111--120","author":"Chen J.","unstructured":"J. Chen , X. He , Q. Lin , Y. Xu , H. Zhang , D. Hao , F. Gao , Z. Xu , Y. Dang , and D. Zhang . 2019 . An Empirical Investigation of Incident Triage for Online Service Systems. In 2019 IEEE\/ACM 41st International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP). 111--120 . J. Chen, X. He, Q. Lin, Y. Xu, H. Zhang, D. Hao, F. Gao, Z. Xu, Y. Dang, and D. Zhang. 2019. An Empirical Investigation of Incident Triage for Online Service Systems. In 2019 IEEE\/ACM 41st International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP). 111--120."},{"key":"e_1_3_2_1_7_1","volume-title":"Continuous Incident Triage for Large-Scale Online Service Systems. In 2019 34th IEEE\/ACM International Conference on Automated Software Engineering (ASE). 364--375","author":"Chen J.","unstructured":"J. Chen , X. He , Q. Lin , H. Zhang , D. Hao , F. Gao , Z. Xu , Y. Dang , and D. Zhang . 2019 . Continuous Incident Triage for Large-Scale Online Service Systems. In 2019 34th IEEE\/ACM International Conference on Automated Software Engineering (ASE). 364--375 . J. Chen, X. He, Q. Lin, H. Zhang, D. Hao, F. Gao, Z. Xu, Y. Dang, and D. Zhang. 2019. Continuous Incident Triage for Large-Scale Online Service Systems. In 2019 34th IEEE\/ACM International Conference on Automated Software Engineering (ASE). 364--375."},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISSRE.2014.34"},{"key":"e_1_3_2_1_9_1","volume-title":"A coefficient of agreement for nominal scales. Educational and psychological measurement 20, 1","author":"Cohen Jacob","year":"1960","unstructured":"Jacob Cohen . 1960. A coefficient of agreement for nominal scales. Educational and psychological measurement 20, 1 ( 1960 ), 37--46. Jacob Cohen. 1960. A coefficient of agreement for nominal scales. Educational and psychological measurement 20, 1 (1960), 37--46."},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2591062.2591172"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3236024.3236030"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2670979.2670986"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2987550.2987583"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2806777.2806937"},{"key":"e_1_3_2_1_15_1","volume-title":"Capturing and Enhancing In Situ System Observability for Failure Detection. In 13th USENIX Symposium on Operating Systems Design and Implementation (OSDI '18)","author":"Huang Peng","year":"2018","unstructured":"Peng Huang , Chuanxiong Guo , Jacob R. Lorch , Lidong Zhou , and Yingnong Dang . 2018 . Capturing and Enhancing In Situ System Observability for Failure Detection. In 13th USENIX Symposium on Operating Systems Design and Implementation (OSDI '18) . USENIX Association, Carlsbad, CA, 1--16. https:\/\/www.usenix.org\/conference\/osdi18\/presentation\/huang Peng Huang, Chuanxiong Guo, Jacob R. Lorch, Lidong Zhou, and Yingnong Dang. 2018. Capturing and Enhancing In Situ System Observability for Failure Detection. In 13th USENIX Symposium on Operating Systems Design and Implementation (OSDI '18). USENIX Association, Carlsbad, CA, 1--16. https:\/\/www.usenix.org\/conference\/osdi18\/presentation\/huang"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3368089.3417054"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2872362.2872374"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3102980.3102985"},{"key":"e_1_3_2_1_19_1","volume-title":"2021 USENIX Annual Technical Conference (USENIX ATC 21)","author":"Li Liqun","year":"2021","unstructured":"Liqun Li , Xu Zhang , Xin Zhao , Hongyu Zhang , Yu Kang , Pu Zhao , Bo Qiao , Shilin He , Pochian Lee , Jeffrey Sun , 2021 . Fighting the fog of war: Automated incident detection for cloud systems . In 2021 USENIX Annual Technical Conference (USENIX ATC 21) . 131--146. Liqun Li, Xu Zhang, Xin Zhao, Hongyu Zhang, Yu Kang, Pu Zhao, Bo Qiao, Shilin He, Pochian Lee, Jeffrey Sun, et al. 2021. Fighting the fog of war: Automated incident detection for cloud systems. In 2021 USENIX Annual Technical Conference (USENIX ATC 21). 131--146."},{"key":"e_1_3_2_1_20_1","volume-title":"17th USENIX Symposium on Networked Systems Design and Implementation (NSDI 20)","author":"Li Ze","year":"2020","unstructured":"Ze Li , Qian Cheng , Ken Hsieh , Yingnong Dang , Peng Huang , Pankaj Singh , Xinsheng Yang , Qingwei Lin , Youjiang Wu , Sebastien Levy , 2020 . Gandalf: An Intelligent, {End-To-End} Analytics Service for Safe Deployment in {Large-Scale} Cloud Infrastructure . In 17th USENIX Symposium on Networked Systems Design and Implementation (NSDI 20) . 389--402. Ze Li, Qian Cheng, Ken Hsieh, Yingnong Dang, Peng Huang, Pankaj Singh, Xinsheng Yang, Qingwei Lin, Youjiang Wu, Sebastien Levy, et al. 2020. Gandalf: An Intelligent, {End-To-End} Analytics Service for Safe Deployment in {Large-Scale} Cloud Infrastructure. In 17th USENIX Symposium on Networked Systems Design and Implementation (NSDI 20). 389--402."},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3317550.3321438"},{"key":"e_1_3_2_1_22_1","volume-title":"17th USENIX Symposium on Networked Systems Design and Implementation (NSDI 20)","author":"Lou Chang","year":"2020","unstructured":"Chang Lou , Peng Huang , and Scott Smith . 2020 . Understanding, detecting and localizing partial failures in large system software . In 17th USENIX Symposium on Networked Systems Design and Implementation (NSDI 20) . 559--574. Chang Lou, Peng Huang, and Scott Smith. 2020. Understanding, detecting and localizing partial failures in large system software. In 17th USENIX Symposium on Networked Systems Design and Implementation (NSDI 20). 559--574."},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/2623330.2623374"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2783258.2788624"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.5555\/1251460.1251461"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1080\/14786440009463897"},{"key":"e_1_3_2_1_27_1","volume-title":"Mining Root Cause Knowledge from Cloud Service Incident Investigations for AIOps. arXiv preprint arXiv:2204.11598","author":"Saha Amrita","year":"2022","unstructured":"Amrita Saha and Steven CH Hoi . 2022. Mining Root Cause Knowledge from Cloud Service Incident Investigations for AIOps. arXiv preprint arXiv:2204.11598 ( 2022 ). Amrita Saha and Steven CH Hoi. 2022. Mining Root Cause Knowledge from Cloud Service Incident Investigations for AIOps. arXiv preprint arXiv:2204.11598 (2022)."},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE-SEIP52600.2021.00031"},{"key":"e_1_3_2_1_29_1","volume-title":"Arjun Radhakrishna, and Anurag Gupta.","author":"Shetty Manish","year":"2022","unstructured":"Manish Shetty , Chetan Bansal , Sai Pramod Upadhyayula , Arjun Radhakrishna, and Anurag Gupta. 2022 . AutoTSG: Learning and Synthesis for Incident Troubleshooting . arXiv preprint arXiv:2205.13457 (2022). Manish Shetty, Chetan Bansal, Sai Pramod Upadhyayula, Arjun Radhakrishna, and Anurag Gupta. 2022. AutoTSG: Learning and Synthesis for Incident Troubleshooting. arXiv preprint arXiv:2205.13457 (2022)."},{"key":"e_1_3_2_1_30_1","volume-title":"Grounded theory in practice","author":"Strauss Anselm","unstructured":"Anselm Strauss and Juliet M Corbin . 1997. Grounded theory in practice . Sage . Anselm Strauss and Juliet M Corbin. 1997. Grounded theory in practice. Sage."},{"key":"e_1_3_2_1_31_1","volume-title":"14th USENIX Symposium on Operating Systems Design and Implementation (OSDI 20)","author":"Sun Xudong","year":"2020","unstructured":"Xudong Sun , Runxiang Cheng , Jianyan Chen , Elaine Ang , Owolabi Legunsen , and Tianyin Xu . 2020 . Testing configuration changes in context to prevent production failures . In 14th USENIX Symposium on Operating Systems Design and Implementation (OSDI 20) . 735--751. Xudong Sun, Runxiang Cheng, Jianyan Chen, Elaine Ang, Owolabi Legunsen, and Tianyin Xu. 2020. Testing configuration changes in context to prevent production failures. In 14th USENIX Symposium on Operating Systems Design and Implementation (OSDI 20). 735--751."},{"key":"e_1_3_2_1_32_1","volume-title":"Configuration Testing: Testing Configuration Values as Code and with Code. arXiv preprint arXiv:1905.12195","author":"Xu Tianyin","year":"2019","unstructured":"Tianyin Xu and Owolabi Legunsen . 2019 . Configuration Testing: Testing Configuration Values as Code and with Code. arXiv preprint arXiv:1905.12195 (2019). Tianyin Xu and Owolabi Legunsen. 2019. Configuration Testing: Testing Configuration Values as Code and with Code. arXiv preprint arXiv:1905.12195 (2019)."},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/2517349.2522727"},{"key":"e_1_3_2_1_34_1","volume-title":"11th USENIX Symposium on Operating Systems Design and Implementation (OSDI 14)","author":"Yuan Ding","year":"2014","unstructured":"Ding Yuan , Yu Luo , Xin Zhuang , Guilherme Renna Rodrigues , Xu Zhao , Yongle Zhang , Pranay U Jain , and Michael Stumm . 2014 . Simple Testing Can Prevent Most Critical Failures: An Analysis of Production Failures in Distributed {Data-Intensive} Systems . In 11th USENIX Symposium on Operating Systems Design and Implementation (OSDI 14) . 249--265. Ding Yuan, Yu Luo, Xin Zhuang, Guilherme Renna Rodrigues, Xu Zhao, Yongle Zhang, Pranay U Jain, and Michael Stumm. 2014. Simple Testing Can Prevent Most Critical Failures: An Analysis of Production Failures in Distributed {Data-Intensive} Systems. In 11th USENIX Symposium on Operating Systems Design and Implementation (OSDI 14). 249--265."},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE43902.2021.00029"},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/3477132.3483577"},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"crossref","unstructured":"Feng Zhu Lijie Xu Gang Ma Shuping Ji Jie Wang Gang Wang Hongyi Zhang Kun Wan Mingming Wang Xingchao Zhang etal 2022. An Empirical Study on Quality Issues of eBay's Big Data SQL Analytics Platform. (2022).  Feng Zhu Lijie Xu Gang Ma Shuping Ji Jie Wang Gang Wang Hongyi Zhang Kun Wan Mingming Wang Xingchao Zhang et al. 2022. An Empirical Study on Quality Issues of eBay's Big Data SQL Analytics Platform. (2022).","DOI":"10.1109\/ICSE-SEIP55303.2022.9793914"}],"event":{"name":"SoCC '22: ACM Symposium on Cloud Computing","location":"San Francisco California","acronym":"SoCC '22","sponsor":["SIGMOD ACM Special Interest Group on Management of Data","SIGOPS ACM Special Interest Group on Operating Systems"]},"container-title":["Proceedings of the 13th Symposium on Cloud Computing"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3542929.3563482","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3542929.3563482","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T13:49:31Z","timestamp":1750168171000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3542929.3563482"}},"subtitle":["an empirical study on a large-scale cloud service"],"short-title":[],"issued":{"date-parts":[[2022,11,7]]},"references-count":37,"alternative-id":["10.1145\/3542929.3563482","10.1145\/3542929"],"URL":"https:\/\/doi.org\/10.1145\/3542929.3563482","relation":{},"subject":[],"published":{"date-parts":[[2022,11,7]]},"assertion":[{"value":"2022-11-07","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}