{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,13]],"date-time":"2026-10-13T04:22:13Z","timestamp":1791865333692,"version":"4.3.4"},"publisher-location":"New York, NY, USA","reference-count":38,"publisher":"ACM","license":[{"start":{"date-parts":[[2024,4,14]],"date-time":"2024-04-14T00:00:00Z","timestamp":1713052800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2024,4,14]]},"DOI":"10.1145\/3639477.3639755","type":"proceedings-article","created":{"date-parts":[[2024,5,31]],"date-time":"2024-05-31T13:27:26Z","timestamp":1717162046000},"page":"36-46","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":5,"title":["On the Difficulty of Identifying Incident-Inducing Changes"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7136-398X","authenticated-orcid":false,"given":"Eileen","family":"Kapel","sequence":"first","affiliation":[{"name":"AI for Fintech Research, ING, Amsterdam, Netherlands"},{"name":"Software Technology, Delft University of Technology, Delft, Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1615-355X","authenticated-orcid":false,"given":"Luis","family":"Cruz","sequence":"additional","affiliation":[{"name":"Delft University of Technology, Delft, Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4231-1897","authenticated-orcid":false,"given":"Diomidis","family":"Spinellis","sequence":"additional","affiliation":[{"name":"Delft University of Technology, Delft, Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4850-3312","authenticated-orcid":false,"given":"Arie","family":"Van Deursen","sequence":"additional","affiliation":[{"name":"Delft University of Technology, Delft, Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2024,5,31]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1007\/s12599-020-00669-6"},{"key":"e_1_3_2_1_2_1","volume-title":"Challenges in the Deployment and Operation of Machine Learning in Practice. In ECIS 2019 proceedings. 27th European Conference on Information Systems (ECIS), Stockholm & Uppsala","author":"Baier Lucas","year":"2019","unstructured":"Lucas Baier, Fabian J\u00f6hren, and Stefan Seebacher. 2019. Challenges in the Deployment and Operation of Machine Learning in Practice. In ECIS 2019 proceedings. 27th European Conference on Information Systems (ECIS), Stockholm & Uppsala, Sweden, June 8-14, 2019. Research Papers. 163."},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/CLOUD53861.2021.00025"},{"key":"e_1_3_2_1_4_1","volume-title":"Alistair Cockburn, Ward Cunningham, Martin Fowler, James Grenning, Jim Highsmith, Andrew Hunt, Ron Jeffries, et al.","author":"Beck Kent","year":"2001","unstructured":"Kent Beck, Mike Beedle, Arie Van Bennekum, Alistair Cockburn, Ward Cunningham, Martin Fowler, James Grenning, Jim Highsmith, Andrew Hunt, Ron Jeffries, et al. 2001. The agile manifesto."},{"key":"e_1_3_2_1_5_1","volume-title":"Site reliability engineering: How Google runs production systems. \" O'Reilly Media","author":"Beyer Betsy","unstructured":"Betsy Beyer, Chris Jones, Jennifer Petoff, and Niall Richard Murphy. 2016. Site reliability engineering: How Google runs production systems. \" O'Reilly Media, Inc.\"."},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3324884.3416624"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939785"},{"key":"e_1_3_2_1_8_1","volume-title":"Jane Huffman Hayes, Patrick M\u00e4der, and Andrea Zisman.","author":"Cleland-Huang Jane","year":"2014","unstructured":"Jane Cleland-Huang, Orlena CZ Gotel, Jane Huffman Hayes, Patrick M\u00e4der, and Andrea Zisman. 2014. Software traceability: trends and future directions. In Future of software engineering proceedings. 55--69."},{"key":"e_1_3_2_1_9_1","unstructured":"IBM Cloud. 2023. IBM Cloud Docs. https:\/\/cloud.ibm.com\/docs\/overview?topic=overview-dr-testing"},{"key":"e_1_3_2_1_10_1","unstructured":"CoEST. [n. d.]. Center of excellence for software & systems traceability. http:\/\/sarec.nd.edu\/coest\/index.html"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE-Companion.2019.00023"},{"key":"e_1_3_2_1_12_1","unstructured":"Alexandre Drouin. 2013. PUAdapter: A tool that adapts any estimator that can output a probability to positive-unlabled learning. It is based on: Elkan Charles and Keith Noto. \"Learning classifiers from only positive and unlabeled data.\" Proceeding of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining. ACM 2008. https:\/\/github.com\/aldro61\/pu-learning."},{"key":"e_1_3_2_1_13_1","unstructured":"IBM Cloud Education. 2019. IT Infrastructure Library (ITIL). https:\/\/www.ibm.com\/cloud\/learn\/it-infrastructure-library"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/1401890.1401920"},{"key":"e_1_3_2_1_15_1","unstructured":"Nicole Forsgren Jez Humble and Gene Kim. 2018. Accelerate. IT Revolution Portland OR."},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/CNSM.2016.7818430"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/NOMS.2016.7502929"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/IEEESTD.2017.8016712"},{"key":"e_1_3_2_1_19_1","volume-title":"The class imbalance problem: A systematic study. Intelligent data analysis 6, 5","author":"Japkowicz Nathalie","year":"2002","unstructured":"Nathalie Japkowicz and Shaju Stephen. 2002. The class imbalance problem: A systematic study. Intelligent data analysis 6, 5 (2002), 429--449."},{"key":"e_1_3_2_1_20_1","volume-title":"Incident Management in a Software-Defined Business: A Case Study. Available at SSRN 4333515","author":"Kapel Eileen","year":"2023","unstructured":"Eileen Kapel, Lu\u00eds Cruz, Diomidis Spinellis, and Arie van Deursen. 2023. Incident Management in a Software-Defined Business: A Case Study. Available at SSRN 4333515 (2023)."},{"key":"e_1_3_2_1_21_1","unstructured":"Andrew Lerner. 2017. AIOps Platforms. https:\/\/blogs.gartner.com\/andrew-lerner\/2017\/08\/09\/aiops-platforms\/"},{"key":"e_1_3_2_1_22_1","volume-title":"17th USENIX Symposium on Networked Systems Design and Implementation (NSDI 20)","author":"Li Ze","year":"2020","unstructured":"Ze Li, Qian Cheng, Ken Hsieh, Yingnong Dang, Peng Huang, Pankaj Singh, Xinsheng Yang, Qingwei Lin, Youjiang Wu, Sebastien Levy, et al. 2020. Gandalf: An Intelligent,{End-To-End} Analytics Service for Safe Deployment in {Large-Scale} Cloud Infrastructure. In 17th USENIX Symposium on Networked Systems Design and Implementation (NSDI 20). 389--402."},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1951.10500769"},{"key":"e_1_3_2_1_24_1","unstructured":"Presidential Commission on the Space Shuttle Challenger Accident. 1986. Report of the Presidential Commission on the Space Shuttle Challenger Accident. http:\/\/history.nasa.gov\/rogersrep\/genindex.htm"},{"key":"e_1_3_2_1_25_1","unstructured":"European Parliament and Council of the European Union. 2018. https:\/\/www.eba.europa.eu\/about-us"},{"key":"e_1_3_2_1_26_1","unstructured":"European Parliament and Council of the European Union. 2019-11-29. Directive (EU) EBA\/GL\/2019\/04 of the European Parliament and of the Council of 29 November 2019 on EBA Guidelines on ICT and security risk management repealing Directive EBA\/GL\/2017\/17. OJ (2019-11-29). https:\/\/www.eba.europa.eu\/regulation-and-policy\/internal-governance\/guidelines-on-ict-and-security-risk-management"},{"key":"e_1_3_2_1_27_1","unstructured":"European Parliament and Council of the European Union. 2022-12-27. Regulation (EU) 2022\/2554 of the European Parliament and of the Council of 14 December 2022 on digital operational resilience for the financial sector and amending Regulations (EC) No 1060\/2009 (EU) No 648\/2012 (EU) No 600\/2014 (EU) No 909\/2014 and (EU) 2016\/1011. OJ L 333 (2022-12-27) 1--79. https:\/\/eur-lex.europa.eu\/eli\/reg\/2022\/2554\/oj"},{"key":"e_1_3_2_1_28_1","first-page":"2825","article-title":"Scikit-learn: Machine learning in Python","author":"Pedregosa Fabian","year":"2011","unstructured":"Fabian Pedregosa, Ga\u00ebl Varoquaux, Alexandre Gramfort, Vincent Michel, Bertrand Thirion, Olivier Grisel, Mathieu Blondel, Peter Prettenhofer, Ron Weiss, Vincent Dubourg, et al. 2011. Scikit-learn: Machine learning in Python. Journal of machine learning research 12, Oct (2011), 2825--2830.","journal-title":"Journal of machine learning research 12"},{"key":"e_1_3_2_1_29_1","volume-title":"AIOps: A Multivocal Literature Review. Artificial Intelligence for Cloud and Edge Computing","author":"Rijal Laxmi","year":"2022","unstructured":"Laxmi Rijal, Ricardo Colomo-Palacios, and Mary S\u00e1nchez-Gord\u00f3n. 2022. AIOps: A Multivocal Literature Review. Artificial Intelligence for Cloud and Edge Computing (2022), 31--50."},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","unstructured":"Claude Sammut and Geoffrey I. Webb (Eds.). 2010. TF-IDF. Springer US Boston MA 986--987. 10.1007\/978-0-387-30164-8_832","DOI":"10.1007\/978-0-387-30164-8_832"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/CBI.2019.00025"},{"key":"e_1_3_2_1_32_1","volume-title":"Proceedings of the 14th ACM\/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM). 1--12","author":"Serban Alex","unstructured":"Alex Serban, Koen van der Blom, Holger Hoos, and Joost Visser. 2020. Adoption and effects of software engineering best practices in machine learning. In Proceedings of the 14th ACM\/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM). 1--12."},{"key":"e_1_3_2_1_33_1","unstructured":"Meghan Stewart and Angela Fleischmann. 2023. Update release cycle for windows clients - windows deployment. https:\/\/learn.microsoft.com\/en-us\/windows\/deployment\/update\/release-cycle"},{"key":"e_1_3_2_1_34_1","volume-title":"Sarbanes-Oxley Act of","author":"United States Code. 2002.","year":"2002","unstructured":"United States Code. 2002. Sarbanes-Oxley Act of 2002, PL 107-204, 116 Stat 745. Codified in Sections 11, 15, 18, 28, and 29 USC."},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISSRE55969.2022.00043"},{"key":"e_1_3_2_1_36_1","volume-title":"Fast Outage Analysis of Large-scale Production Clouds with Service Correlation Mining. In 2021 IEEE\/ACM 43rd International Conference on Software Engineering (ICSE). IEEE, 885--896","author":"Wang Yaohui","year":"2021","unstructured":"Yaohui Wang, Guozheng Li, Zijian Wang, Yu Kang, Yangfan Zhou, Hongyu Zhang, Feng Gao, Jeffrey Sun, Li Yang, Pochian Lee, et al. 2021. Fast Outage Analysis of Large-scale Production Clouds with Service Correlation Mining. In 2021 IEEE\/ACM 43rd International Conference on Software Engineering (ICSE). IEEE, 885--896."},{"key":"e_1_3_2_1_37_1","volume-title":"Case study research: Design and methods","author":"Yin Robert K","unstructured":"Robert K Yin. 2009. Case study research: Design and methods. Vol. 5. sage."},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3468264.3468543"}],"event":{"name":"ICSE-SEIP '24: 46th International Conference on Software Engineering: Software Engineering in Practice","location":"Lisbon Portugal","acronym":"ICSE-SEIP '24","sponsor":["SIGSOFT ACM Special Interest Group on Software Engineering","IEEE CS","Faculty of Engineering of University of Porto"]},"container-title":["Proceedings of the 46th International Conference on Software Engineering: Software Engineering in Practice"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3639477.3639755","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3639477.3639755","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T23:44:32Z","timestamp":1750290272000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3639477.3639755"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,4,14]]},"references-count":38,"alternative-id":["10.1145\/3639477.3639755","10.1145\/3639477"],"URL":"https:\/\/doi.org\/10.1145\/3639477.3639755","relation":{},"subject":[],"published":{"date-parts":[[2024,4,14]]},"assertion":[{"value":"2024-05-31","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}