{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,24]],"date-time":"2026-07-24T15:21:10Z","timestamp":1784906470614,"version":"3.55.0"},"publisher-location":"New York, NY, USA","reference-count":47,"publisher":"ACM","license":[{"start":{"date-parts":[[2026,4,12]],"date-time":"2026-04-12T00:00:00Z","timestamp":1775952000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/legalcode"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2026,4,12]]},"DOI":"10.1145\/3786583.3786876","type":"proceedings-article","created":{"date-parts":[[2026,7,11]],"date-time":"2026-07-11T09:12:14Z","timestamp":1783761134000},"page":"328-339","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Learning from Change: Predictive Models for Incident Prevention in a Regulated IT Environment"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7136-398X","authenticated-orcid":false,"given":"Eileen","family":"Kapel","sequence":"first","affiliation":[{"name":"ING Bank, Amsterdam, Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-0901-5388","authenticated-orcid":false,"given":"Jan","family":"Lennartz","sequence":"additional","affiliation":[{"name":"ING Bank, Brussels, Belgium"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1615-355X","authenticated-orcid":false,"given":"Luis","family":"Cruz","sequence":"additional","affiliation":[{"name":"Delft University of Technology, Delft, Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4231-1897","authenticated-orcid":false,"given":"Diomidis","family":"Spinellis","sequence":"additional","affiliation":[{"name":"Delft University of Technology, Delft, Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4850-3312","authenticated-orcid":false,"given":"Arie","family":"van Deursen","sequence":"additional","affiliation":[{"name":"Delft University of Technology, Delft, Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2026,7,11]]},"reference":[{"key":"e_1_3_3_1_2_2","unstructured":"2022-12-27. Regulation (EU) 2022\/2554 of the European Parliament and of the Council of 14 December 2022 on digital operational resilience for the financial sector and amending Regulations (EC) No 1060\/2009 (EU) No 648\/2012 (EU) No 600\/2014 (EU) No 909\/2014 and (EU) 2016\/1011. OJ L 333 (2022-12-27) 1\u201379. https:\/\/eur-lex.europa.eu\/eli\/reg\/2022\/2554\/oj"},{"key":"e_1_3_3_1_3_2","doi-asserted-by":"crossref","unstructured":"Amina Adadi and Mohammed Berrada. 2018. Peeking inside the black-box: a survey on explainable artificial intelligence (XAI). IEEE access 6 (2018) 52138\u201352160.","DOI":"10.1109\/ACCESS.2018.2870052"},{"key":"e_1_3_3_1_4_2","doi-asserted-by":"crossref","unstructured":"Salman Ahmed Muskaan Singh Brendan Doherty Effirul Ramlan Kathryn Harkin Magda Bucholc and Damien Coyle. 2023. An empirical analysis of state-of-art classification models in an it incident severity prediction framework. Applied Sciences 13 6 (2023) 3843.","DOI":"10.3390\/app13063843"},{"key":"e_1_3_3_1_5_2","doi-asserted-by":"crossref","unstructured":"Gerg\u0151 Barta. 2018. The increasing role of IT auditors in financial audit: risks and intelligent answers. Business Management and Education 16 1 (2018) 81\u201393.","DOI":"10.3846\/bme.2018.2142"},{"key":"e_1_3_3_1_6_2","doi-asserted-by":"publisher","DOI":"10.1109\/CLOUD53861.2021.00025"},{"key":"e_1_3_3_1_7_2","unstructured":"Kent Beck Mike Beedle Arie Van\u00a0Bennekum Alistair Cockburn Ward Cunningham Martin Fowler James Grenning Jim Highsmith Andrew Hunt Ron Jeffries et\u00a0al. 2001. The agile manifesto."},{"key":"e_1_3_3_1_8_2","volume-title":"Site reliability engineering: How Google runs production systems","author":"Beyer Betsy","year":"2016","unstructured":"Betsy Beyer, Chris Jones, Jennifer Petoff, and Niall\u00a0Richard Murphy. 2016. Site reliability engineering: How Google runs production systems. \" O\u2019Reilly Media, Inc.\"."},{"key":"e_1_3_3_1_9_2","doi-asserted-by":"publisher","DOI":"10.1145\/3324884.3416624"},{"key":"e_1_3_3_1_10_2","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939785"},{"key":"e_1_3_3_1_11_2","unstructured":"European Commission. 2024. The act texts. https:\/\/artificialintelligenceact.eu\/the-act\/"},{"key":"e_1_3_3_1_12_2","unstructured":"EBA. 2021. Revised Guidelines on major incident reporting under PSD2. https:\/\/www.eba.europa.eu\/regulation-and-policy\/payment-services-and-electronic-money\/guidelines-on-major-incidents-reporting-under-psd2"},{"key":"e_1_3_3_1_13_2","unstructured":"IBM\u00a0Cloud Education. 2019. IT Infrastructure Library (ITIL). https:\/\/www.ibm.com\/cloud\/learn\/it-infrastructure-library"},{"key":"e_1_3_3_1_14_2","unstructured":"Stephen Elliot. 2014. DevOps and the cost of downtime: Fortune 1000 best practice metrics quantified. International Data Corporation (IDC) (2014)."},{"key":"e_1_3_3_1_15_2","doi-asserted-by":"publisher","DOI":"10.5555\/3235404"},{"key":"e_1_3_3_1_16_2","doi-asserted-by":"publisher","DOI":"10.1145\/3542929.3563482"},{"key":"e_1_3_3_1_17_2","doi-asserted-by":"publisher","DOI":"10.1109\/CNSM.2016.7818430"},{"key":"e_1_3_3_1_18_2","doi-asserted-by":"publisher","DOI":"10.1109\/NOMS.2016.7502929"},{"key":"e_1_3_3_1_19_2","doi-asserted-by":"publisher","unstructured":"Zhe\u00a0Hui Hoo Jane Candlish and Dawn Teare. 2017. What is an ROC curve? Emergency Medicine Journal 34 6 (2017) 357\u2013359. arXiv:https:\/\/emj.bmj.com\/content\/34\/6\/357.full.pdf10.1136\/emermed-2017-206735","DOI":"10.1136\/emermed-2017-206735"},{"key":"e_1_3_3_1_20_2","doi-asserted-by":"publisher","unstructured":"ISO\/IEC\/IEEE. 2017. ISO\/IEC\/IEEE International Standard - Systems and software engineering\u2013Vocabulary. ISO\/IEC\/IEEE 24765:2017(E) (2017) 1\u2013541. 10.1109\/IEEESTD.2017.8016712","DOI":"10.1109\/IEEESTD.2017.8016712"},{"key":"e_1_3_3_1_21_2","doi-asserted-by":"crossref","unstructured":"Nathalie Japkowicz and Shaju Stephen. 2002. The class imbalance problem: A systematic study. Intelligent data analysis 6 5 (2002) 429\u2013449.","DOI":"10.3233\/IDA-2002-6504"},{"key":"e_1_3_3_1_22_2","doi-asserted-by":"publisher","DOI":"10.1145\/3643665.3648048"},{"key":"e_1_3_3_1_23_2","doi-asserted-by":"publisher","DOI":"10.1145\/3639477.3639755"},{"key":"e_1_3_3_1_24_2","volume-title":"Advances in Neural Information Processing Systems","author":"Ke Guolin","year":"2017","unstructured":"Guolin Ke, Qi Meng, Thomas Finley, Taifeng Wang, Wei Chen, Weidong Ma, Qiwei Ye, and Tie-Yan Liu. 2017. LightGBM: A Highly Efficient Gradient Boosting Decision Tree. In Advances in Neural Information Processing Systems , I.\u00a0Guyon, U.\u00a0Von Luxburg, S.\u00a0Bengio, H.\u00a0Wallach, R.\u00a0Fergus, S.\u00a0Vishwanathan, and R.\u00a0Garnett (Eds.), Vol.\u00a030. Curran Associates, Inc.https:\/\/proceedings.neurips.cc\/paper_files\/paper\/2017\/file\/6449f44a102fde848669bdd9eb6b76fa-Paper.pdf"},{"key":"e_1_3_3_1_25_2","first-page":"389","volume-title":"17th USENIX Symposium on Networked Systems Design and Implementation (NSDI 20)","author":"Li Ze","year":"2020","unstructured":"Ze Li, Qian Cheng, Ken Hsieh, Yingnong Dang, Peng Huang, Pankaj Singh, Xinsheng Yang, Qingwei Lin, Youjiang Wu, Sebastien Levy, and Murali Chintalapati. 2020. Gandalf: An Intelligent, End-To-End Analytics Service for Safe Deployment in Large-Scale Cloud Infrastructure. In 17th USENIX Symposium on Networked Systems Design and Implementation (NSDI 20). USENIX Association, Santa Clara, CA, 389\u2013402. https:\/\/www.usenix.org\/conference\/nsdi20\/presentation\/li"},{"key":"e_1_3_3_1_26_2","unstructured":"Scott Lundberg. 2017. A unified approach to interpreting model predictions. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/1705.07874 (2017)."},{"key":"e_1_3_3_1_27_2","unstructured":"Scott Lundberg. 2021. Be careful when interpreting predictive models in search of causal insights. https:\/\/medium.com\/data-science\/be-careful-when-interpreting-predictive-models-in-search-of-causal-insights-e68626e664b6"},{"key":"e_1_3_3_1_28_2","unstructured":"Scott\u00a0M Lundberg Gabriel\u00a0G Erion and Su-In Lee. 2018. Consistent individualized feature attribution for tree ensembles. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/1802.03888 (2018)."},{"key":"e_1_3_3_1_29_2","doi-asserted-by":"publisher","unstructured":"Adya Mishra. 2019. Exploring ITIL and ITSM Change Management in Highly Regulated Industries: A Review of Best Practices and Challenges. International Journal of Innovative Research in Engineering & Multidisciplinary Physical Sciences 7 (10 2019) 1\u20138. 10.5281\/zenodo.14838584","DOI":"10.5281\/zenodo.14838584"},{"key":"e_1_3_3_1_30_2","unstructured":"Greg Morrison. 2021. Automated Change Impact Assessments. https:\/\/www.servicenow.com\/community\/it-service-management-blog\/automated-change-impact-assessments\/ba-p\/2267267"},{"key":"e_1_3_3_1_31_2","first-page":"4593","volume-title":"Proceedings of the 29th international conference on computational linguistics","author":"Mosca Edoardo","year":"2022","unstructured":"Edoardo Mosca, Ferenc Szigeti, Stella Tragianni, Daniel Gallagher, and Georg Groh. 2022. SHAP-based explanation methods: a review for NLP interpretability. In Proceedings of the 29th international conference on computational linguistics. 4593\u20134603."},{"key":"e_1_3_3_1_32_2","doi-asserted-by":"crossref","unstructured":"Francis\u00a0Sahngun Nahm. 2022. Receiver operating characteristic curve: overview and practical use for clinicians. Korean journal of anesthesiology 75 1 (2022) 25\u201336.","DOI":"10.4097\/kja.21209"},{"key":"e_1_3_3_1_33_2","unstructured":"Didrik Nielsen. 2016. Tree boosting with xgboost-why does xgboost win\" every\" machine learning competition?Master\u2019s thesis. NTNU."},{"key":"e_1_3_3_1_34_2","unstructured":"European Parliament and Council of\u00a0the European\u00a0Union. 2018. https:\/\/www.eba.europa.eu\/about-us"},{"key":"e_1_3_3_1_35_2","unstructured":"European Parliament and Council of\u00a0the European\u00a0Union. 2019-11-29. Directive (EU) EBA\/GL\/2019\/04 of the European Parliament and of the Council of 29 November 2019 on EBA Guidelines on ICT and security risk management repealing Directive EBA\/GL\/2017\/17. OJ (2019-11-29). https:\/\/www.eba.europa.eu\/regulation-and-policy\/internal-governance\/guidelines-on-ict-and-security-risk-management"},{"key":"e_1_3_3_1_36_2","unstructured":"Fabian Pedregosa Ga\u00ebl Varoquaux Alexandre Gramfort Vincent Michel Bertrand Thirion Olivier Grisel Mathieu Blondel Peter Prettenhofer Ron Weiss Vincent Dubourg et\u00a0al. 2011. Scikit-learn: Machine learning in Python. Journal of machine learning research 12 Oct (2011) 2825\u20132830."},{"key":"e_1_3_3_1_37_2","unstructured":"Youcef Remil Anes Bendimerad Romain Mathonat and Mehdi Kaytoue. 2024. AIOps Solutions for Incident Management: Technical Guidelines and A Comprehensive Literature Review. arxiv:https:\/\/arXiv.org\/abs\/2404.01363\u00a0[cs.OS] https:\/\/arxiv.org\/abs\/2404.01363"},{"key":"e_1_3_3_1_38_2","doi-asserted-by":"publisher","DOI":"10.1145\/3605098.3635981"},{"key":"e_1_3_3_1_39_2","doi-asserted-by":"crossref","unstructured":"Ranjan Sapkota Shaina Raza and Manoj Karkee. 2025. Comprehensive analysis of transparency and accessibility of chatgpt deepseek and other sota large language models. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2502.18505 (2025).","DOI":"10.20944\/preprints202502.1608.v1"},{"key":"e_1_3_3_1_40_2","unstructured":"ServiceNow. [n. d.]. What is ServiceNow?https:\/\/www.servicenow.com\/what-is-servicenow.html"},{"key":"e_1_3_3_1_41_2","unstructured":"ServiceNow. 2024. Change Success Score Product Documentation Release Washington DC. https:\/\/docs.servicenow.com\/bundle\/washingtondc-it-service-management\/page\/product\/change-management\/concept\/change-success-score.html"},{"key":"e_1_3_3_1_42_2","doi-asserted-by":"crossref","unstructured":"United States Code. 2002. Sarbanes-Oxley Act of 2002 PL 107-204 116 Stat 745. Codified in Sections 11 15 18 28 and 29 USC.","DOI":"10.2307\/1342618"},{"key":"e_1_3_3_1_43_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE-SEIP58684.2023.00026"},{"key":"e_1_3_3_1_44_2","volume-title":"Case study research: Design and methods","author":"Yin Robert\u00a0K","year":"2009","unstructured":"Robert\u00a0K Yin. 2009. Case study research: Design and methods. Vol.\u00a05. sage."},{"key":"e_1_3_3_1_45_2","first-page":"575","volume-title":"17th USENIX Symposium on Networked Systems Design and Implementation (NSDI 20)","author":"Zhai Ennan","year":"2020","unstructured":"Ennan Zhai, Ang Chen, Ruzica Piskac, Mahesh Balakrishnan, Bingchuan Tian, Bo Song, and Haoliang Zhang. 2020. Check before You Change: Preventing Correlated Failures in Service Updates. In 17th USENIX Symposium on Networked Systems Design and Implementation (NSDI 20). USENIX Association, Santa Clara, CA, 575\u2013589. https:\/\/www.usenix.org\/conference\/nsdi20\/presentation\/zhai"},{"key":"e_1_3_3_1_46_2","doi-asserted-by":"publisher","DOI":"10.1145\/3468264.3468543"},{"key":"e_1_3_3_1_47_2","doi-asserted-by":"publisher","DOI":"10.1109\/ISSRE59848.2023.00028"},{"key":"e_1_3_3_1_48_2","doi-asserted-by":"publisher","unstructured":"Quan Zou Sifa Xie Ziyu Lin Meihong Wu and Ying Ju. 2016. Finding the Best Classification Threshold in Imbalanced Classification. Big Data Research 5 (2016) 2\u20138. 10.1016\/j.bdr.2015.12.001Big data analytics and applications.","DOI":"10.1016\/j.bdr.2015.12.001"}],"event":{"name":"ICSE-SEIP '26: 2026 IEEE\/ACM 48th International Conference on Software Engineering","location":"Rio de Janeiro Brazil","acronym":"ICSE-SEIP '26","sponsor":["SIGSOFT ACM Special Interest Group on Software Engineering","IEEE CS","Faculty of Engineering of University of Porto"]},"container-title":["Proceedings of the IEEE\/ACM 48th International Conference on Software Engineering: Software Engineering in Practice"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3786583.3786876","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,7,11]],"date-time":"2026-07-11T09:16:43Z","timestamp":1783761403000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3786583.3786876"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,4,12]]},"references-count":47,"alternative-id":["10.1145\/3786583.3786876","10.1145\/3786583"],"URL":"https:\/\/doi.org\/10.1145\/3786583.3786876","relation":{},"subject":[],"published":{"date-parts":[[2026,4,12]]},"assertion":[{"value":"2026-07-11","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}