{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,9,3]],"date-time":"2025-09-03T10:42:51Z","timestamp":1756896171681,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":54,"publisher":"ACM","license":[{"start":{"date-parts":[[2024,7,10]],"date-time":"2024-07-10T00:00:00Z","timestamp":1720569600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2024,7,10]]},"DOI":"10.1145\/3663529.3663856","type":"proceedings-article","created":{"date-parts":[[2024,7,10]],"date-time":"2024-07-10T19:43:13Z","timestamp":1720640593000},"page":"370-381","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Practitioners\u2019 Challenges and Perceptions of CI Build Failure Predictions at Atlassian"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4670-9608","authenticated-orcid":false,"given":"Yang","family":"Hong","sequence":"first","affiliation":[{"name":"Monash University, Melbourne, Australia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5516-9984","authenticated-orcid":false,"given":"Chakkrit","family":"Tantithamthavorn","sequence":"additional","affiliation":[{"name":"Monash University, Melbourne, Australia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4059-757X","authenticated-orcid":false,"given":"Jirat","family":"Pasuksmit","sequence":"additional","affiliation":[{"name":"Atlassian, Sydney, Australia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6328-8839","authenticated-orcid":false,"given":"Patanamon","family":"Thongtanunam","sequence":"additional","affiliation":[{"name":"University of Melbourne, Melbourne, Australia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4978-9407","authenticated-orcid":false,"given":"Arik","family":"Friedman","sequence":"additional","affiliation":[{"name":"Atlassian, Sydney, Australia"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-0142-7893","authenticated-orcid":false,"given":"Xing","family":"Zhao","sequence":"additional","affiliation":[{"name":"Atlassian, Sydney, Australia"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-0920-0143","authenticated-orcid":false,"given":"Anton","family":"Krasikov","sequence":"additional","affiliation":[{"name":"Atlassian, Sydney, Australia"}]}],"member":"320","published-online":{"date-parts":[[2024,7,10]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"crossref","first-page":"2740","DOI":"10.1109\/TSE.2020.2967380","article-title":"A machine learning approach to improve the detection of ci skip commits","volume":"47","author":"Abdalkareem Rabe","year":"2020","unstructured":"Rabe Abdalkareem, Suhaib Mujahid, and Emad Shihab. 2020. A machine learning approach to improve the detection of ci skip commits. IEEE Transactions on Software Engineering (TSE), 47, 12 (2020), 2740\u20132754.","journal-title":"IEEE Transactions on Software Engineering (TSE)"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2019.2897300"},{"key":"e_1_3_2_1_3_1","volume-title":"Proceedings of the Fourteenth EuroSys Conference","author":"Ananthanarayanan Sundaram","year":"2019","unstructured":"Sundaram Ananthanarayanan, Masoud Saeida Ardekani, Denis Haenikel, Balaji Varadarajan, Simon Soriano, Dhaval Patel, and Ali-Reza Adl-Tabatabai. 2019. Keeping master green at scale. In Proceedings of the Fourteenth EuroSys Conference 2019. ACM, 1\u201315."},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/2961111.2962628"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2021.110939"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/MSR.2017.62"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/MSR.2017.24"},{"key":"e_1_3_2_1_8_1","volume-title":"2020 IEEE 27th International Conference on Software Analysis, Evolution and Reengineering (SANER). IEEE, 423\u2013434","author":"Cassee Nathan","year":"2020","unstructured":"Nathan Cassee, Bogdan Vasilescu, and Alexander Serebrenik. 2020. The silent helper: the impact of continuous integration on code reviews. In 2020 IEEE 27th International Conference on Software Analysis, Evolution and Reengineering (SANER). IEEE, 423\u2013434."},{"key":"e_1_3_2_1_9_1","volume-title":"Proceedings of the 35th IEEE\/ACM International Conference on Automated Software Engineering (ICSE). ACM, 42\u201353","author":"Chen Bihuan","year":"2020","unstructured":"Bihuan Chen, Linlin Chen, Chen Zhang, and Xin Peng. 2020. BUILDFAST: History-aware build outcome prediction for fast feedback and reduced cost in continuous integration. In Proceedings of the 35th IEEE\/ACM International Conference on Automated Software Engineering (ICSE). ACM, 42\u201353."},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1986.10478291"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2013.09.001"},{"key":"e_1_3_2_1_12_1","unstructured":"Michael Fu Jirat Pasuksmit and Chakkrit Tantithamthavorn. 2024. AI for DevSecOps: A Landscape and Future Opportunities. arXiv preprint arXiv:2404.04839."},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3238147.3238171"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/ESEM.2017.23"},{"key":"e_1_3_2_1_15_1","volume-title":"Proceedings of the 11th Joint Meeting on Foundations of Software Engineering (FSE). ACM, 197\u2013207","author":"Hilton Michael","year":"2017","unstructured":"Michael Hilton, Nicholas Nelson, Timothy Tunnell, Darko Marinov, and Danny Dig. 2017. Trade-offs in continuous integration: assurance, security, and flexibility. In Proceedings of the 11th Joint Meeting on Foundations of Software Engineering (FSE). ACM, 197\u2013207."},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2970276.2970358"},{"key":"e_1_3_2_1_17_1","volume-title":"Analysis of covariance. Applied Statistics for the Behavioral Sciences","author":"Hinkle DE","unstructured":"DE Hinkle, W Wiersma, and SG Jurs. 1998. Analysis of covariance. Applied Statistics for the Behavioral Sciences. 4th ed. Boston, MA: Houghton Mifflin Company, 516\u2013547.","edition":"4"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2020.2982385"},{"key":"e_1_3_2_1_19_1","volume-title":"2021 IEEE\/ACM 18th International Conference on Mining Software Repositories (MSR). 432\u2013443","author":"Jiarpakdee Jirayus","year":"2021","unstructured":"Jirayus Jiarpakdee, Chakkrit Tantithamthavorn, and John Grundy. 2021. Practitioners\u2019 perceptions of the goals and visual explanations of defect prediction models. In 2021 IEEE\/ACM 18th International Conference on Mining Software Repositories (MSR). 432\u2013443."},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3377811.3380437"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2022.111292"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3576038"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10489-023-04523-6"},{"key":"e_1_3_2_1_24_1","volume-title":"2014 IEEE International Conference on Software Maintenance and Evolution (ICSME). 41\u201350","author":"Kerzazi Noureddine","year":"2014","unstructured":"Noureddine Kerzazi, Foutse Khomh, and Bram Adams. 2014. Why do automated builds break? an empirical study. In 2014 IEEE International Conference on Software Maintenance and Evolution (ICSME). 41\u201350."},{"key":"e_1_3_2_1_25_1","volume-title":"Proceedings of the 38th international conference on software engineering (ICSE). IEEE, 1028\u20131038","author":"Kononenko Oleksii","year":"2016","unstructured":"Oleksii Kononenko, Olga Baysal, and Michael W Godfrey. 2016. Code review quality: How developers see it. In Proceedings of the 38th international conference on software engineering (ICSE). IEEE, 1028\u20131038."},{"key":"e_1_3_2_1_26_1","volume-title":"Proceedings of the 40th international conference on software engineering: software engineering in practice (ICSE-SEIP). IEEE, 124\u2013133","author":"Kononenko Oleksii","year":"2018","unstructured":"Oleksii Kononenko, Tresa Rose, Olga Baysal, Michael Godfrey, Dennis Theisen, and Bart De Water. 2018. Studying pull request merges: A case study of shopify\u2019s active merchant. In Proceedings of the 40th international conference on software engineering: software engineering in practice (ICSE-SEIP). IEEE, 124\u2013133."},{"key":"e_1_3_2_1_27_1","volume-title":"Repeated Builds During Code Review: An Empirical Study of the OpenStack Community. In IEEE\/ACM International Conference on Automated Software Engineering (ASE). 153\u2013165","author":"Maipradit Rungroj","year":"2023","unstructured":"Rungroj Maipradit, Dong Wang, Patanamon Thongtanunam, Raula Gaikovina Kula, Yasutaka Kamei, and Shane McIntosh. 2023. Repeated Builds During Code Review: An Empirical Study of the OpenStack Community. In IEEE\/ACM International Conference on Automated Software Engineering (ASE). 153\u2013165."},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-015-9381-9"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/MSR.2017.26"},{"key":"e_1_3_2_1_30_1","volume-title":"2017 IEEE\/ACM 14th International Conference on Mining Software Repositories (MSR). IEEE, 451\u2013454","author":"Orellana Gerardo","year":"2017","unstructured":"Gerardo Orellana, Gulsher Laghari, Alessandro Murgia, and Serge Demeyer. 2017. On the differences between unit and integration testing in the travistorrent dataset. In 2017 IEEE\/ACM 14th International Conference on Mining Software Repositories (MSR). IEEE, 451\u2013454."},{"key":"e_1_3_2_1_31_1","volume-title":"2021 36th IEEE\/ACM International Conference on Automated Software Engineering (ASE). IEEE, 407\u2013418","author":"Pornprasit Chanathip","year":"2021","unstructured":"Chanathip Pornprasit, Chakkrit Tantithamthavorn, Jirayus Jiarpakdee, Michael Fu, and Patanamon Thongtanunam. 2021. Pyexplainer: Explaining the predictions of just-in-time defect models. In 2021 36th IEEE\/ACM International Conference on Automated Software Engineering (ASE). IEEE, 407\u2013418."},{"key":"e_1_3_2_1_32_1","volume-title":"2017 IEEE\/ACM 14th International Conference on Mining Software Repositories (MSR). 499\u2013502","author":"Rahman Mohammad Masudur","year":"2017","unstructured":"Mohammad Masudur Rahman and Chanchal K Roy. 2017. Impact of continuous integration on code reviews. In 2017 IEEE\/ACM 14th International Conference on Mining Software Repositories (MSR). 499\u2013502."},{"key":"e_1_3_2_1_33_1","volume-title":"2017 IEEE\/ACM 14th International Conference on Mining Software Repositories (MSR). 345\u2013355","author":"Rausch Thomas","year":"2017","unstructured":"Thomas Rausch, Waldemar Hummer, Philipp Leitner, and Stefan Schulte. 2017. An empirical analysis of build failures in the continuous integration workflows of java-based open-source software. In 2017 IEEE\/ACM 14th International Conference on Mining Software Repositories (MSR). 345\u2013355."},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-018-9646-1"},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2020.106392"},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10515-021-00319-5"},{"key":"e_1_3_2_1_37_1","volume-title":"Proceedings of the 16th ACM\/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM). ACM, 137\u2013147","author":"Santos Jadson","year":"2022","unstructured":"Jadson Santos, Daniel Alencar da Costa, and Uir\u00e1 Kulesza. 2022. Investigating the impact of continuous integration practices on the productivity and quality of open-source projects. In Proceedings of the 16th ACM\/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM). ACM, 137\u2013147."},{"key":"e_1_3_2_1_38_1","first-page":"51","article-title":"Continuous integration: improving software quality and reducing risk","volume":"10","author":"Schneider Ray","year":"2008","unstructured":"Ray Schneider. 2008. Continuous integration: improving software quality and reducing risk. Software Quality Professional, 10, 4 (2008), 51.","journal-title":"Software Quality Professional"},{"key":"e_1_3_2_1_39_1","volume-title":"Proceedings of the 32nd ACM\/IEEE International Conference on Software Engineering (ICSE). 2, ACM, 511\u2013512","author":"Schr\u00f6ter Adrian","year":"2010","unstructured":"Adrian Schr\u00f6ter. 2010. Predicting build outcome with developer interaction in jazz. In Proceedings of the 32nd ACM\/IEEE International Conference on Software Engineering (ICSE). 2, ACM, 511\u2013512."},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/2568225.2568255"},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/MS.2023.3246686"},{"key":"e_1_3_2_1_42_1","volume-title":"Proceedings of the 40th International conference on software engineering: Software engineering in practice (ICSE-SEIP). IEEE, 286\u2013295","author":"Tantithamthavorn Chakkrit","year":"2018","unstructured":"Chakkrit Tantithamthavorn and Ahmed E Hassan. 2018. An experience report on defect modelling in practice: Pitfalls and challenges. In Proceedings of the 40th International conference on software engineering: Software engineering in practice (ICSE-SEIP). IEEE, 286\u2013295."},{"key":"e_1_3_2_1_43_1","volume-title":"2021 36th IEEE\/ACM International Conference on Automated Software Engineering (ASE). 1\u20132.","author":"Tantithamthavorn Chakkrit","year":"2021","unstructured":"Chakkrit Tantithamthavorn and Jirayus Jiarpakdee. 2021. Explainable ai for software engineering. In 2021 36th IEEE\/ACM International Conference on Automated Software Engineering (ASE). 1\u20132."},{"key":"e_1_3_2_1_44_1","doi-asserted-by":"crossref","unstructured":"Chakkrit Tantithamthavorn Jirayus Jiarpakdee and John Grundy. 2020. Explainable AI for Software Engineering. arXiv preprint arXiv:2012.01614.","DOI":"10.1109\/ASE51524.2021.9678580"},{"key":"e_1_3_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/MS.2021.3072088"},{"key":"e_1_3_2_1_46_1","volume-title":"2015 IEEE\/ACM 37th IEEE International Conference on Software Engineering. 1, IEEE, 812\u2013823","author":"Tantithamthavorn Chakkrit","year":"2015","unstructured":"Chakkrit Tantithamthavorn, Shane McIntosh, Ahmed E Hassan, Akinori Ihara, and Kenichi Matsumoto. 2015. The impact of mislabelling on the performance and interpretation of defect prediction models. In 2015 IEEE\/ACM 37th IEEE International Conference on Software Engineering. 1, IEEE, 812\u2013823."},{"key":"e_1_3_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-016-9452-6"},{"key":"e_1_3_2_1_48_1","volume-title":"Proceedings of the 10th joint meeting on foundations of software engineering (FSE). 805\u2013816","author":"Vasilescu Bogdan","year":"2015","unstructured":"Bogdan Vasilescu, Yue Yu, Huaimin Wang, Premkumar Devanbu, and Vladimir Filkov. 2015. Quality and productivity outcomes relating to continuous integration in GitHub. In Proceedings of the 10th joint meeting on foundations of software engineering (FSE). 805\u2013816."},{"key":"e_1_3_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSME.2017.67"},{"key":"e_1_3_2_1_50_1","volume-title":"2009 IEEE 31st international conference on software engineering (ICSE). IEEE, 1\u201311","author":"Wolf Timo","year":"2009","unstructured":"Timo Wolf, Adrian Schroter, Daniela Damian, and Thanh Nguyen. 2009. Predicting build failures using social network analysis on developer communication. In 2009 IEEE 31st international conference on software engineering (ICSE). IEEE, 1\u201311."},{"key":"e_1_3_2_1_51_1","volume-title":"The VARCLUS Procedure. AppliThe VARCLUS Procedure","author":"Sarle WS.","unstructured":"Sarle WS. 1990. The VARCLUS Procedure. AppliThe VARCLUS Procedure, 4th edn. SAS Institute, Inc..","edition":"4"},{"key":"e_1_3_2_1_52_1","volume-title":"2017 IEEE International Conference on Software Quality, Reliability and Security Companion (QRS-C). 311\u2013315","author":"Xia Jing","year":"2017","unstructured":"Jing Xia and Yanhui Li. 2017. Could we predict the result of a continuous integration build? An empirical study. In 2017 IEEE International Conference on Software Quality, Reliability and Security Companion (QRS-C). 311\u2013315."},{"key":"e_1_3_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1109\/SANER.2019.8667996"},{"key":"e_1_3_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.2017.8115619"}],"event":{"name":"FSE '24: 32nd ACM International Conference on the Foundations of Software Engineering","sponsor":["SIGSOFT ACM Special Interest Group on Software Engineering"],"location":"Porto de Galinhas Brazil","acronym":"FSE '24"},"container-title":["Companion Proceedings of the 32nd ACM International Conference on the Foundations of Software Engineering"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3663529.3663856","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3663529.3663856","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T23:44:22Z","timestamp":1750290262000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3663529.3663856"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7,10]]},"references-count":54,"alternative-id":["10.1145\/3663529.3663856","10.1145\/3663529"],"URL":"https:\/\/doi.org\/10.1145\/3663529.3663856","relation":{},"subject":[],"published":{"date-parts":[[2024,7,10]]},"assertion":[{"value":"2024-07-10","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}