{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,13]],"date-time":"2026-06-13T14:10:09Z","timestamp":1781359809996,"version":"3.54.1"},"reference-count":67,"publisher":"Association for Computing Machinery (ACM)","issue":"OOPSLA2","license":[{"start":{"date-parts":[[2024,10,8]],"date-time":"2024-10-08T00:00:00Z","timestamp":1728345600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Program. Lang."],"published-print":{"date-parts":[[2024,10,8]]},"abstract":"<jats:p>\n                    Modern applications have become increasingly complex and their manual installation and configuration is no longer practical. Instead, IT organizations heavily rely on\n                    <jats:italic toggle=\"yes\">Infrastructure as Code (IaC)<\/jats:italic>\n                    technologies, to automate the provisioning, configuration, and maintenance of computing infrastructures and systems. IaC systems typically offer declarative, domain-specific languages (DSLs) that allow system administrators and developers to write high-level programs that specify the desired state of their infrastructure in a reliable, predictable, and documented fashion. Just like traditional programs, IaC software is not immune to faults, with issues ranging from deployment failures to critical misconfigurations that often impact production systems used by millions of end users. Surprisingly, despite its crucial role in global infrastructure management, the tooling and techniques for ensuring IaC reliability still have room for improvement.\n                  <\/jats:p>\n                  <jats:p>In this work, we conduct a comprehensive analysis of 360 bugs identified in IaC software within prominent IaC ecosystems including Ansible, Puppet, and Chef. Our work is the first in-depth exploration of bug characteristics in these widely-used IaC environments. Through our analysis we aim to understand: (1) how these bugs manifest, (2) their underlying root causes, (3) their reproduction requirements in terms of system state (e.g., operating system versions) or input characteristics, and (4) how these bugs are fixed. Based on our findings, we evaluate the state-of-the-art techniques for IaC reliability, identify their limitations, and provide a set of recommendations for future research. We believe that our study helps researchers to (1) better understand the complexity and peculiarities of IaC software, and (2) develop advanced tooling for more reliable and robust system configurations.<\/jats:p>","DOI":"10.1145\/3689799","type":"journal-article","created":{"date-parts":[[2024,10,8]],"date-time":"2024-10-08T03:23:04Z","timestamp":1728357784000},"page":"2490-2520","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":12,"title":["When Your Infrastructure Is a Buggy Program: Understanding Faults in Infrastructure as Code Ecosystems"],"prefix":"10.1145","volume":"8","author":[{"ORCID":"https:\/\/orcid.org\/0009-0007-2457-1421","authenticated-orcid":false,"given":"Georgios-Petros","family":"Drosos","sequence":"first","affiliation":[{"name":"ETH Zurich, Zurich, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9906-3073","authenticated-orcid":false,"given":"Thodoris","family":"Sotiropoulos","sequence":"additional","affiliation":[{"name":"ETH Zurich, Zurich, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-8947-2075","authenticated-orcid":false,"given":"Georgios","family":"Alexopoulos","sequence":"additional","affiliation":[{"name":"University of Athens, Athens, Greece"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5061-9018","authenticated-orcid":false,"given":"Dimitris","family":"Mitropoulos","sequence":"additional","affiliation":[{"name":"University of Athens, Athens, Greece"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2970-1391","authenticated-orcid":false,"given":"Zhendong","family":"Su","sequence":"additional","affiliation":[{"name":"ETH Zurich, Zurich, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2024,10,8]]},"reference":[{"key":"e_1_3_1_2_1","unstructured":"Amazon Web Services Inc. or its affiliates. 2017. Summary of the Amazon S3 Service Disruption in the Northern Virginia (US-EAST-1) Region. https:\/\/aws.amazon.com\/message\/41926\/ [Online; accessed 21-February-2024]."},{"key":"e_1_3_1_3_1","unstructured":"Ansible. 2024a. Ansible Galaxy. https:\/\/galaxy.ansible.com\/ui\/ [Online; accessed 21-February-2024]."},{"key":"e_1_3_1_4_1","unstructured":"Ansible. 2024b. Ansible Playbook Content Organisation. https:\/\/docs.ansible.com\/ansible\/2.8\/user_guide\/playbooks_best_practices.html#content-organization [Online; accessed 28-February-2024]."},{"key":"e_1_3_1_5_1","doi-asserted-by":"crossref","unstructured":"Matej Artac Tadej Borovssak Elisabetta Di Nitto Michele Guerriero and Damian Andrew Tamburri. 2017. DevOps: Introducing Infrastructure-as-Code. In 2017 IEEE\/ACM 39th International Conference on Software Engineering Companion (ICSE-C). 497\u2013498. https:\/\/doi.org\/10.1109\/ICSE-C.2017.162 10.1109\/ICSE-C.2017.162","DOI":"10.1109\/ICSE-C.2017.162"},{"key":"e_1_3_1_6_1","first-page":"32","article-title":"Actor concurrency bugs: a comprehensive study on symptoms, root causes, API usages, and differences","volume":"4","author":"Bagherzadeh Mehdi","year":"2020","unstructured":"Mehdi Bagherzadeh, Nicholas Fireman, Anas Shawesh, and Raffi Khatchadourian. 2020. Actor concurrency bugs: a comprehensive study on symptoms, root causes, API usages, and differences. Proc. ACM Program. Lang. 4, OOPSLA, Article 214 (nov 2020), 32 pages. https:\/\/doi.org\/10.1145\/3428282 10.1145\/3428282","journal-title":"Proc. ACM Program. Lang."},{"key":"e_1_3_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/2168836.2168865"},{"key":"e_1_3_1_8_1","first-page":"30","article-title":"Well-typed programs can go wrong: a study of typing-related bugs in JVM compilers","volume":"5","author":"Chaliasos Stefanos","year":"2021","unstructured":"Stefanos Chaliasos, Thodoris Sotiropoulos, Georgios-Petros Drosos, Charalambos Mitropoulos, Dimitris Mitropoulos, and Diomidis Spinellis. 2021. Well-typed programs can go wrong: a study of typing-related bugs in JVM compilers. Proc. ACM Program. Lang. 5, OOPSLA, Article 123 (oct 2021), 30 pages. https:\/\/doi.org\/10.1145\/3485500 10.1145\/3485500","journal-title":"Proc. ACM Program. Lang."},{"key":"e_1_3_1_9_1","unstructured":"Chef Software Inc. 2024a. Chef Cookbook Directory Structure. https:\/\/docs.chef.io\/cookbook_repo\/#cookbook-directory-structure [Online; accessed 28-February-2024]."},{"key":"e_1_3_1_10_1","unstructured":"Chef Software Inc. 2024b. The source of Chef cookbooks - Chef Supermarket. https:\/\/supermarket.chef.io\/ [Online; accessed 21-February-2024]."},{"key":"e_1_3_1_11_1","first-page":"1701","volume-title":"20th USENIX Symposium on Networked Systems Design and Implementation (NSDI 23)","author":"Chen Yinfang","year":"2023","unstructured":"Yinfang Chen, Xudong Sun, Suman Nath, Ze Yang, and Tianyin Xu. 2023. Push-Button Reliability Testing for Cloud-Backed Applications with Rainmaker. In 20th USENIX Symposium on Networked Systems Design and Implementation (NSDI 23). USENIX Association, Boston, MA, 1701\u20131716. https:\/\/www.usenix.org\/conference\/nsdi23\/presentation\/chen-yinfang"},{"key":"e_1_3_1_12_1","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1007\/978-3-540-39671-0_4","volume-title":"Self-Managing Distributed Systems","author":"Couch Alva","year":"2003","unstructured":"Alva Couch and Yizhan Sun. 2003. On the Algebraic Structure of Convergence. In Self-Managing Distributed Systems, Marcus Brunner and Alexander Keller (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 28\u201340."},{"key":"e_1_3_1_13_1","first-page":"358","volume-title":"Proceedings of the 11th ACM Symposium on Cloud Computing(SoCC \u201920)","author":"Dai Ting","year":"2020","unstructured":"Ting Dai, Alexei Karve, Grzegorz Koper, and Sai Zeng. 2020. Automatically detecting risky scripts in infrastructure code. In Proceedings of the 11th ACM Symposium on Cloud Computing (Virtual Event, USA) (SoCC \u201920). Association for Computing Machinery, New York, NY, USA, 358\u2013371. https:\/\/doi.org\/10.1145\/3419111.3421303 10.1145\/3419111.3421303"},{"key":"e_1_3_1_14_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2020.110726"},{"key":"e_1_3_1_15_1","first-page":"1","volume-title":"Proceedings of the 24th International Conference on Large Installation System Administration(LISA\u201910)","author":"Delaet Thomas","year":"2010","unstructured":"Thomas Delaet, Wouter Joosen, and Bart Vanbrabant. 2010. A survey of system configuration tools. In Proceedings of the 24th International Conference on Large Installation System Administration (San Jose, CA) (LISA\u201910). USENIX Association, USA, 1\u20138."},{"key":"e_1_3_1_16_1","first-page":"509","volume-title":"Proceedings of the 32nd IEEE\/ACM International Conference on Automated Software Engineering","author":"Franco Anthony Di","year":"2017","unstructured":"Anthony Di Franco, Hui Guo, and Cindy Rubio-Gonz\u00e1lez. 2017. A Comprehensive Study of Real-World Numerical Bug Characteristics. In Proceedings of the 32nd IEEE\/ACM International Conference on Automated Software Engineering (Urbana-Champaign, IL, USA) (ASE 2017). IEEE Press, 509\u2013519. https:\/\/doi.org\/10.1109\/ASE.2017.8115662 10.1109\/ASE.2017.8115662"},{"key":"e_1_3_1_17_1","unstructured":"Georgios-Petros Drosos Thodoris Sotiropoulos Georgios Alexopoulos Dimitris Mitropoulos and Zhendong Su. 2024. Artifact for OOPSLA 2024 paper: \u201cWhen Your Infrastructure is a Buggy Program: Understanding Faults in Infrastructure as Code Ecosystems\u201d. https:\/\/doi.org\/10.5281\/zenodo.12668895 10.5281\/zenodo.12668895"},{"key":"e_1_3_1_18_1","first-page":"956","volume-title":"Proceedings of the 35th IEEE\/ACM International Conference on Automated Software Engineering(ASE \u201920)","author":"Eghbali Aryaz","year":"2021","unstructured":"Aryaz Eghbali and Michael Pradel. 2021. No strings attached: an empirical study of string-related software bugs. In Proceedings of the 35th IEEE\/ACM International Conference on Automated Software Engineering (Virtual Event, Australia) (ASE \u201920). Association for Computing Machinery, New York, NY, USA, 956\u2013967. https:\/\/doi.org\/10.1145\/3324884.3416576 10.1145\/3324884.3416576"},{"key":"e_1_3_1_19_1","doi-asserted-by":"publisher","DOI":"10.5555\/3155562.3155604"},{"key":"e_1_3_1_20_1","unstructured":"GitHub Inc. 2014. DNS Outage Post Mortem. https:\/\/github.blog\/2014-01-18-dns-outage-post-mortem\/ [Online; accessed 21-February-2024]."},{"key":"e_1_3_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3592533.3592806"},{"key":"e_1_3_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3600006.3613161"},{"key":"e_1_3_1_23_1","doi-asserted-by":"crossref","unstructured":"MIchele Guerriero Martin Garriga Damian A. Tamburri and Fabio Palomba. 2019. Adoption Support and Challenges of Infrastructure-as-Code: Insights from Industry. In 2019 IEEE International Conference on Software Maintenance and Evolution (ICSME). 580\u2013589. https:\/\/doi.org\/10.1109\/ICSME.2019.00092 10.1109\/ICSME.2019.00092","DOI":"10.1109\/ICSME.2019.00092"},{"key":"e_1_3_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2983990.2984000"},{"key":"e_1_3_1_25_1","unstructured":"HashiCorp. 2024. Automate infrastructure on any cloud with Terraform. https:\/\/www.terraform.io\/ [Online; accessed 21-February-2024]."},{"key":"e_1_3_1_26_1","first-page":"24","article-title":"State Reconciliation Defects in Infrastructure as Code","volume":"1","author":"Hassan Md Mahadi","year":"2024","unstructured":"Md Mahadi Hassan, John Salvador, Shubhra Kanti Karmaker Santu, and Akond Rahman. 2024. State Reconciliation Defects in Infrastructure as Code. Proc. ACM Softw. Eng. 1, FSE, Article 83 (jul 2024), 24 pages. https:\/\/doi.org\/10.1145\/3660790 10.1145\/3660790","journal-title":"Proc. ACM Softw. Eng."},{"key":"e_1_3_1_27_1","unstructured":"Knative. 2019. Knative Documentation. https:\/\/knative.dev Accessed: 2024-08-03."},{"key":"e_1_3_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2872362.2872374"},{"key":"e_1_3_1_29_1","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1007\/978-3-030-72013-1_6","volume-title":"Tools and Algorithms for the Construction and Analysis of Systems","author":"Lepiller Julien","year":"2021","unstructured":"Julien Lepiller, Ruzica Piskac, Martin Sch\u00e4f, and Mark Santolucito. 2021. Analyzing Infrastructure as Code to Prevent Intra-update Sniping Vulnerabilities. In Tools and Algorithms for the Construction and Analysis of Systems, Jan Friso Groote and Kim Guldstrand Larsen (Eds.). Springer International Publishing, Cham, 105\u2013123."},{"key":"e_1_3_1_30_1","unstructured":"M. Zalewski. 2013. American fuzzy lop. https:\/\/lcamtuf.coredump.cx\/afl\/. Online accessed; 05-08-2021."},{"key":"e_1_3_1_31_1","doi-asserted-by":"publisher","DOI":"10.5555\/1855840.1855863"},{"key":"e_1_3_1_32_1","first-page":"31","article-title":"Casting about in the Dark: An Empirical Study of Cast Operations in Java Programs","volume":"3","author":"Mastrangelo Luis","year":"2019","unstructured":"Luis Mastrangelo, Matthias Hauswirth, and Nathaniel Nystrom. 2019. Casting about in the Dark: An Empirical Study of Cast Operations in Java Programs. Proc. ACM Program. Lang. 3, OOPSLA, Article 158 (Oct. 2019), 31 pages. https:\/\/doi.org\/10.1145\/3360584 10.1145\/3360584","journal-title":"Proc. ACM Program. Lang."},{"key":"e_1_3_1_33_1","unstructured":"Kief Morris. 2016. Infrastructure as code: managing servers in the cloud. \" O\u2019Reilly Media Inc.\"."},{"key":"e_1_3_1_34_1","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1145\/3524842.3527964","volume-title":"Proceedings of the 19th International Conference on Mining Software Repositories","author":"Opdebeeck Ruben","year":"2022","unstructured":"Ruben Opdebeeck, Ahmed Zerouali, and Coen De Roover. 2022. Smelly variables in Ansible infrastructure code: detection, prevalence, and lifetime. In Proceedings of the 19th International Conference on Mining Software Repositories (Pittsburgh, Pennsylvania) (MSR \u201922). Association for Computing Machinery, New York, NY, USA, 61\u201372. https:\/\/doi.org\/10.1145\/3524842.3527964 10.1145\/3524842.3527964"},{"key":"e_1_3_1_35_1","doi-asserted-by":"crossref","unstructured":"Ruben Opdebeeck Ahmed Zerouali and Coen De Roover. 2023a. Control and Data Flow in Security Smell Detection for Infrastructure as Code: Is It Worth the Effort?. In 2023 IEEE\/ACM 20th International Conference on Mining Software Repositories (MSR). 534\u2013545. https:\/\/doi.org\/10.1109\/MSR59073.2023.00079 10.1109\/MSR59073.2023.00079","DOI":"10.1109\/MSR59073.2023.00079"},{"key":"e_1_3_1_36_1","doi-asserted-by":"crossref","unstructured":"Ruben Opdebeeck Ahmed Zerouali and Coen De Roover. 2023b. Control and Data Flow in Security Smell Detection for Infrastructure as Code: Is It Worth the Effort?. In 2023 IEEE\/ACM 20th International Conference on Mining Software Repositories (MSR). 534\u2013545. https:\/\/doi.org\/10.1109\/MSR59073.2023.00079 10.1109\/MSR59073.2023.00079","DOI":"10.1109\/MSR59073.2023.00079"},{"key":"e_1_3_1_37_1","unstructured":"Perforce. 2024. Puppet Infrastructure & I T Automation at Scale. https:\/\/www.puppet.com\/ [Online; accessed 21-February-2024]."},{"key":"e_1_3_1_38_1","unstructured":"Progress. 2024. Chef Software DevOps Automation Solutions. https:\/\/www.chef.io\/ [Online; accessed 21-February-2024]."},{"key":"e_1_3_1_39_1","unstructured":"Pulumi. 2024. Pulumi - Infrastructure as Code in any programming language. https:\/\/www.pulumi.com\/ [Online; accessed 21-February-2024]."},{"key":"e_1_3_1_40_1","unstructured":"Puppet. 2024a. Puppet Forge. https:\/\/forge.puppet.com\/ [Online; accessed 21-February-2024]."},{"key":"e_1_3_1_41_1","unstructured":"Puppet. 2024b. Understanding the Puppet Directory. https:\/\/www.puppet.com\/blog\/puppet-directory [Online; accessed 28-February-2024]."},{"key":"e_1_3_1_42_1","doi-asserted-by":"crossref","first-page":"752","DOI":"10.1145\/3377811.3380409","volume-title":"Proceedings of the ACM\/IEEE 42nd International Conference on Software Engineering(ICSE \u201920).","author":"Rahman Akond","year":"2020","unstructured":"Akond Rahman, Effat Farhana, Chris Parnin, and Laurie Williams. 2020. Gang of eight: a defect taxonomy for Infrastructure as Code scripts. In Proceedings of the ACM\/IEEE 42nd International Conference on Software Engineering (Seoul, South Korea) (ICSE \u201920). Association for Computing Machinery, New York, NY, USA, 752\u2013764. https:\/\/doi.org\/10.1145\/3377811.3380409 10.1145\/3377811.3380409"},{"key":"e_1_3_1_43_1","first-page":"164","volume-title":"Proceedings of the 41st International Conference on Software Engineering(ICSE \u201919)","author":"Rahman Akond","year":"2019","unstructured":"Akond Rahman, Chris Parnin, and Laurie Williams. 2019. The seven sins: security smells in Infrastructure as Code scripts. In Proceedings of the 41st International Conference on Software Engineering (Montreal, Quebec, Canada) (ICSE \u201919). IEEE Press, 164\u2013175. https:\/\/doi.org\/10.1109\/ICSE.2019.00033 10.1109\/ICSE.2019.00033"},{"issue":"1","key":"e_1_3_1_44_1","first-page":"31","article-title":"Security Smells in Ansible and Chef Scripts: A Replication Study","volume":"30","author":"Rahman Akond","year":"2021","unstructured":"Akond Rahman, Md Rayhanur Rahman, Chris Parnin, and Laurie Williams. 2021. Security Smells in Ansible and Chef Scripts: A Replication Study. ACM Trans. Softw. Eng. Methodol. 30, 1, Article 3 (jan 2021), 31 pages. https:\/\/doi.org\/10.1145\/3408897 10.1145\/3408897","journal-title":"ACM Trans. Softw. Eng. Methodol."},{"issue":"4","key":"e_1_3_1_45_1","first-page":"36","article-title":"Security Misconfigurations in Open Source Kubernetes Manifests: An Empirical Study","volume":"32","author":"Rahman Akond","year":"2023","unstructured":"Akond Rahman, Shazibul Islam Shamim, Dibyendu Brinto Bose, and Rahul Pandita. 2023. Security Misconfigurations in Open Source Kubernetes Manifests: An Empirical Study. ACM Trans. Softw. Eng. Methodol. 32, 4, Article 99 (may 2023), 36 pages. https:\/\/doi.org\/10.1145\/3579639 10.1145\/3579639","journal-title":"ACM Trans. Softw. Eng. Methodol."},{"key":"e_1_3_1_46_1","unstructured":"Red Hat Inc. 2024a. Ansible Molecule. https:\/\/ansible.readthedocs.io\/projects\/molecule\/ [Online; accessed 01-August-2024]."},{"key":"e_1_3_1_47_1","unstructured":"Red Hat Inc. 2024b. Testing Ansible. https:\/\/docs.ansible.com\/ansible\/latest\/dev_guide\/testing.html [Online; accessed 01-August-2024]."},{"key":"e_1_3_1_48_1","unstructured":"RedHat Inc. 2024. Ansible is simple IT automation. https:\/\/www.ansible.com\/ [Online; accessed 21-February-2024]."},{"key":"e_1_3_1_49_1","unstructured":"RSpec team. 2024. RSpec: Behaviour Driven Development for Ruby. https:\/\/rspec.info\/ [Online; accessed 01-August-2024]."},{"key":"e_1_3_1_50_1","first-page":"12","volume-title":"Proceedings of the 37th IEEE\/ACM International Conference on Automated Software Engineering(ASE \u201922)","author":"Saavedra Nuno","year":"2023","unstructured":"Nuno Saavedra and Jo\u00e0o F. Ferreira. 2023. GLITCH: Automated Polyglot Security Smell Detection in Infrastructure as Code. In Proceedings of the 37th IEEE\/ACM International Conference on Automated Software Engineering (, Rochester, MI, USA,) (ASE \u201922). Association for Computing Machinery, New York, NY, USA, Article 47, 12 pages. https:\/\/doi.org\/10.1145\/3551349.3556945 10.1145\/3551349.3556945"},{"key":"e_1_3_1_51_1","doi-asserted-by":"crossref","unstructured":"Nuno Saavedra Jo\u00e3o Gon\u00e7alves Miguel Henriques Jo\u00e3o F. Ferreira and Alexandra Mendes. 2023. Polyglot Code Smell Detection for Infrastructure as Code with GLITCH. In 2023 38th IEEE\/ACM International Conference on Automated Software Engineering (ASE). 2042\u20132045. https:\/\/doi.org\/10.1109\/ASE56229.2023.00162 10.1109\/ASE56229.2023.00162","DOI":"10.1109\/ASE56229.2023.00162"},{"key":"e_1_3_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/2908080.2908083"},{"key":"e_1_3_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/2901739.2901761"},{"key":"e_1_3_1_54_1","doi-asserted-by":"crossref","unstructured":"Daniel Sokolowski and Guido Salvaneschi. 2023. Towards Reliable Infrastructure as Code. In 2023 IEEE 20th International Conference on Software Architecture Companion (ICSA-C). 318\u2013321. https:\/\/doi.org\/10.1109\/ICSA-C57050.2023.00072 10.1109\/ICSA-C57050.2023.00072","DOI":"10.1109\/ICSA-C57050.2023.00072"},{"key":"e_1_3_1_55_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2024.3393070"},{"key":"e_1_3_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/3377811.3380384"},{"key":"e_1_3_1_57_1","doi-asserted-by":"publisher","DOI":"10.1109\/MS.2012.85"},{"key":"e_1_3_1_58_1","unstructured":"Stack Exchange Inc. 2023. 2023 Developer Survey. https:\/\/survey.stackoverflow.co\/2023\/#other-tools [Online; accessed 01-April-2024]."},{"key":"e_1_3_1_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/3460319.3464806"},{"key":"e_1_3_1_60_1","first-page":"143","volume-title":"16th USENIX Symposium on Operating Systems Design and Implementation (OSDI 22)","author":"Sun Xudong","year":"2022","unstructured":"Xudong Sun, Wenqing Luo, Jiawei Tyler Gu, Aishwarya Ganesan, Ramnatthan Alagappan, Michael Gasch, Lalith Suresh, and Tianyin Xu. 2022. Automatic Reliability Testing For Cluster Management Controllers. In 16th USENIX Symposium on Operating Systems Design and Implementation (OSDI 22). USENIX Association, Carlsbad, CA, 143\u2013159. https:\/\/www.usenix.org\/conference\/osdi22\/presentation\/sun"},{"key":"e_1_3_1_61_1","first-page":"649","volume-title":"18th USENIX Symposium on Operating Systems Design and Implementation (OSDI 24)","author":"Sun Xudong","year":"2024","unstructured":"Xudong Sun, Wenjie Ma, Jiawei Tyler Gu, Zicheng Ma, Tej Chajed, Jon Howell, Andrea Lattuada, Oded Padon, Lalith Suresh, Adriana Szekeres, and Tianyin Xu. 2024. Anvil: Verifying Liveness of Cluster Management Controllers. In 18th USENIX Symposium on Operating Systems Design and Implementation (OSDI 24). USENIX Association, Santa Clara, CA, 649\u2013666. https:\/\/www.usenix.org\/conference\/osdi24\/presentation\/sun-xudong"},{"key":"e_1_3_1_62_1","unstructured":"The Kubernetes authors. 2024. Kubernetes: Production-Grade Container Orchestration. Kubernetes Homepage. Retrieved from http:\/\/kubernetes.io\/."},{"key":"e_1_3_1_63_1","first-page":"164","volume-title":"25th IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER 2018)","author":"Bent Eduard Van der","year":"2018","unstructured":"Eduard Van der Bent, J. Hage, Joost Visser, and Georgios Gousios. 2018. How good is your Puppet? An empirically defined and validated quality model for Puppet. In 25th IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER 2018). IEEE, United States, 164\u2013174. https:\/\/doi.org\/10.1109\/SANER.2018.8330206 10.1109\/SANER.2018.8330206 25th IEEE International Conference on Software Analysis, Evolution and Reengineering 2018, SAMER 2018 ; Conference date: 20-03-2018 Through 23-03-2018."},{"key":"e_1_3_1_64_1","unstructured":"Joost Visser Sylvan Rigal Gijs Wijnholds and Zeeger Lubsen. 2016. Building software teams: Ten best practices for effective software development. \" O\u2019Reilly Media Inc.\"."},{"key":"e_1_3_1_65_1","first-page":"625","volume-title":"Proceedings of the 32nd IEEE\/ACM International Conference on Automated Software Engineering (Urbana-Champaign, IL, USA) (ASE \u201917)","author":"Weiss Aaron","year":"2017","unstructured":"Aaron Weiss, Arjun Guha, and Yuriy Brun. 2017. Tortoise: interactive system configuration repair. In Proceedings of the 32nd IEEE\/ACM International Conference on Automated Software Engineering (Urbana-Champaign, IL, USA) (ASE \u201917). IEEE Press, 625\u2013636."},{"key":"e_1_3_1_66_1","doi-asserted-by":"publisher","DOI":"10.1093\/comjnl\/25.4.465"},{"key":"e_1_3_1_67_1","unstructured":"Wikimedia Commons. 2017. Incident documentation\/20170118-Labs. https:\/\/wikitech.wikimedia.org\/wiki\/Incidents\/2017-01-18_Labs [Online; accessed 21-February-2024]."},{"key":"e_1_3_1_68_1","first-page":"1319","volume-title":"Proceedings of the 32nd ACM SIGSOFT International Symposium on Software Testing and Analysis (, Seattle, WA, USA,) (ISSTA 2023)","author":"Xiong Yiheng","year":"2023","unstructured":"Yiheng Xiong, Mengqian Xu, Ting Su, Jingling Sun, Jue Wang, He Wen, Geguang Pu, Jifeng He, and Zhendong Su. 2023. An Empirical Study of Functional Bugs in Android Apps. In Proceedings of the 32nd ACM SIGSOFT International Symposium on Software Testing and Analysis (, Seattle, WA, USA,) (ISSTA 2023). Association for Computing Machinery, New York, NY, USA, 1319\u20131331. https:\/\/doi.org\/10.1145\/3597926.3598138 10.1145\/3597926.3598138"}],"container-title":["Proceedings of the ACM on Programming Languages"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3689799","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3689799","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,2,4]],"date-time":"2026-02-04T09:12:56Z","timestamp":1770196376000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3689799"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,10,8]]},"references-count":67,"journal-issue":{"issue":"OOPSLA2","published-print":{"date-parts":[[2024,10,8]]}},"alternative-id":["10.1145\/3689799"],"URL":"https:\/\/doi.org\/10.1145\/3689799","relation":{},"ISSN":["2475-1421"],"issn-type":[{"value":"2475-1421","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,10,8]]},"assertion":[{"value":"2024-04-05","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-08-18","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-10-08","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}