{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,29]],"date-time":"2026-08-29T15:59:07Z","timestamp":1788019147124,"version":"build-2784847793"},"reference-count":61,"publisher":"Association for Computing Machinery (ACM)","issue":"PLDI","license":[{"start":{"date-parts":[[2024,6,20]],"date-time":"2024-06-20T00:00:00Z","timestamp":1718841600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Program. Lang."],"published-print":{"date-parts":[[2024,6,20]]},"abstract":"<jats:p>\n                    Configuration errors remain a major cause of system failures and service outages. One promising approach to identify configuration errors automatically is to learn common usage patterns (and anti-patterns) using data-driven methods. However, existing data-driven learning approaches analyze only simple configurations (\n                    <jats:italic toggle=\"yes\">e.g.<\/jats:italic>\n                    , those with no hierarchical structure), identify only simple types of issues (\n                    <jats:italic toggle=\"yes\">e.g.<\/jats:italic>\n                    , type errors), or require extensive domain-specific tuning. In this paper, we present D\n                    <jats:sc>iffy<\/jats:sc>\n                    , the first push-button configuration analyzer that detects likely bugs in structured configurations. From example configurations, D\n                    <jats:sc>iffy<\/jats:sc>\n                    learns a common template, with \"holes\" that capture their variation. It then applies unsupervised learning to identify anomalous template parameters as likely bugs. We evaluate D\n                    <jats:sc>iffy<\/jats:sc>\n                    on a large cloud provider\u2019s wide-area network, an operational 5G network testbed, and MySQL configurations, demonstrating its versatility, performance, and accuracy. During D\n                    <jats:sc>iffy<\/jats:sc>\n                    \u2019s development, it caught and prevented a bug in a configuration timer value that had previously caused an outage for the cloud provider.\n                  <\/jats:p>","DOI":"10.1145\/3656385","type":"journal-article","created":{"date-parts":[[2024,6,20]],"date-time":"2024-06-20T12:27:20Z","timestamp":1718886440000},"page":"199-222","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":4,"title":["Diffy: Data-Driven Bug Finding for Configurations"],"prefix":"10.1145","volume":"8","author":[{"ORCID":"https:\/\/orcid.org\/0009-0006-2694-4685","authenticated-orcid":false,"given":"Siva Kesava Reddy","family":"Kakarla","sequence":"first","affiliation":[{"name":"Microsoft Research, Redmond, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2123-4258","authenticated-orcid":false,"given":"Francis Y.","family":"Yan","sequence":"additional","affiliation":[{"name":"Microsoft Research, Redmond, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7844-2026","authenticated-orcid":false,"given":"Ryan","family":"Beckett","sequence":"additional","affiliation":[{"name":"Microsoft Research, Redmond, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2024,6,20]]},"reference":[{"key":"e_1_3_2_2_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00778-015-0389-y"},{"key":"e_1_3_2_3_1","doi-asserted-by":"publisher","DOI":"10.23919\/FMCAD.2018.8602994"},{"key":"e_1_3_2_4_1","first-page":"617","volume-title":"In 19th USENIX Symposium on Networked Systems Design and Implementation (NSDI 22)","author":"Beckett Ryan","year":"2022","unstructured":"Ryan Beckett and Aarti Gupta. 2022. Katra: Realtime Verification for Multilayer Networks. In 19th USENIX Symposium on Networked Systems Design and Implementation (NSDI 22). USENIX Association, Renton, WA, 617-634. www.usenix.org\/conference\/nsdi22\/presentation\/beckett"},{"key":"e_1_3_2_5_1","doi-asserted-by":"publisher","unstructured":"Ryan Beckett Aarti Gupta Ratul Mahajan and David Walker. 2017. A General Approach to Network Configuration Verification. In Proceedings of the Conference of the ACM Special Interest Group on Data Communication (Los Angeles CA USA) (SIGCOMM '17). ACM New York NY USA 155\u2013168. https:\/\/doi.org\/10.1145\/3098822.3098834 10.1145\/3098822.3098834","DOI":"10.1145\/3098822.3098834"},{"key":"e_1_3_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3230543.3230583"},{"key":"e_1_3_2_7_1","doi-asserted-by":"publisher","unstructured":"Ryan Beckett Aarti Gupta Ratul Mahajan and David Walker. 2019. Abstract Interpretation of Distributed Network Control Planes. Proc. ACM Program. Lang. 4 POPL Article 42 (dec 2019) 27 pages. https:\/\/doi.org\/10.1145\/3371110 10.1145\/3371110","DOI":"10.1145\/3371110"},{"key":"e_1_3_2_8_1","doi-asserted-by":"publisher","unstructured":"Tim Bray. 2017. The JavaScript Object Notation (JSON) Data Interchange Format. RFC 8259. https:\/\/doi.org\/10.17487\/RFC8259 10.17487\/RFC8259","DOI":"10.17487\/RFC8259"},{"key":"e_1_3_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3368089.3409727"},{"key":"e_1_3_2_10_1","unstructured":"Cisco. 2023. Basic Router Configuration. https:\/\/www.cisco.com\/c\/en\/us\/td\/docs\/routers\/access\/800M\/software\/800MSCG\/routconf.html. [Online; accessed 30-March-2023]."},{"key":"e_1_3_2_11_1","unstructured":"Oracle Corporation. 2023. MySQL. https:\/\/www.mysql.com\/. Accessed: 2023\u201311-01."},{"key":"e_1_3_2_12_1","first-page":"859","volume-title":"In 2016 IEEE 16th International Conference on Data Mining (ICDM)","author":"Min Du","year":"2016","unstructured":"Min Du and Feifei Li. 2016. Spell: Streaming parsing of system event logs. In 2016 IEEE 16th International Conference on Data Mining (ICDM). IEEE, 859-864."},{"key":"e_1_3_2_13_1","doi-asserted-by":"publisher","unstructured":"Dawson Engler David Yu Chen Seth Hallem Andy Chou and Benjamin Chelf. 2001. Bugs as Deviant Behavior: A General Approach to Inferring Errors in Systems Code. In Proceedings of the Eighteenth ACM Symposium on Operating Systems Principles (Banff Alberta Canada) (SOSP '01). Association for Computing Machinery New York NY USA 57\u201372. https:\/\/doi.org\/10.1145\/502034.502041 10.1145\/502034.502041","DOI":"10.1145\/502034.502041"},{"key":"e_1_3_2_14_1","doi-asserted-by":"crossref","unstructured":"Dawson Engler David Yu Chen Seth Hallem Andy Chou and Benjamin Chelf. 2001. Bugs as deviant behavior: A general approach to inferring errors in systems code. ACM SIGOPS Operating Systems Review 35 5 (2001) 57\u201372.","DOI":"10.1145\/502059.502041"},{"key":"e_1_3_2_15_1","unstructured":"Evolven. 2022. Downtime Outages and Failures - Understanding Their True Costs. https:\/\/www.evolven.com\/blog\/d owntime-outages-and-failures-understanding-their-true-costs.html. Accessed: March 26 2023."},{"key":"e_1_3_2_16_1","first-page":"217","volume-title":"In 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI 16)","author":"Fayaz Seyed K.","year":"2016","unstructured":"Seyed K. Fayaz, Tushar Sharma, Ari Fogel, Ratul Mahajan, Todd Millstein, Vyas Sekar, and George Varghese. 2016 Efficient Network Reachability Analysis Using a Succinct Control Plane Representation. In 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI 16). USENIX Association, Savannah, GA, 217-232. https:\/\/www.usenix.org\/conference\/osdi16\/technical-sessions\/presentation\/fayaz"},{"key":"e_1_3_2_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/1328897.1328488"},{"key":"e_1_3_2_18_1","first-page":"469","volume-title":"In 12th USENIX Symposium on Networked Systems Design and Implementation (NSDI 15)","author":"Fogel Ari","year":"2015","unstructured":"Ari Fogel, Stanley Fung, Luis Pedrosa, Meg Walraed-Sullivan, Ramesh Govindan, Ratul Mahajan, and Todd Millstein. 2015. A General Approach to Network Configuration Analysis. In 12th USENIX Symposium on Networked Systems Design and Implementation (NSDI 15). USENIX Association, Oakland, CA, 469-483. https:\/\/www.usenix.org\/conference\/nsdi15\/technical-sessions\/presentation\/fogel"},{"key":"e_1_3_2_19_1","unstructured":"Cloud Native Computing Foundation. 2023. Kubernetes Documentation. https:\/\/kubernetes.io\/docs\/home\/. Accessed 2023\u201311-01."},{"key":"e_1_3_2_20_1","unstructured":"Qiang Fu Jian-Guang Lou Yi Wang and Jiang Li. 2009. Execution anomaly detection in distributed systems through unstructured log analysis. In 2009 ninth IEEE international conference on data mining. IEEE 149\u2013158."},{"key":"e_1_3_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2934872.2934876"},{"key":"e_1_3_2_22_1","doi-asserted-by":"crossref","unstructured":"Sumit Gulwani. 2011. Automating string processing in spreadsheets using input-output examples. ACM Sigplan Notices 46 1 (2011) 317\u2013330.","DOI":"10.1145\/1925844.1926423"},{"key":"e_1_3_2_23_1","doi-asserted-by":"crossref","unstructured":"Haryadi S Gunawi Mingzhe Hao Tanakorn Leesatapornwongsa Tiratat Patana-Anake Thanh Do Jeffry Adityatama Kurnia J Eliazar Agung Laksono Jeffrey F Lukman Vincentius Martin et al. 2014. What bugs live in the cloud? a study of 3000+ issues in cloud systems. In Proceedings of the ACM symposium on cloud computing. 1\u201314.","DOI":"10.1145\/2670979.2670986"},{"key":"e_1_3_2_24_1","article-title":"ADBench: Anomaly Detection Benchmark","author":"Han Songqiao","year":"2022","unstructured":"Songqiao Han, Xiyang Hu, Hailiang Huang, Mingqi Jiang, and Yue Zhao. 2022. ADBench: Anomaly Detection Benchmark. In Neural Information Processing Systems (NeurIPS).","journal-title":"In Neural Information Processing Systems (NeurIPS)."},{"key":"e_1_3_2_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICWS.2017.13"},{"key":"e_1_3_2_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISSRE.2016.21"},{"key":"e_1_3_2_27_1","first-page":"735","volume-title":"In 14th USENIX Symposium on Networked Systems Design and Implementation (NSDI 17)","author":"Horn Alex","year":"2017","unstructured":"Alex Horn, Ali Kheradmand, and Mukul Prasad. 2017. Delta-net: Real-time Network Verification Using Atoms. In 14th USENIX Symposium on Networked Systems Design and Implementation (NSDI 17). USENIX Association, Boston, MA, 735-749. https:\/\/www.usenix.org\/conference\/nsdi17\/technical-sessions\/presentation\/horn-alex"},{"key":"e_1_3_2_28_1","unstructured":"Istio 2023. Istio Configuration. Retrieved Sep 19 2023 from https:\/\/istio.io\/latest\/docs\/ops\/configuration\/"},{"key":"e_1_3_2_29_1","doi-asserted-by":"publisher","unstructured":"Karthick Jayaraman Nikolaj Bjorner Jitu Padhye Amar Agrawal Ashish Bhargava Paul-Andre C Bissonnette Shane Foster Andrew Helwer Mark Kasten Ivan Lee Anup Namdhari Haseeb Niaz Aniruddha Parkhi Hanukumar Pinnamraju Adrian Power Neha Milind Raje and Parag Sharma. 2019. Validating Datacenters at Scale. In Proceedings of the ACM Special Interest Group on Data Communication (Beijing China) (SIGCOMM '19). ACM New York NY USA 200\u2013213. https:\/\/doi.org\/10.1145\/3341302.3342094 10.1145\/3341302.3342094","DOI":"10.1145\/3341302.3342094"},{"key":"e_1_3_2_30_1","unstructured":"Juniper Networks. 2023. CLI User Guide for Junos OS. https:\/\/www.juniper.net\/documentation\/us\/en\/software\/junos \/cli\/index.html. ."},{"key":"e_1_3_2_31_1","doi-asserted-by":"publisher","unstructured":"Siva Kesava Reddy Kakarla Ryan Beckett Behnaz Arzani Todd Millstein and George Varghese. 2020. GRoot: Proactive Verification of DNS Configurations. In Proceedings of the Annual Conference of the ACM Special Interest Group on Data Communication on the Applications Technologies Architectures and Protocols for Computer Communication (Virtual Event USA) (SIGCOMM '20). Association for Computing Machinery New York NY USA 310\u2013328. https:\/\/doi.org\/10.1145\/3387514.3405871 10.1145\/3387514.3405871","DOI":"10.1145\/3387514.3405871"},{"key":"e_1_3_2_32_1","unstructured":"Siva Kesava Reddy Kakarla Alan Tang Ryan Beckett Karthick Jayaraman Todd Millstein Yuval Tamir and George Varghese. 2020. Finding Network Misconfigurations by Automatic Template Inference. In 17th USENIX Symposium on Networked Systems Design and Implementation (NSDI 20). USENIX Association Santa Clara CA 999\u20131013. https:\/\/www.usenix.org\/conference\/nsdi20\/presentation\/kakarla"},{"key":"e_1_3_2_33_1","unstructured":"Siva Kesava Reddy Kakarla Francis Y. Yan and Ryan Beckett. 2024. Diffy: Data-Driven Bug Finding for Configurations. https:\/\/github.com\/microsoft\/DiffyConfigAnalyzer. ."},{"key":"e_1_3_2_34_1","doi-asserted-by":"publisher","unstructured":"Siva Kesava Reddy Kakarla Francis Y. Yan and Ryan Beckett. 2024. Diffy: Data-Driven Bug Finding for Configurations. https:\/\/doi.org\/10.5281\/zenodo.10740687 10.5281\/zenodo.10740687. .","DOI":"10.5281\/zenodo.10740687"},{"key":"e_1_3_2_35_1","first-page":"113","volume-title":"In 9th USENIX Symposium on Networked Systems Design and Implementation (NSDI 12)","author":"Kazemian Peyman","year":"2012","unstructured":"Peyman Kazemian, George Varghese, and Nick McKeown. 2012. Header Space Analysis: Static Checking for Networks. In 9th USENIX Symposium on Networked Systems Design and Implementation (NSDI 12). USENIX Association, San Jose, CA, 113-126. https:\/\/www.usenix.org\/conference\/nsdi12\/technical-sessions\/presentation\/kazemian"},{"key":"e_1_3_2_36_1","first-page":"15","volume-title":"Presented as part of the 10th USENIX Symposium on Networked Systems Design and Implementation (NSDI 13)","author":"Khurshid Ahmed","year":"2013","unstructured":"Ahmed Khurshid, Xuan Zou, Wenxuan Zhou, Matthew Caesar, and P. Brighten Godfrey. 2013. VeriFlow: Verifying Network-Wide Invariants in Real Time. In Presented as part of the 10th USENIX Symposium on Networked Systems Design and Implementation (NSDI 13). USENIX, Lombard, IL, 15-27. https:\/\/www.usenix.org\/conference\/nsdi13\/technical-sessions\/presentation\/khurshid"},{"key":"e_1_3_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/1162678.1162681"},{"key":"e_1_3_2_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDM.2008.17"},{"key":"e_1_3_2_39_1","doi-asserted-by":"crossref","unstructured":"Hongqiang Harry Liu Yibo Zhu Jitu Padhye Jiaxin Cao Sri Tallapragada Nuno P Lopes Andrey Rybalchenko Guohan Lu and Lihua Yuan. 2017. Crystalnet: Faithfully emulating large production networks. In Proceedings of the 26th Symposium on Operating Systems Principles. 599\u2013613.","DOI":"10.1145\/3132747.3132759"},{"key":"e_1_3_2_40_1","unstructured":"Nuno P. Lopes Nikolaj Bj\u00f8rner Patrice Godefroid Karthick Jayaraman and George Varghese. 2015. Checking Beliefs in Dynamic Networks. In Proceedings of the 12th USENIX Conference on Networked Systems Design and Implementation (Oakland CA) (NSDI'15). USENIX Association USA 499\u2013512."},{"key":"e_1_3_2_41_1","doi-asserted-by":"crossref","unstructured":"Haohui Mai Ahmed Khurshid Rachit Agarwal Matthew Caesar P. Brighten Godfrey and Samuel Talmadge King. 2011. Debugging the Data Plane with Anteater. SIGCOMM Comput. Commun. Rev. 41 4 (aug 2011) 290\u2013301. https:\/\/doi.org.10.1145\/2043164.2018470","DOI":"10.1145\/2043164.2018470"},{"key":"e_1_3_2_42_1","unstructured":"Nextgov. 2021. Commercial Cloud Outages Are a Wake-Up Call. https:\/\/www.nextgov.com\/ideas\/2021\/03\/commercialcloud-outages-are-wake-call\/172731\/. Accessed: 2023\u201311-01."},{"key":"e_1_3_2_43_1","unstructured":"David Oppenheimer Archana Ganapathi and David A Patterson. 2003. Why do Internet services fail and what can be done about it?. In 4th Usenix Symposium on Internet Technologies and Systems (USITS 03)."},{"key":"e_1_3_2_44_1","unstructured":"Saswat Padhi. 2018. FlashProfileDemo: A C# application that demonstrates the capabilities of FlashProfile. https:\/\/github.com\/SaswatPadhi\/FlashProfileDemo\/tree\/master\/tests."},{"key":"e_1_3_2_45_1","doi-asserted-by":"publisher","unstructured":"Saswat Padhi Prateek Jain Daniel Perelman Oleksandr Polozov Sumit Gulwani and Todd D. Millstein. 2018. FlashProfile: A Framework for Synthesizing Data Profiles. PACMPL 2 OOPSLA (2018) 150:1\u2013150:28. https:\/\/doi.org\/10.1145\/3276520 10.1145\/3276520","DOI":"10.1145\/3276520"},{"key":"e_1_3_2_46_1","doi-asserted-by":"publisher","unstructured":"Oleksandr Polozov and Sumit Gulwani. 2015. FlashMeta: A Framework for Inductive Program Synthesis. SIGPLAN Not. 50 10 (oct 2015) 107\u2013126. https:\/\/doi.org\/10.1145\/2858965.2814310 10.1145\/2858965.2814310","DOI":"10.1145\/2858965.2814310"},{"key":"e_1_3_2_47_1","unstructured":"Raymond Pompon. 2021. BGP DNS and the fragility of our critical systems. https:\/\/www.f5.com\/labs\/articles\/cisotociso\/bgp-dns-and-the-fragility-of-our-critical-systems . ."},{"issue":"4","key":"e_1_3_2_48_1","first-page":"88","volume":"30","author":"Ariel Rabkin and Randy Howard Katz","year":"2012","unstructured":"Ariel Rabkin and Randy Howard Katz. 2012. How hadoop clusters break. IEEE software 30, 4 (2012), 88-94.","journal-title":"How hadoop clusters break. IEEE software"},{"key":"e_1_3_2_49_1","unstructured":"Teri Radichel. 2023. About the 5-hour Microsoft Outage. https:\/\/medium.com\/cloud-security\/about-the-5-hourmicrosoft-outage-18d47543769d. Accessed: 2023\u201311-01."},{"key":"e_1_3_2_50_1","doi-asserted-by":"publisher","DOI":"10.17487\/RFC4271"},{"key":"e_1_3_2_51_1","doi-asserted-by":"crossref","unstructured":"Mark Santolucito Ennan Zhai Rahul Dhodapkar Aaron Shim and Ruzica Piskac. 2017. Synthesizing configuration file specifications with association rule learning. Proceedings of the ACM on Programming Languages 1 OOPSLA (2017) 1\u221220.","DOI":"10.1145\/3133888"},{"key":"e_1_3_2_52_1","first-page":"80","volume-title":"Computer Aided Verification: 28th International Conference, CAV 2016, Proceedings, Part II 28","author":"Santolucito Mark","year":"2016","unstructured":"Mark Santolucito, Ennan Zhai, and Ruzica Piskac. 2016. Probabilistic automated language learning for configuration files. In Computer Aided Verification: 28th International Conference, CAV 2016, Proceedings, Part II 28. Springer, Springer, Cham, Toronto, ON, Canada, 80-87."},{"key":"e_1_3_2_53_1","doi-asserted-by":"crossref","unstructured":"Temple F Smith and Michael S Waterman. 1981. Identification of common molecular subsequences. \u04b0ournal of molecular biology 147 1 (1981) 195\u2013197.","DOI":"10.1016\/0022-2836(81)90087-5"},{"key":"e_1_3_2_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/3452296.3472925"},{"key":"e_1_3_2_55_1","unstructured":"Liam Tung. 2019. Azure global outage: Our DNS update mangled domain records says Microsoft. https:\/\/www.zdnet. com\/article\/azure-global-outage-our-dns-update-mangled-domain-records-says-microsoft\/. ."},{"key":"e_1_3_2_56_1","unstructured":"Kurt Wise. 2017. High Number of AWS Misconfigurations Leaves Huge Security Holes. https:\/\/virtualizationreview.c om\/articles\/2017\/04\/19\/aws-misconfigurations-leaves-huge-security-holes.aspx."},{"key":"e_1_3_2_57_1","first-page":"244","article-title":"Do not blame users for misconfigurations","author":"Tianyin Xu","year":"2013","unstructured":"Tianyin Xu, Jiaqi Zhang, Peng Huang, Jing Zheng, Tianwei Sheng, Ding Yuan, Yuanyuan Zhou, and Shankar Pasupathy. 2013. Do not blame users for misconfigurations. In Proceedings of the Twenty-Fourth ACM Symposium on Operating Systems Principles. 244-259.","journal-title":"In Proceedings of the Twenty-Fourth ACM Symposium on Operating Systems Principles."},{"key":"e_1_3_2_58_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNET.2015.2398197"},{"key":"e_1_3_2_59_1","doi-asserted-by":"crossref","unstructured":"Zuoning Yin Xiao Ma Jing Zheng Yuanyuan Zhou Lakshmi N Bairavasundaram and Shankar Pasupathy. 2011. An empirical study on configuration errors in commercial and open source systems. In Proceedings of the Twenty-Third ACM Symposium on Operating Systems Principles. 159\u2013172.","DOI":"10.1145\/2043556.2043572"},{"key":"e_1_3_2_60_1","unstructured":"Iris Zarecki. 2019. 19 of the worst IT outages in 2019 - A Recap of Being Let Down. https:\/\/www.continuitysoftware.c om\/blog\/19-of-the-worst-it-outages-in-2019-a-recap-of-being-let-down\/."},{"key":"e_1_3_2_61_1","doi-asserted-by":"publisher","unstructured":"Jiaqi Zhang Lakshminarayanan Renganarayana Xiaolan Zhang Niyu Ge Vasanth Bala Tianyin Xu and Yuanyuan Zhou. 2014. EnCore: Exploiting System Environment and Correlation Information for Misconfiguration Detection. In Proceedings of the 19th International Conference on Architectural Support for Programming Languages and Operating Systems (Salt Lake City Utah USA) (ASPLOS '14). Association for Computing Machinery New York NY USA 687-700. https:\/\/doi.org\/10.1145\/2541940.2541983 10.1145\/2541940.2541983","DOI":"10.1145\/2541940.2541983"},{"key":"e_1_3_2_62_1","first-page":"241","volume-title":"In 17th USENIX Symposium on Networked Systems Design and Implementation (NSDI 20)","author":"Peng Zhang Xu","year":"2020","unstructured":"Peng Zhang, Xu Liu, Hongkun Yang, Ning Kang, Zhengchang Gu, and Hao Li. 2020. APKeep: Realtime Verification for Real Networks. In 17th USENIX Symposium on Networked Systems Design and Implementation (NSDI 20). USENIX Association, Santa Clara, CA, 241-255. https:\/\/www.usenix.org\/conference\/nsdi20\/presentation\/zhang-peng"}],"container-title":["Proceedings of the ACM on Programming Languages"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3656385","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3656385","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,4]],"date-time":"2025-07-04T16:43:58Z","timestamp":1751647438000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3656385"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,6,20]]},"references-count":61,"journal-issue":{"issue":"PLDI","published-print":{"date-parts":[[2024,6,20]]}},"alternative-id":["10.1145\/3656385"],"URL":"https:\/\/doi.org\/10.1145\/3656385","relation":{},"ISSN":["2475-1421"],"issn-type":[{"value":"2475-1421","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,6,20]]},"assertion":[{"value":"2024-06-20","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}