{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,18]],"date-time":"2026-05-18T19:06:50Z","timestamp":1779131210942,"version":"3.51.4"},"reference-count":87,"publisher":"Association for Computing Machinery (ACM)","issue":"3","funder":[{"DOI":"10.13039\/100000001","name":"NSF","doi-asserted-by":"publisher","award":["IIS-1955488"],"award-info":[{"award-number":["IIS-1955488"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"NSF","doi-asserted-by":"publisher","award":["IIS-2027575"],"award-info":[{"award-number":["IIS-2027575"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000015","name":"DOE U.S. Department of Energy","doi-asserted-by":"publisher","award":["DE-SC0016260"],"award-info":[{"award-number":["DE-SC0016260"]}],"id":[{"id":"10.13039\/100000015","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000015","name":"DOE U.S. Department of Energy","doi-asserted-by":"publisher","award":["AC02-05CH11231"],"award-info":[{"award-number":["AC02-05CH11231"]}],"id":[{"id":"10.13039\/100000015","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100006502","name":"Defense Sciences Office, DARPA","doi-asserted-by":"publisher","award":["HR00112590131"],"award-info":[{"award-number":["HR00112590131"]}],"id":[{"id":"10.13039\/100006502","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. ACM Manag. Data"],"published-print":{"date-parts":[[2026,5,18]]},"abstract":"<jats:p>\n                    Since 2020, automated testing for Database Management Systems (DBMSs) has flourished, uncovering hundreds of bugs in widely-used systems. A cornerstone of these techniques is\n                    <jats:italic toggle=\"yes\">test oracle<\/jats:italic>\n                    , which typically implements a mechanism to generate equivalent query pairs, and subsequently runs the pair and identifies bugs by checking the consistency of their results. While running these oracles can be automated, designing the mechanism to generate equivalent queries remains a fundamentally manual endeavor. This paper explores the use of large language models (LLMs) to automate the discovery of equivalent queries in the design of test oracles, addressing a long-standing bottleneck towards fully automated DBMS testing.\n                  <\/jats:p>\n                  <jats:p>\n                    Although LLMs demonstrate impressive creativity, they are prone to hallucinations that can produce numerous false positive bug reports. Furthermore, their high monetary cost and latency mean that LLM invocations should be limited to ensure that bug detection is efficient and economical. To this end, we introduce Argus, a novel framework built upon the core concept of the\n                    <jats:italic toggle=\"yes\">Constrained Abstract Query<\/jats:italic>\n                    \u2014a SQL skeleton containing placeholders and their associated instantiation conditions, e.g., the placeholder must be filled by a Boolean column. Argus uses LLMs to generate pairs of these skeletons, with their equivalence formally proven using a SQL equivalence solver to ensure soundness. After that, the placeholders in the verified skeletons are instantiated with concrete, reusable SQL snippets that are also synthesized by LLMs to produce complex test cases. We have implemented Argus and evaluated it on five extensively tested DBMSs, discovering 41 previously unknown bugs, 36 of which are logic bugs, with 36 confirmed and 27 already fixed by the developers. The artifacts for Argus are available at https:\/\/github.com\/joyemang33\/Argus\n                  <\/jats:p>","DOI":"10.1145\/3802017","type":"journal-article","created":{"date-parts":[[2026,5,18]],"date-time":"2026-05-18T18:19:16Z","timestamp":1779128356000},"page":"1-28","source":"Crossref","is-referenced-by-count":0,"title":["Automated Discovery of Test Oracles for Database Management Systems Using LLMs"],"prefix":"10.1145","volume":"4","author":[{"ORCID":"https:\/\/orcid.org\/0009-0000-4462-8527","authenticated-orcid":false,"given":"Qiuyang","family":"Mang","sequence":"first","affiliation":[{"name":"UC Berkeley, Berkeley, California, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-6079-3326","authenticated-orcid":false,"given":"Runyuan","family":"He","sequence":"additional","affiliation":[{"name":"UC Berkeley, Berkeley, California, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-0341-7362","authenticated-orcid":false,"given":"Suyang","family":"Zhong","sequence":"additional","affiliation":[{"name":"National University of Singapore, Singapore, Singapore"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-4968-1027","authenticated-orcid":false,"given":"Xiaoxuan","family":"Liu","sequence":"additional","affiliation":[{"name":"UC Berkeley, Berkeley, California, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-4821-1558","authenticated-orcid":false,"given":"Huanchen","family":"Zhang","sequence":"additional","affiliation":[{"name":"Tsinghua University, Berkeley, California, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6261-6263","authenticated-orcid":false,"given":"Alvin","family":"Cheung","sequence":"additional","affiliation":[{"name":"UC Berkeley, Berkeley, California, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2026,5,18]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/1989323.1989395"},{"key":"e_1_2_1_2_1","volume-title":"arXiv preprint arXiv:2508.16307","author":"Ba Jinsheng","year":"2025","unstructured":"Jinsheng Ba, Yuancheng Jiang, and Manuel Rigger. 2025. Metamorphic Coverage. arXiv preprint arXiv:2508.16307 (2025)."},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE48619.2023.00174"},{"key":"e_1_2_1_4_1","volume-title":"Proceedings of the IEEE\/ACM 46th International Conference on Software Engineering. 1-13","author":"Ba Jinsheng","year":"2024","unstructured":"Jinsheng Ba and Manuel Rigger. 2024. Cert: Finding performance issues in database systems through the lens of cardinality estimation. In Proceedings of the IEEE\/ACM 46th International Conference on Software Engineering. 1-13."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3654991"},{"key":"e_1_2_1_6_1","volume-title":"The oracle problem in software testing: A survey","author":"Barr Earl T","year":"2014","unstructured":"Earl T Barr, Mark Harman, Phil McMinn, Muzammil Shahbaz, and Shin Yoo. 2014. The oracle problem in software testing: A survey. IEEE transactions on software engineering 41, 5 (2014), 507-525."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3183713.3190662"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/1247480.1247520"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.14778\/3749646.3749727"},{"key":"e_1_2_1_10_1","first-page":"1","article-title":"Cosette: An Automated Prover for SQL","author":"Chu Shumo","year":"2017","unstructured":"Shumo Chu, Chenglong Wang, Konstantin Weitz, and Alvin Cheung. 2017. Cosette: An Automated Prover for SQL.. In CIDR. 1-7.","journal-title":"CIDR."},{"key":"e_1_2_1_11_1","volume-title":"HoTTSQL: Proving query rewrites with univalent SQL semantics. Acm sigplan notices 52, 6","author":"Chu Shumo","year":"2017","unstructured":"Shumo Chu, Konstantin Weitz, Alvin Cheung, and Dan Suciu. 2017. HoTTSQL: Proving query rewrites with univalent SQL semantics. Acm sigplan notices 52, 6 (2017), 510-524."},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3698810"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3626768"},{"key":"e_1_2_1_14_1","unstructured":"Dolt. 2025. Dolt Homepage. [EB\/OL]. https:\/\/www.dolthub.com\/"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3597503.3639210"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3551349.3560431"},{"key":"e_1_2_1_17_1","unstructured":"Lele Gaifax and Contributors. 2025. pglast: A PostgreSQL AST and statements prettifier for Python. https:\/\/github. com\/lelit\/pglast. Accessed: 2025-10-15."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3709652"},{"key":"e_1_2_1_19_1","first-page":"1071","volume-title":"Proceedings of the ACM on Programming Languages 8, OOPSLA1","author":"He Yang","year":"2024","unstructured":"Yang He, Pinhan Zhao, Xinyu Wang, and Yuepeng Wang. 2024. VeriEQL: Bounded equivalence verification for complex SQL queries with integrity constraints. Proceedings of the ACM on Programming Languages 8, OOPSLA1 (2024), 1071-1099."},{"key":"e_1_2_1_20_1","volume-title":"Autocomp: LLM-Driven Code Optimization for Tensor Accelerators. arXiv preprint arXiv:2505.18574","author":"Hong Charles","year":"2025","unstructured":"Charles Hong, Sahil Bhatia, Alvin Cheung, and Yakun Sophia Shao. 2025. Autocomp: LLM-Driven Code Optimization for Tensor Accelerators. arXiv preprint arXiv:2505.18574 (2025)."},{"key":"e_1_2_1_21_1","volume-title":"Nextgeneration database interfaces: A survey of llm-based text-to-sql. arXiv preprint arXiv:2406.08426","author":"Hong Zijin","year":"2024","unstructured":"Zijin Hong, Zheng Yuan, Qinggang Zhang, Hao Chen, Junnan Dong, Feiran Huang, and Xiao Huang. 2024. Nextgeneration database interfaces: A survey of llm-based text-to-sql. arXiv preprint arXiv:2406.08426 (2024)."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.14778\/3415478.3415535"},{"key":"e_1_2_1_23_1","volume-title":"Proceedings of the 46th IEEE\/ACM International Conference on Software Engineering. 1-12","author":"Jiang Yuancheng","year":"2024","unstructured":"Yuancheng Jiang, Jiahao Liu, Jinsheng Ba, Roland HC Yap, Zhenkai Liang, and Manuel Rigger. 2024. Detecting logic bugs in graph database management systems via injective and surjective graph query transformation. In Proceedings of the 46th IEEE\/ACM International Conference on Software Engineering. 1-12."},{"key":"e_1_2_1_24_1","first-page":"821","volume-title":"18th USENIX Symposium on Operating Systems Design and Implementation (OSDI 24)","author":"Jiang Zu-Ming","year":"2024","unstructured":"Zu-Ming Jiang and Zhendong Su. 2024. Detecting logic bugs in database engines via equivalent expression transformation. In 18th USENIX Symposium on Operating Systems Design and Implementation (OSDI 24). 821-835."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.14778\/3357377.3357382"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3243734.3243804"},{"key":"e_1_2_1_27_1","volume-title":"Test time scaling for code generation. arXiv preprint arXiv:2502.14382","author":"Li Dacheng","year":"2025","unstructured":"Dacheng Li, Shiyi Cao, Chengkun Cao, Xiuyu Li, Shangyin Tan, Kurt Keutzer, Jiarong Xing, Joseph E Gonzalez, and Ion Stoica. 2025. S*: Test time scaling for code generation. arXiv preprint arXiv:2502.14382 (2025)."},{"key":"e_1_2_1_28_1","first-page":"474","volume-title":"Proceedings of the ACM on Programming Languages 8, OOPSLA1","author":"Li Haonan","year":"2024","unstructured":"Haonan Li, Yu Hao, Yizhuo Zhai, and Zhiyun Qian. 2024. Enhancing static analysis for practical bug detection: An llm-integrated approach. Proceedings of the ACM on Programming Languages 8, OOPSLA1 (2024), 474-499."},{"key":"e_1_2_1_29_1","volume-title":"LLM-R2: A large language model enhanced rule-based rewrite system for boosting query efficiency. arXiv preprint arXiv:2404.12872","author":"Li Zhaodonghui","year":"2024","unstructured":"Zhaodonghui Li, Haitao Yuan, Huiming Wang, Gao Cong, and Lidong Bing. 2024. LLM-R2: A large language model enhanced rule-based rewrite system for boosting query efficiency. arXiv preprint arXiv:2404.12872 (2024)."},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE55515.2023.00057"},{"key":"e_1_2_1_31_1","first-page":"4309","volume-title":"Detecting Logical Bugs of DBMS with Coverage-based Guidance. In 31st USENIX Security Symposium (USENIX Security 22)","author":"Liang Yu","year":"2022","unstructured":"Yu Liang, Song Liu, and Hong Hu. 2022. Detecting Logical Bugs of DBMS with Coverage-based Guidance. In 31st USENIX Security Symposium (USENIX Security 22). USENIX Association, Boston, MA, 4309-4326. https:\/\/www.usenix.org\/conference\/usenixsecurity22\/presentation\/liang"},{"key":"e_1_2_1_32_1","volume-title":"Towards accurate and efficient document analytics with large language models. arXiv preprint arXiv:2405.04674","author":"Lin Yiming","year":"2024","unstructured":"Yiming Lin, Madelon Hulsebos, Ruiying Ma, Shreya Shankar, Sepanta Zeigham, Aditya G Parameswaran, and Eugene Wu. 2024. Towards accurate and efficient document analytics with large language models. arXiv preprint arXiv:2405.04674 (2024)."},{"key":"e_1_2_1_33_1","volume-title":"2025 IEEE 41st International Conference on Data Engineering (ICDE). IEEE, 2422-2435","author":"Lin Yiming","year":"2025","unstructured":"Yiming Lin, Madelon Hulsebos, Ruiying Ma, Shreya Shankar, Sepanta Zeighami, Aditya G Parameswaran, and Eugene Wu. 2025. Querying templatized document collections with large language models. In 2025 IEEE 41st International Conference on Data Engineering (ICDE). IEEE, 2422-2435."},{"key":"e_1_2_1_34_1","volume-title":"Proceedings of the 33rd ACM SIGSOFT International Symposium on Software Testing and Analysis. 666-677","author":"Liu Shuang","year":"2024","unstructured":"Shuang Liu, Junhao Lan, Xiaoning Du, Jiyuan Li, Wei Lu, Jiajun Jiang, and Xiaoyong Du. 2024. Testing graph database systems with graph-state persistence oracle. In Proceedings of the 33rd ACM SIGSOFT International Symposium on Software Testing and Analysis. 666-677."},{"key":"e_1_2_1_35_1","volume-title":"Leveraging application data constraints to optimize database-backed web applications. arXiv preprint arXiv:2205.02954","author":"Liu Xiaoxuan","year":"2022","unstructured":"Xiaoxuan Liu, Shuxian Wang, Mengzhu Sun, Sicheng Pan, Ge Li, Siddharth Jha, Cong Yan, Junwen Yang, Shan Lu, and Alvin Cheung. 2022. Leveraging application data constraints to optimize database-backed web applications. arXiv preprint arXiv:2205.02954 (2022)."},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/3510003.3510093"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3725300"},{"key":"e_1_2_1_38_1","volume-title":"PostgreSQL: introduction and concepts","author":"Momjian Bruce","unstructured":"Bruce Momjian. 2001. PostgreSQL: introduction and concepts. Vol. 192. Addison-Wesley New York."},{"key":"e_1_2_1_39_1","first-page":"601","volume-title":"Proceedings of the ACM on Programming Languages 9, PLDI","author":"M\u00fcndler Niels","year":"2025","unstructured":"Niels M\u00fcndler, Jingxuan He, Hao Wang, Koushik Sen, Dawn Song, and Martin Vechev. 2025. Type-Constrained Code Generation with Language Models. Proceedings of the ACM on Programming Languages 9, PLDI (2025), 601-626."},{"key":"e_1_2_1_40_1","unstructured":"MySQL. 2025. MySQL Homepage. [EB\/OL]. https:\/\/www.mysql.com"},{"key":"e_1_2_1_41_1","volume-title":"Sergey Shirobokov, Borislav Kozlovskii, Francisco JR Ruiz, Abbas Mehrabian, et al.","author":"Novikov Alexander","year":"2025","unstructured":"Alexander Novikov, Ng\u00e2n Vu, Marvin Eisenberger, Emilien Dupont, Po-Sen Huang, Adam Zsolt Wagner, Sergey Shirobokov, Borislav Kozlovskii, Francisco JR Ruiz, Abbas Mehrabian, et al. 2025. AlphaEvolve: A coding agent for scientific and algorithmic discovery. arXiv preprint arXiv:2506.13131 (2025)."},{"key":"e_1_2_1_42_1","unstructured":"OpenAI. 2025. Introducing OpenAI o3 and o4-mini. https:\/\/openai.com\/index\/introducing-o3-and-o4-mini\/."},{"key":"e_1_2_1_43_1","volume-title":"Semantic Operators: A Declarative Model for Rich, AI-based Data Processing. arXiv preprint arXiv:2407.11418","author":"Patel Liana","year":"2024","unstructured":"Liana Patel, Siddharth Jha, Melissa Pan, Harshit Gupta, Parth Asawa, Carlos Guestrin, and Matei Zaharia. 2024. Semantic Operators: A Declarative Model for Rich, AI-based Data Processing. arXiv preprint arXiv:2407.11418 (2024)."},{"key":"e_1_2_1_44_1","volume-title":"Forty-second International Conference on Machine Learning.","author":"Patil Shishir G","unstructured":"Shishir G Patil, Huanzhi Mao, Fanjia Yan, Charlie Cheng-Jie Ji, Vishnu Suresh, Ion Stoica, and Joseph E Gonzalez. [n.d.]. The Berkeley Function Calling Leaderboard (BFCL): From Tool Use to Agentic Evaluation of Large Language Models. In Forty-second International Conference on Machine Learning."},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/3709658"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3299869.3320212"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/3368089.3409710"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/3428279"},{"key":"e_1_2_1_49_1","first-page":"667","volume-title":"14th USENIX Symposium on Operating Systems Design and Implementation (OSDI 20)","author":"Rigger Manuel","year":"2020","unstructured":"Manuel Rigger and Zhendong Su. 2020. Testing database engines via pivoted query synthesis. In 14th USENIX Symposium on Operating Systems Design and Implementation (OSDI 20). 667-682."},{"key":"e_1_2_1_50_1","volume-title":"XX Can Be Faster. arXiv preprint arXiv:2505.09814","author":"Rybin Dmitry","year":"2025","unstructured":"Dmitry Rybin, Yushun Zhang, and Zhi-Quan Luo. 2025. XX Can Be Faster. arXiv preprint arXiv:2505.09814 (2025)."},{"key":"e_1_2_1_51_1","volume-title":"2023 IEEE 39th International Conference on Data Engineering (ICDE). IEEE, 3585-3588","author":"Sanghi Anupam","year":"2023","unstructured":"Anupam Sanghi and Jayant R Haritsa. 2023. Synthetic data generation for enterprise dbms. In 2023 IEEE 39th International Conference on Data Engineering (ICDE). IEEE, 3585-3588."},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.14778\/3749646.3749683"},{"key":"e_1_2_1_53_1","unstructured":"Andreas Seltenreich. 2022. Sqlsmith. https:\/\/github.com\/anse1\/sqlsmith."},{"key":"e_1_2_1_54_1","volume-title":"Docetl: Agentic query rewriting and evaluation for complex document processing. arXiv preprint arXiv:2410.12189","author":"Shankar Shreya","year":"2024","unstructured":"Shreya Shankar, Tristan Chambers, Tarak Shah, Aditya G Parameswaran, and Eugene Wu. 2024. Docetl: Agentic query rewriting and evaluation for complex document processing. arXiv preprint arXiv:2410.12189 (2024)."},{"key":"e_1_2_1_55_1","volume-title":"Llm4fuzz: Guided fuzzing of smart contracts with large language models. arXiv preprint arXiv:2401.11108","author":"Shou Chaofan","year":"2024","unstructured":"Chaofan Shou, Jing Liu, Doudou Lu, and Koushik Sen. 2024. Llm4fuzz: Guided fuzzing of smart contracts with large language models. arXiv preprint arXiv:2401.11108 (2024)."},{"key":"e_1_2_1_56_1","first-page":"618","article-title":"Massive stochastic testing of SQL","volume":"98","author":"Slutz Donald R","year":"1998","unstructured":"Donald R Slutz. 1998. Massive stochastic testing of SQL. In VLDB, Vol. 98. 618-622.","journal-title":"VLDB"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.14778\/3659437.3659445"},{"key":"e_1_2_1_58_1","volume-title":"Proceedings of the VLDB Endowment(VLDB)","author":"Song Jiansen","year":"2025","unstructured":"Jiansen Song, Wensheng Dou, Yingying Zheng, Yu Gao, Ziyu Cui, Wei Wang, and Jun Wei. 2025. Detecting Schema-Related Logic Bugs in Relational DBMSs via Equivalent Database Construction. Proceedings of the VLDB Endowment(VLDB) (2025)."},{"key":"e_1_2_1_59_1","volume-title":"Chengzhi Piao, Hong Cheng, Helen Meng, Deli Zhao, and Yu Rong.","author":"Tan Jie","year":"2025","unstructured":"Jie Tan, Kangfei Zhao, Rui Li, Jeffrey Xu Yu, Chengzhi Piao, Hong Cheng, Helen Meng, Deli Zhao, and Yu Rong. 2025. Can Large Language Models Be Query Optimizer for Relational Databases? arXiv preprint arXiv:2502.05562 (2025)."},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/3588909"},{"key":"e_1_2_1_61_1","volume-title":"Unveiling Logic Bugs in SPJG Query Optimizations within DBMS. ACM Transactions on Database Systems","author":"Tang Xiu","year":"2025","unstructured":"Xiu Tang, Shijie Yang, Sai Wu, Dongxiang Zhang, Wenchao Zhou, Feifei Li, and Gang Chen. 2025. Unveiling Logic Bugs in SPJG Query Optimizations within DBMS. ACM Transactions on Database Systems (2025)."},{"key":"e_1_2_1_62_1","first-page":"569","article-title":"Impossibility of an algorithm for the decision problem for finite classes","volume":"70","author":"Trakhtenbrot Boris A","year":"1950","unstructured":"Boris A Trakhtenbrot. 1950. Impossibility of an algorithm for the decision problem for finite classes. In Doklady Akademiia Nauk SSSR, Vol. 70. 569.","journal-title":"Doklady Akademiia Nauk SSSR"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.14778\/3681954.3682024"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/3514221.3526125"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/3597503.3639121"},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/3650212.3680323"},{"key":"e_1_2_1_67_1","first-page":"709","volume-title":"Proceedings of the ACM on Programming Languages 8, OOPSLA2","author":"Yang Chenyuan","year":"2024","unstructured":"Chenyuan Yang, Yinlin Deng, Runyu Lu, Jiayi Yao, Jiawei Liu, Reyhaneh Jabbarvand, and Lingming Zhang. 2024. Whitefox: White-box compiler fuzzing empowered by large language models. Proceedings of the ACM on Programming Languages 8, OOPSLA2 (2024), 709-735."},{"key":"e_1_2_1_68_1","first-page":"560","volume-title":"Proceedings of the 30th ACM International Conference on Architectural Support for Programming Languages and Operating Systems","volume":"2","author":"Yang Chenyuan","year":"2025","unstructured":"Chenyuan Yang, Zijie Zhao, and Lingming Zhang. 2025. Kernelgpt: Enhanced kernel fuzzing via large language models. In Proceedings of the 30th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 2. 560-573."},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1145\/3514221.3526168"},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1145\/3725271"},{"key":"e_1_2_1_71_1","volume-title":"Sembug: Detecting Logic Bugs in Dbms Through Generating Semantic-Aware Non-Optimizing Query. In 2025 IEEE\/ACM 33rd International Conference on Program Comprehension (ICPC). IEEE, 124-135","author":"Ye Shiyang","year":"2025","unstructured":"Shiyang Ye, Chao Ni, Jue Wang, Qianqian Pang, Xinrui Li, and Xiaodan Xu. 2025. Sembug: Detecting Logic Bugs in Dbms Through Generating Semantic-Aware Non-Optimizing Query. In 2025 IEEE\/ACM 33rd International Conference on Program Comprehension (ICPC). IEEE, 124-135."},{"key":"e_1_2_1_72_1","volume-title":"Autonomous Code Evolution Meets NP-Completeness. arXiv preprint arXiv:2509.07367","author":"Yu Cunxi","year":"2025","unstructured":"Cunxi Yu, Rongjian Liang, Chia-Tung Ho, and Haoxing Ren. 2025. Autonomous Code Evolution Meets NP-Completeness. arXiv preprint arXiv:2509.07367 (2025)."},{"key":"e_1_2_1_73_1","volume-title":"Cut Costs","author":"Zeighami Sepanta","year":"2025","unstructured":"Sepanta Zeighami, Shreya Shankar, and Aditya Parameswaran. 2025. Cut Costs, Not Accuracy: LLM-Powered Data Processing with Guarantees. arXiv preprint arXiv:2509.02896 (2025)."},{"key":"e_1_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.1145\/3709674"},{"key":"e_1_2_1_75_1","series-title":"SIAM journal on computing 18, 6","volume-title":"Simple fast algorithms for the editing distance between trees and related problems","author":"Zhang Kaizhong","year":"1989","unstructured":"Kaizhong Zhang and Dennis Shasha. 1989. Simple fast algorithms for the editing distance between trees and related problems. SIAM journal on computing 18, 6 (1989), 1245-1262."},{"key":"e_1_2_1_76_1","volume-title":"Using large language models for hyperparameter optimization. arXiv preprint arXiv:2312.04528","author":"Zhang Michael R","year":"2023","unstructured":"Michael R Zhang, Nishkrit Desai, Juhan Bae, Jonathan Lorraine, and Jimmy Ba. 2023. Using large language models for hyperparameter optimization. arXiv preprint arXiv:2312.04528 (2023)."},{"key":"e_1_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.1145\/3704742.3704964"},{"key":"e_1_2_1_78_1","volume-title":"Llm-sql-solver: Can llms determine SQL equivalence? arXiv preprint arXiv:2312.10321","author":"Zhao Fuheng","year":"2023","unstructured":"Fuheng Zhao, Lawrence Lim, Ishtiyaque Ahmad, Divyakant Agrawal, and Amr El Abbadi. 2023. Llm-sql-solver: Can llms determine SQL equivalence? arXiv preprint arXiv:2312.10321 (2023)."},{"key":"e_1_2_1_79_1","first-page":"1315","volume-title":"Proceedings of the ACM on Programming Languages 9, PLDI","author":"Zhao Pinhan","year":"2025","unstructured":"Pinhan Zhao, Yuepeng Wang, and Xinyu Wang. 2025. Polygon: Symbolic Reasoning for SQL using Conflict-Driven Under-Approximation Search. Proceedings of the ACM on Programming Languages 9, PLDI (2025), 1315-1340."},{"key":"e_1_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.1145\/3372297.3417260"},{"key":"e_1_2_1_81_1","volume-title":"Testing Database Systems with Large Language Model Synthesized Fragments. arXiv preprint arXiv:2505.02012","author":"Zhong Suyang","year":"2025","unstructured":"Suyang Zhong and Manuel Rigger. 2025. Testing Database Systems with Large Language Model Synthesized Fragments. arXiv preprint arXiv:2505.02012 (2025)."},{"key":"e_1_2_1_82_1","doi-asserted-by":"publisher","DOI":"10.1145\/3779212.3790215"},{"key":"e_1_2_1_83_1","volume-title":"SPES: A two-stage query equivalence verifier. arXiv preprint arXiv:2004.00481","author":"Zhou Qi","year":"2020","unstructured":"Qi Zhou, Joy Arulraj, Shamkant Navathe, William Harris, and Jinpeng Wu. 2020. SPES: A two-stage query equivalence verifier. arXiv preprint arXiv:2004.00481 (2020)."},{"key":"e_1_2_1_84_1","volume-title":"CrackSQL: A Hybrid SQL Dialect Translation System Powered by Large Language Models. arXiv preprint arXiv:2504.00882","author":"Zhou Wei","year":"2025","unstructured":"Wei Zhou, Yuyang Gao, Xuanhe Zhou, and Guoliang Li. 2025. CrackSQL: A Hybrid SQL Dialect Translation System Powered by Large Language Models. arXiv preprint arXiv:2504.00882 (2025)."},{"key":"e_1_2_1_85_1","doi-asserted-by":"publisher","DOI":"10.1007\/s41019-023-00235-6"},{"key":"e_1_2_1_86_1","doi-asserted-by":"publisher","DOI":"10.14778\/3636218.3636236"},{"key":"e_1_2_1_87_1","unstructured":"\u00c1ndr\u00e9 Albrecht and Contributors. 2025. sqlparse: A non-validating SQL parser module for Python. https:\/\/github.com\/andialbrecht\/sqlparse. Accessed: 2025-10-15."}],"container-title":["Proceedings of the ACM on Management of Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3802017","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,18]],"date-time":"2026-05-18T18:27:26Z","timestamp":1779128846000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3802017"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,5,18]]},"references-count":87,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2026,5,18]]}},"alternative-id":["10.1145\/3802017"],"URL":"https:\/\/doi.org\/10.1145\/3802017","relation":{},"ISSN":["2836-6573"],"issn-type":[{"value":"2836-6573","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,5,18]]}}}