{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,27]],"date-time":"2026-03-27T02:38:30Z","timestamp":1774579110543,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":63,"publisher":"ACM","license":[{"start":{"date-parts":[[2024,9,11]],"date-time":"2024-09-11T00:00:00Z","timestamp":1726012800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2024,9,11]]},"DOI":"10.1145\/3650212.3680355","type":"proceedings-article","created":{"date-parts":[[2024,9,11]],"date-time":"2024-09-11T11:44:25Z","timestamp":1726055065000},"page":"1223-1235","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":25,"title":["How Effective Are They? Exploring Large Language Model Based Fuzz Driver Generation"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5603-1322","authenticated-orcid":false,"given":"Cen","family":"Zhang","sequence":"first","affiliation":[{"name":"Nanyang Technological University, Singapore, Singapore"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8953-0782","authenticated-orcid":false,"given":"Yaowen","family":"Zheng","sequence":"additional","affiliation":[{"name":"Nanyang Technological University, Singapore, Singapore"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-9197-2069","authenticated-orcid":false,"given":"Mingqiang","family":"Bai","sequence":"additional","affiliation":[{"name":"Institute of Information Engineering at Chinese Academy of Sciences, Beijing, China \/ University of Chinese Academy of Sciences, Beijing, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0991-4231","authenticated-orcid":false,"given":"Yeting","family":"Li","sequence":"additional","affiliation":[{"name":"Institute of Information Engineering at Chinese Academy of Sciences, Beijing, China \/ University of Chinese Academy of Sciences, Beijing, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0044-466X","authenticated-orcid":false,"given":"Wei","family":"Ma","sequence":"additional","affiliation":[{"name":"Nanyang Technological University, Singapore, Singapore"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1288-6502","authenticated-orcid":false,"given":"Xiaofei","family":"Xie","sequence":"additional","affiliation":[{"name":"Singapore Management University, Singapore, Singapore"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4382-0757","authenticated-orcid":false,"given":"Yuekang","family":"Li","sequence":"additional","affiliation":[{"name":"University of New South Wales, Sydney, Australia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2745-7521","authenticated-orcid":false,"given":"Limin","family":"Sun","sequence":"additional","affiliation":[{"name":"Institute of Information Engineering at Chinese Academy of Sciences, Beijing, China \/ University of Chinese Academy of Sciences, Beijing, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7300-9215","authenticated-orcid":false,"given":"Yang","family":"Liu","sequence":"additional","affiliation":[{"name":"Nanyang Technological University, Singapore, Singapore"}]}],"member":"320","published-online":{"date-parts":[[2024,9,11]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/3338906.3340456"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3576915.3616610"},{"key":"e_1_3_2_1_3_1","unstructured":"Codellama. 2023. codellama-34b-instruct Model. https:\/\/huggingface.co\/codellama\/CodeLlama-34b-hf"},{"key":"e_1_3_2_1_4_1","unstructured":"Open Source Contributors. 2023. Fuzz Driver of Civetweb Project. https:\/\/github.com\/civetweb\/civetweb\/blob\/master\/fuzztest\/fuzzmain.c"},{"key":"e_1_3_2_1_5_1","unstructured":"Open Source Contributors. 2023. Fuzz Driver of Coraring Project. https:\/\/github.com\/RoaringBitmap\/CRoaring\/blob\/master\/fuzz\/croaring_fuzzer.c"},{"key":"e_1_3_2_1_6_1","volume-title":"Fuzz Driver of Kamailio Project. https:\/\/github.com\/kamailio\/kamailio\/blob\/f9cbe7ad01331e97852872c29b612409bf571c8d\/misc\/fuzz\/fuzz_parse_msg.c#L22","author":"Contributors Open Source","unstructured":"Open Source Contributors. 2023. Fuzz Driver of Kamailio Project. https:\/\/github.com\/kamailio\/kamailio\/blob\/f9cbe7ad01331e97852872c29b612409bf571c8d\/misc\/fuzz\/fuzz_parse_msg.c#L22"},{"key":"e_1_3_2_1_7_1","unstructured":"Open Source Contributors. 2023. Fuzz Driver of Kamailio Project. https:\/\/github.com\/kamailio\/kamailio\/blob\/f9cbe7ad01331e97852872c29b612409bf571c8d\/src\/modules\/misctest\/misctest_mod.c#L273"},{"key":"e_1_3_2_1_8_1","unstructured":"Open Source Contributors. 2023. Fuzz Driver of Libmodbus Project. https:\/\/github.com\/google\/oss-fuzz\/blob\/master\/projects\/libmodbus\/fuzz\/FuzzClient.c"},{"key":"e_1_3_2_1_9_1","unstructured":"Open Source Contributors. 2023. Fuzz Driver of Lua Project. https:\/\/github.com\/google\/oss-fuzz\/blob\/master\/projects\/lua\/fuzz_lua.c"},{"key":"e_1_3_2_1_10_1","unstructured":"Open Source Contributors. 2023. Fuzz Driver of Tmux Project. https:\/\/github.com\/tmux\/tmux\/blob\/master\/fuzz\/input-fuzzer.c"},{"key":"e_1_3_2_1_11_1","unstructured":"Open Source Contributors. 2023. The PermaLink for Oracle Checking Expected Output of One API Used in Fuzz Driver of Bind9 Project. https:\/\/gitlab.isc.org\/isc-projects\/bind9\/-\/blob\/af5d0a0afbbc136074133e80a63565d668b8a40d\/fuzz\/dns_rdata_fromwire_text.c#L176"},{"key":"e_1_3_2_1_12_1","volume-title":"Outputs Used in Fuzz Driver of Bind9 Project. https:\/\/gitlab.isc.org\/isc-projects\/bind9\/-\/blob\/af5d0a0afbbc136074133e80a63565d668b8a40d\/fuzz\/dns_name_fromwire.c#L82","author":"Contributors Open Source","unstructured":"Open Source Contributors. 2023. The PermaLink for Oracle Checking Expected Relationship of Two APIs\u2019 Outputs Used in Fuzz Driver of Bind9 Project. https:\/\/gitlab.isc.org\/isc-projects\/bind9\/-\/blob\/af5d0a0afbbc136074133e80a63565d668b8a40d\/fuzz\/dns_name_fromwire.c#L82"},{"key":"e_1_3_2_1_13_1","volume-title":"The PermaLink for Oracle Used in Fuzz Driver of iGraph Project. https:\/\/github.com\/igraph\/igraph\/blob\/1b25b1102916bb99274af4bc7c6322f2fe193204\/fuzzing\/read_dl_fuzzer.cpp#L62","author":"Contributors Open Source","unstructured":"Open Source Contributors. 2023. The PermaLink for Oracle Used in Fuzz Driver of iGraph Project. https:\/\/github.com\/igraph\/igraph\/blob\/1b25b1102916bb99274af4bc7c6322f2fe193204\/fuzzing\/read_dl_fuzzer.cpp#L62"},{"key":"e_1_3_2_1_14_1","volume-title":"Haoran Peng, Chenyuan Yang, and Lingming Zhang.","author":"Deng Yinlin","year":"2023","unstructured":"Yinlin Deng, Chunqiu Steven Xia, Haoran Peng, Chenyuan Yang, and Lingming Zhang. 2023. Large Language Models are Zero-Shot Fuzzers: Fuzzing Deep-Learning Libraries via Large Language Models. arxiv:2212.14834."},{"key":"e_1_3_2_1_15_1","volume-title":"Chenyuan Yang, Shizhuo Dylan Zhang, Shujing Yang, and Lingming Zhang.","author":"Deng Yinlin","year":"2023","unstructured":"Yinlin Deng, Chunqiu Steven Xia, Chenyuan Yang, Shizhuo Dylan Zhang, Shujing Yang, and Lingming Zhang. 2023. Large Language Models are Edge-Case Fuzzers: Testing Deep Learning Libraries via FuzzGPT. arXiv preprint arXiv:2304.02014."},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"crossref","unstructured":"Zhiyu Fan Xiang Gao Abhik Roychoudhury and Shin Hwei Tan. 2022. Automated Repair of Programs from Large Language Models. arXiv preprint arXiv:2205.10583.","DOI":"10.1109\/ICSE48619.2023.00128"},{"key":"e_1_3_2_1_17_1","volume-title":"14th USENIX Workshop on Offensive Technologies (WOOT 20)","author":"Fioraldi Andrea","year":"2020","unstructured":"Andrea Fioraldi, Dominik Maier, Heiko Ei\u00df feldt, and Marc Heuse. 2020. $AFL++$: Combining incremental steps of fuzzing research. In 14th USENIX Workshop on Offensive Technologies (WOOT 20)."},{"key":"e_1_3_2_1_18_1","unstructured":"Google. 2017. OSS-Fuzz Github Repository. https:\/\/github.com\/google\/oss-fuzz"},{"key":"e_1_3_2_1_19_1","unstructured":"Google. 2023. Google PaLM2 Text Models. https:\/\/cloud.google.com\/vertex-ai\/docs\/generative-ai\/model-reference\/text"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","unstructured":"John Hancock. 2004. Jaccard Distance (Jaccard Index Jaccard Similarity Coefficient). isbn:9780471650126 https:\/\/doi.org\/10.1002\/9780471650126.dob0956 10.1002\/9780471650126.dob0956","DOI":"10.1002\/9780471650126.dob0956"},{"key":"e_1_3_2_1_21_1","volume-title":"29th USENIX Security Symposium (USENIX Security 20)","author":"Ispoglou Kyriakos","year":"2020","unstructured":"Kyriakos Ispoglou, Daniel Austin, Vishwath Mohan, and Mathias Payer. 2020. Fuzzgen: Automatic fuzzer generation. In 29th USENIX Security Symposium (USENIX Security 20)."},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3510003.3510203"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/SP46215.2023.10179394"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"crossref","unstructured":"Xue Jiang Yihong Dong Lecheng Wang Qiwei Shang and Ge Li. 2023. Self-planning Code Generation with Large Language Model. arxiv:2303.06689.","DOI":"10.1145\/3672456"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.14722\/ndss.2021.24334"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3243734.3243804"},{"key":"e_1_3_2_1_27_1","unstructured":"libfuzzer@googlegroups.com. 2019. LibFuzzer. https:\/\/llvm.org\/docs\/LibFuzzer.html"},{"key":"e_1_3_2_1_28_1","volume-title":"Yuyao Wang, and Lingming Zhang.","author":"Liu Jiawei","year":"2023","unstructured":"Jiawei Liu, Chunqiu Steven Xia, Yuyao Wang, and Lingming Zhang. 2023. Is your code generated by chatgpt really correct? rigorous evaluation of large language models for code generation. arXiv preprint arXiv:2305.01210."},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"crossref","unstructured":"Zhe Liu Chunyang Chen Junjie Wang Xing Che Yuekai Huang Jun Hu and Qing Wang. 2022. Fill in the Blank: Context-aware Automated Text Input Generation for Mobile GUI Testing. arXiv preprint arXiv:2212.04732.","DOI":"10.1109\/ICSE48619.2023.00119"},{"key":"e_1_3_2_1_30_1","unstructured":"Ziyang Luo Can Xu Pu Zhao Qingfeng Sun Xiubo Geng Wenxiang Hu Chongyang Tao Jing Ma Qingwei Lin and Daxin Jiang. 2023. WizardCoder: Empowering Code Large Language Models with Evol-Instruct. arXiv preprint arXiv:2306.08568."},{"key":"e_1_3_2_1_31_1","unstructured":"Yunlong Lyu Yuxuan Xie Peng Chen and Hao Chen. 2023. Prompt Fuzzing for Fuzz Driver Generation. arxiv:2312.17677."},{"key":"e_1_3_2_1_32_1","unstructured":"OpenAI. 2022. ChatGpt Website. https:\/\/chat.openai.com"},{"key":"e_1_3_2_1_33_1","unstructured":"OPENAI. 2023. Example Usage of System Role. https:\/\/platform.openai.com\/docs\/guides\/text-generation\/chat-completions-api"},{"key":"e_1_3_2_1_35_1","unstructured":"OpenAI. 2023. OpenAI GPT-3.5 Models List. https:\/\/platform.openai.com\/docs\/models\/gpt-3-5"},{"key":"e_1_3_2_1_36_1","unstructured":"OpenAI. 2023. OpenAI GPT-4 Models List. https:\/\/platform.openai.com\/docs\/models\/gpt-4-and-gpt-4-turbo"},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/SP46214.2022.9833571"},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/SP46215.2023.10179420"},{"key":"e_1_3_2_1_39_1","volume-title":"Yossi Adi, Jingyu Liu, Tal Remez, and J\u00e9r\u00e9my Rapin.","author":"Roziere Baptiste","year":"2023","unstructured":"Baptiste Roziere, Jonas Gehring, Fabian Gloeckle, Sten Sootla, Itai Gat, Xiaoqing Ellen Tan, Yossi Adi, Jingyu Liu, Tal Remez, and J\u00e9r\u00e9my Rapin. 2023. Code llama: Open foundation models for code. arXiv preprint arXiv:2308.12950."},{"key":"e_1_3_2_1_40_1","unstructured":"Max Sch\u00e4fer Sarah Nadi Aryaz Eghbali and Frank Tip. 2023. Adaptive test generation using a large language model. arXiv preprint arXiv:2302.06527."},{"key":"e_1_3_2_1_41_1","unstructured":"Max Sch\u00e4fer Sarah Nadi Aryaz Eghbali and Frank Tip. 2023. Adaptive Test Generation Using a Large Language Model. arxiv:2302.06527."},{"key":"e_1_3_2_1_42_1","volume-title":"Noshin Ulfat, Fahmid Al Rifat, and Vinicius Carvalho Lopes.","author":"Siddiq Mohammed Latif","year":"2023","unstructured":"Mohammed Latif Siddiq, Joanna Santos, Ridwanul Hasan Tanvir, Noshin Ulfat, Fahmid Al Rifat, and Vinicius Carvalho Lopes. 2023. Exploring the Effectiveness of Large Language Models in Generating Unit Tests. arXiv preprint arXiv:2305.00418."},{"key":"e_1_3_2_1_43_1","unstructured":"Sourcegraph. 2024. Sourcegraph CLI tool. https:\/\/docs.sourcegraph.com\/cli"},{"key":"e_1_3_2_1_44_1","unstructured":"Google OSS-Fuzz Team. 2024. Feedback of adding runtime error filtering.. https:\/\/github.com\/google\/oss-fuzz-gen\/pull\/185#issuecomment-2024141597"},{"key":"e_1_3_2_1_45_1","unstructured":"Google OSS-Fuzz Team. 2024. Observed case for successfully generating fuzz drivers for new APIs by fixing the fuzzing runtime error.. https:\/\/github.com\/google\/oss-fuzz-gen\/pull\/198#issuecomment-2044547163"},{"key":"e_1_3_2_1_46_1","unstructured":"Google OSS-Fuzz Team. 2024. OSS-Fuzz-Gen Default Repeat Time in Experiments. https:\/\/github.com\/google\/oss-fuzz-gen\/blob\/d2b1bfac45efe217b28d5d882d3c3b942adaf9f7\/report\/docker_run.sh#L111"},{"key":"e_1_3_2_1_47_1","volume-title":"OSS-Fuzz-Gen Default Temperature in Experiment. https:\/\/github.com\/google\/oss-fuzz-gen\/blob\/d2b1bfac45efe217b28d5d882d3c3b942adaf9f7\/run_one_experiment.py#L53","author":"Fuzz Team Google","unstructured":"Google OSS-Fuzz Team. 2024. OSS-Fuzz-Gen Default Temperature in Experiment. https:\/\/github.com\/google\/oss-fuzz-gen\/blob\/d2b1bfac45efe217b28d5d882d3c3b942adaf9f7\/run_one_experiment.py#L53"},{"key":"e_1_3_2_1_48_1","unstructured":"Google OSS-Fuzz Team. 2024. OSS-Fuzz-Gen: LLM powered fuzzing via OSS-Fuzz.. https:\/\/github.com\/google\/oss-fuzz-gen"},{"key":"e_1_3_2_1_49_1","unstructured":"Google OSS-Fuzz Team. 2024. OSS-Fuzz-Gen PR #185. https:\/\/github.com\/google\/oss-fuzz-gen\/pull\/185"},{"key":"e_1_3_2_1_50_1","unstructured":"Google OSS-Fuzz Team. 2024. OSS-Fuzz-Gen PR #187. https:\/\/github.com\/google\/oss-fuzz-gen\/pull\/187"},{"key":"e_1_3_2_1_51_1","unstructured":"Google OSS-Fuzz Team. 2024. OSS-Fuzz-Gen PR #191. https:\/\/github.com\/google\/oss-fuzz-gen\/pull\/191"},{"key":"e_1_3_2_1_52_1","unstructured":"Google OSS-Fuzz Team. 2024. OSS-Fuzz-Gen PR #198. https:\/\/github.com\/google\/oss-fuzz-gen\/pull\/198"},{"key":"e_1_3_2_1_53_1","unstructured":"Google OSS-Fuzz Team. 2024. OSS-Fuzz-Gen PR #199. https:\/\/github.com\/google\/oss-fuzz-gen\/pull\/199"},{"key":"e_1_3_2_1_54_1","unstructured":"Google OSS-Fuzz Team. 2024. OSS-Fuzz-Gen PR #204. https:\/\/github.com\/google\/oss-fuzz-gen\/pull\/204"},{"key":"e_1_3_2_1_55_1","unstructured":"Google OSS-Fuzz Team. 2024. Scaling security with AI: from detection to solution.. https:\/\/security.googleblog.com\/2023\/08\/ai-powered-fuzzing-breaking-bug-hunting.html"},{"key":"e_1_3_2_1_56_1","volume-title":"Magicoder: Source Code Is All You Need. arXiv preprint arXiv:2312.02120.","author":"Wei Yuxiang","year":"2023","unstructured":"Yuxiang Wei, Zhe Wang, Jiawei Liu, Yifeng Ding, and Lingming Zhang. 2023. Magicoder: Source Code Is All You Need. arXiv preprint arXiv:2312.02120."},{"key":"e_1_3_2_1_57_1","unstructured":"WizardLM. 2023. wizardcoder-15b-v1.0 Model. https:\/\/huggingface.co\/WizardLM\/WizardCoder-15B-V1.0"},{"key":"e_1_3_2_1_58_1","volume-title":"Michael Pradel, and Lingming Zhang.","author":"Xia Chunqiu Steven","year":"2023","unstructured":"Chunqiu Steven Xia, Matteo Paltenghi, Jia Le Tian, Michael Pradel, and Lingming Zhang. 2023. Universal fuzzing via large language models. arXiv preprint arXiv:2308.04748."},{"key":"e_1_3_2_1_59_1","unstructured":"Chunqiu Steven Xia and Lingming Zhang. 2023. Keep the Conversation Going: Fixing 162 out of 337 bugs for $0.42 each using ChatGPT. arXiv preprint arXiv:2304.00385."},{"key":"e_1_3_2_1_60_1","unstructured":"Chenyuan Yang Yinlin Deng Runyu Lu Jiayi Yao Jiawei Liu Reyhaneh Jabbarvand and Lingming Zhang. 2023. White-box compiler fuzzing empowered by large language models. arXiv preprint arXiv:2310.15991."},{"key":"e_1_3_2_1_61_1","unstructured":"Cen Zhang. 2023. Website for This Study. https:\/\/sites.google.com\/view\/llm4fdg\/home"},{"key":"e_1_3_2_1_62_1","unstructured":"Cen Zhang Yuekang Li Hao Zhou Xiaohan Zhang Yaowen Zheng Xian Zhan Xiaofei Xie Xiapu Luo Xinghua Li Yang Liu and Sheikh Mahbub Habib. 2023. Automata-guided control-flow-sensitive fuzz driver generation. Article 161 18 pages. isbn:978-1-939133-37-3"},{"key":"e_1_3_2_1_63_1","volume-title":"APICraft: Fuzz Driver Generation for Closed-source SDK Libraries. In 30th USENIX Security Symposium (USENIX Security 21)","author":"Zhang Cen","year":"2021","unstructured":"Cen Zhang, Xingwei Lin, Yuekang Li, Yinxing Xue, Jundong Xie, Hongxu Chen, Xinlei Ying, Jiashui Wang, and Yang Liu. 2021. APICraft: Fuzz Driver Generation for Closed-source SDK Libraries. In 30th USENIX Security Symposium (USENIX Security 21). 2811\u20132828."},{"key":"e_1_3_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE-SEIP52600.2021.00041"}],"event":{"name":"ISSTA '24: 33rd ACM SIGSOFT International Symposium on Software Testing and Analysis","location":"Vienna Austria","acronym":"ISSTA '24","sponsor":["SIGSOFT ACM Special Interest Group on Software Engineering","AITO"]},"container-title":["Proceedings of the 33rd ACM SIGSOFT International Symposium on Software Testing and Analysis"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3650212.3680355","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3650212.3680355","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T22:50:08Z","timestamp":1750287008000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3650212.3680355"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,9,11]]},"references-count":63,"alternative-id":["10.1145\/3650212.3680355","10.1145\/3650212"],"URL":"https:\/\/doi.org\/10.1145\/3650212.3680355","relation":{},"subject":[],"published":{"date-parts":[[2024,9,11]]},"assertion":[{"value":"2024-09-11","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}