{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,22]],"date-time":"2026-11-22T15:43:37Z","timestamp":1795362217202,"version":"4.10.3"},"reference-count":77,"publisher":"Association for Computing Machinery (ACM)","issue":"FSE","license":[{"start":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T00:00:00Z","timestamp":1750291200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/legalcode"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. ACM Softw. Eng."],"published-print":{"date-parts":[[2025,6,19]]},"abstract":"<jats:p>Detecting vulnerability fix commits in open-source software is crucial for maintaining software security. To help OSS identify vulnerability fix commits, several automated approaches are developed. However, existing approaches like VulFixMiner and CoLeFunDa, focus solely on code changes, neglecting essential context from development artifacts. Tools like Vulcurator, which integrates issue reports, fail to leverage semantic associations between different development artifacts (e.g., pull requests and history vulnerability fixes). Moreover, they miss vulnerability fixes in tangled commits and lack explanations, limiting practical use. Hence to address those limitations, we propose LLM4VFD, a novel framework that leverages Large Language Models (LLMs) enhanced with Chain-of-Thought reasoning and In-Context Learning to improve the accuracy of vulnerability fix detection. LLM4VFD comprises three components: (1) Code Change Intention, which analyzes commit summaries, purposes, and implications using Chain-of-Thought reasoning; (2) Development Artifact, which incorporates context from related issue reports and pull requests; (3) Historical Vulnerability, which retrieves similar past vulnerability fixes to enrich context. More importantly, on top of the prediction, LLM4VFD also provides a detailed analysis and explanation to help security experts understand the rationale behind the decision. We evaluated LLM4VFD against state-of-the-art techniques, including Pre-trained Language Model-based approaches and vanilla LLMs, using a newly collected dataset, BigVulFixes. Experimental results demonstrate that LLM4VFD significantly outperforms the best-performed existing approach by 68.1%\u2013145.4%. Furthermore, We conducted a user study with security experts, showing that the analysis generated by LLM4VFD improves the efficiency of vulnerability fix identification.<\/jats:p>","DOI":"10.1145\/3715738","type":"journal-article","created":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T11:15:34Z","timestamp":1750331734000},"page":"489-510","source":"Crossref","is-referenced-by-count":16,"title":["Code Change Intention, Development Artifact, and History Vulnerability: Putting Them Together for Vulnerability Fix Detection by LLM"],"prefix":"10.1145","volume":"2","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9963-6225","authenticated-orcid":false,"given":"Xu","family":"Yang","sequence":"first","affiliation":[{"name":"University of Manitoba, Winnipeg, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6439-0720","authenticated-orcid":false,"given":"Wenhan","family":"Zhu","sequence":"additional","affiliation":[{"name":"Huawei, Toronto, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7848-5170","authenticated-orcid":false,"given":"Michael","family":"Pacheco","sequence":"additional","affiliation":[{"name":"Huawei, Toronto, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5181-3146","authenticated-orcid":false,"given":"Jiayuan","family":"Zhou","sequence":"additional","affiliation":[{"name":"Huawei, Toronto, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3823-1771","authenticated-orcid":false,"given":"Shaowei","family":"Wang","sequence":"additional","affiliation":[{"name":"University of Manitoba, Winnipeg, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0093-3292","authenticated-orcid":false,"given":"Xing","family":"Hu","sequence":"additional","affiliation":[{"name":"Zhejiang University, Hangzhou, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0145-615X","authenticated-orcid":false,"given":"Kui","family":"Liu","sequence":"additional","affiliation":[{"name":"Huawei Software Engineering Application Technology Lab, Hangzhou, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2025,6,19]]},"reference":[{"key":"e_1_3_1_1_2","doi-asserted-by":"publisher","unstructured":"2024. LLM4VFD replication pacakge. Zenodo. https:\/\/doi.org\/10.5281\/zenodo.13776994 10.5281\/zenodo.13776994","DOI":"10.5281\/zenodo.13776994"},{"key":"e_1_3_1_2_2","unstructured":"Josh Achiam Steven Adler Sandhini Agarwal Lama Ahmad Ilge Akkaya Florencia Leoni Aleman Diogo Almeida Janko Altenschmidt Sam Altman Shyamal Anadkat et al.. Gpt-4 technical report. arXiv preprint arXiv:2303.08774 (2023)."},{"key":"e_1_3_1_3_2","unstructured":"Patrick Barei\u00df Beatriz Souza Marcelo dAmorim and Michael Pradel. 2022. Code generation tools (almost) for free? a study of few-shot pre-trained language models on code. arXiv preprint arXiv:2206.01335 (2022)."},{"key":"e_1_3_1_4_2","doi-asserted-by":"crossref","unstructured":"Mike Barnett Christian Bird Jo\u00e0o Brunet and Shuvendu K Lahiri.. Helping developers help themselves: Automatic decomposition of code review changesets. In 2015 IEEE\/ACM 37th IEEE International Conference on Software Engineering (2015).","DOI":"10.1109\/ICSE.2015.35"},{"key":"e_1_3_1_5_2","article-title":"Deep learning based vulnerability detection: Are we there yet?","author":"Chakraborty Saikat","year":"2021","unstructured":"Saikat Chakraborty, Rahul Krishna, Yangruibo Ding, and Baishakhi Ray. 2021. Deep learning based vulnerability detection: Are we there yet?. IEEE Transactions on Software Engineering (2021).","journal-title":"IEEE Transactions on Software Engineering"},{"key":"e_1_3_1_6_2","unstructured":"Aaron Chan Anant Kharkar Roshanak Zilouchian Moghaddam Yevhen Mohylevskyy Alec Helyar Eslam Kamal Mohamed Elkamhawy and Neel Sundaresan. 2023. Transformer-based vulnerability detection in code at EditTime: Zero-shot few-shot or fine-tuning?. arXiv preprint arXiv:2306.01754 (2023)."},{"key":"e_1_3_1_7_2","unstructured":"Banghao Chen Zhaofeng Zhang Nicolas Langren\u00e9 and Shengxin Zhu. 2023. Unleashing the potential of prompt engineering in Large Language Models: a comprehensive review. arXiv preprint arXiv:2310.14735 (2023)."},{"key":"e_1_3_1_8_2","unstructured":"Mark Chen Jerry Tworek Heewoo Jun Qiming Yuan Henrique Ponde De Oliveira Pinto Jared Kaplan Harri Edwards Yuri Burda Nicholas Joseph Greg Brockman et al. 2021. Evaluating large language models trained on code. arXiv preprint arXiv:2107.03374 (2021)."},{"key":"e_1_3_1_9_2","doi-asserted-by":"crossref","unstructured":"Yang Chen Andrew E Santosa Ang Ming Yi Abhishek Sharma Asankhaya Sharma and David Lo. 2020. A machine learning approach for vulnerability curation. In Proceedings of the 17th International Conference on Mining Software Repositories (2020).","DOI":"10.1145\/3379597.3387461"},{"key":"e_1_3_1_10_2","unstructured":"Yiran Cheng Lwin Khin Shar Ting Zhang Shouguo Yang Chaopeng Dong David Lo Shichao Lv Zhiqiang Shi and Limin Sun. 2024. LLM-Enhanced Static Analysis for Precise Identification of Vulnerable OSS Versions. arXiv preprint arXiv.2408.07321 (2024)."},{"key":"e_1_3_1_11_2","unstructured":"Chroma. 2024. Chroma is the open-source Al application database. Batteries included. https:\/\/www.trychroma.com\/ accessed 2024-09-12."},{"key":"e_1_3_1_12_2","unstructured":"GitHub Docs. 2022. GitHub REST API documentation. https:\/\/docs.github.com\/en\/rest?apiVersion=2022-11-28 accessed 2024-08-19."},{"key":"e_1_3_1_13_2","unstructured":"Qingxiu Dong Lei Li Damai Dai Ce Zheng Zhiyong Wu Baobao Chang Xu Sun Jingjing Xu and Zhifang Sui. 2022. A survey on in-context learning. arXiv preprint arXiv:2301.00234 (2022)."},{"key":"e_1_3_1_14_2","unstructured":"Xueying Du Geng Zheng Kaixin Wang Jiayi Feng Wentai Deng Mingwei Liu Bihuan Chen Xin Peng Tao Ma and Yiling Lou. 2024. Vul-RAG: Enhancing LLM-based Vulnerability Detection via Knowledge-level RAG. arXiv preprint arXiv:2406.11147 (2024)."},{"key":"e_1_3_1_15_2","unstructured":"Abhimanyu Dubey Abhinav Jauhri Abhinav Pandey Abhishek Kadian Ahmad Al-Dahle Aiesha Letman Akhil Mathur Alan Schelten Amy Yang Angela Fan et al. 2024. The llama 3 herd of models. arXiv preprint arXiv:2407.21783 (2024)."},{"key":"e_1_3_1_16_2","unstructured":"Jiahao Fan Yi Li Shaohua Wang and Tien N Nguyen.. 2020. A C\/C++ code vulnerability dataset with code changes and CVE summaries. In Proceedings of the 17th International Conference on Mining Software Repositories."},{"key":"e_1_3_1_17_2","unstructured":"Lishui Fan Jiakun Liu Zhongxin Liu David Lo Xin Xia and Shanping Li.. 2024. Exploring the Capabilities of LLMs for Code Change Related Tasks. arXiv preprint arXiv:2407.02824 (2024)."},{"key":"e_1_3_1_18_2","unstructured":"Richard Fang Rohan Bindu Akul Gupta Qiusi Zhan and Daniel Kang.. 2024. Teams of LLM Agents can Exploit Zero-Day Vulnerabilities. arXiv preprint arXiv:2406.01637 (2024)."},{"key":"e_1_3_1_19_2","doi-asserted-by":"crossref","unstructured":"Henry Gilbert Michael Sandborn Douglas C Schmidt Jesse Spencer-Smith and Jules White.. 2023. Semantic compression with large language models. In 2023 Tenth International Conference on Social Networks Analysis Management and Security (SNAMS).","DOI":"10.1109\/SNAMS60348.2023.10375400"},{"key":"e_1_3_1_20_2","unstructured":"GitHub. 2024. GitHub Advisory Database. https:\/\/github.com\/advisories accessed 2024-08-19."},{"key":"e_1_3_1_21_2","unstructured":"gpac. 2023. fixed #2475 . gpac\/gpac@c88df2e . GitHub. https:\/\/github.com\/gpac\/gpac\/commit\/c88df2e202efad214c25b4e586f243b2038779ba accessed 2024-08-19."},{"key":"e_1_3_1_22_2","unstructured":"gpac. 2023. OOB Read segfault . Issue #2475 . gpac\/gpac . GitHub. https:\/\/github.com\/gpac\/gpac\/issues\/2475 accessed 2024-08-19."},{"key":"e_1_3_1_23_2","doi-asserted-by":"crossref","unstructured":"Haibo He and Edwardo A Garcia. 2009.Learning from imbalanced data. IEEE Transactions on knowledge and data engineering (2009).","DOI":"10.1109\/TKDE.2008.239"},{"key":"e_1_3_1_24_2","unstructured":"Dan Hendrycks Collin Burns Steven Basart Andy Zou Mantas Mazeika Dawn Song and Jacob Steinhardt. 2020. Measuring massive multitask language understanding. arXiv preprint arXiv:2009.03300 (2020)."},{"key":"e_1_3_1_25_2","doi-asserted-by":"crossref","unstructured":"Kim Herzig and Andreas Zeller.. 2013. The impact of tangled code changes. In 2013 10th Working Conference on Mining Software Repositories (MSR).","DOI":"10.1109\/MSR.2013.6624018"},{"key":"e_1_3_1_26_2","unstructured":"Xinyi Hou Yanjie Zhao Yue Liu Zhou Yang Kailong Wang Li Li Xiapu Luo David Lo John Grundy and Haoyu Wang. 2023. Large language models for software engineering: A systematic literature review. arXiv preprint arXiv:2308.10620 (2023)."},{"key":"e_1_3_1_27_2","unstructured":"Nafis Tanveer Islam Joseph Khoury Andrew Seong Gonzalo De La Torre Parra Elias Bou-Harb and Peyman Najafirad. 2024. LLM-Powered Code Vulnerability Repair with Reinforcement Learning and Semantic Reward. arXiv preprint arXiv.2401.03374 (2024)."},{"key":"e_1_3_1_28_2","unstructured":"Shuyang Jiang Yuhao Wang and Yu Wang. 2023. Selfevolve: A code evolution framework via large language models. arXiv preprint arXiv:2306.02907 (2023)."},{"key":"e_1_3_1_29_2","doi-asserted-by":"crossref","unstructured":"Takeshi Kojima Shixiang Shane Gu Machel Reid Yutaka Matsuo and Yusuke Iwasawa. 2022. Large language models are zero-shot reasoners. Advances in neural information processing systems (2022).","DOI":"10.52202\/068431-1613"},{"key":"e_1_3_1_30_2","doi-asserted-by":"crossref","unstructured":"Ummay Kulsum Haotian Zhu Bowen Xu and Marcelo d\u2019Amorim.. 2024. A Case Study of LLM for Automated Vulnerability Repair: Assessing Impact of Reasoning and Patch Validation Feedback. In Proceedings of the 1st ACM International Conference on Al-Powered Software.","DOI":"10.1145\/3664646.3664770"},{"key":"e_1_3_1_31_2","doi-asserted-by":"crossref","unstructured":"Woosuk Kwon Zhuohan Li Siyuan Zhuang Ying Sheng Lianmin Zheng Cody Hao Yu Joseph E. Gonzalez Hao Zhang and Ion Stoica.. 2023. Efficient Memory Management for Large Language Model Serving with PagedAttention. In Proceedings of the ACM SIGOPS 29th Symposium on Operating Systems Principles.","DOI":"10.1145\/3600006.3613165"},{"key":"e_1_3_1_32_2","doi-asserted-by":"crossref","unstructured":"Juho Leinonen Paul Denny Stephen MacNeil Sami Sarsa Seth Bernstein Joanne Kim Andrew Tran and Arto Hellas.. 2023. Comparing code explanations created by students and large language models. In Proceedings of the 2023 Conference on Innovation and Technology in Computer Science Education V. 1.","DOI":"10.1145\/3587102.3588785"},{"key":"e_1_3_1_33_2","doi-asserted-by":"crossref","unstructured":"Yi Li Shaohua Wang and Tien N Nguyen.. 2021. Vulnerability detection with fine-grained interpretations. In Proceedings of the 29th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering.","DOI":"10.1145\/3468264.3468597"},{"key":"e_1_3_1_34_2","unstructured":"Zehan Li Xin Zhang Yanzhao Zhang Dingkun Long Pengjun Xie and Meishan Zhang. 2023. Towards general text embeddings with multi-stage contrastive learning. arXiv preprint arXiv:2308.03281 (2023)."},{"key":"e_1_3_1_35_2","unstructured":"Jiawei Liu Chunqiu Steven Xia Yuyao Wang and Lingming Zhang. 2024. Is your code generated by chatgpt really correct? rigorous evaluation of large language models for code generation. Advances in Neural Information Processing Systems (2024)."},{"key":"e_1_3_1_36_2","unstructured":"Shigang Liu Guanjun Lin Lizhen Qu Jun Zhang Olivier De Vel Paul Montague and Yang Xiang. 2020. CD-VulD: Cross-domain vulnerability discovery based on deep domain adaptation. IEEE Transactions on Dependable and Secure Computing (2020)."},{"key":"e_1_3_1_37_2","doi-asserted-by":"crossref","unstructured":"Brian W Matthews.. 1975. Comparison of the predicted and observed secondary structure of T4 phage lysozyme. Biochimica et Biophysica Acta (BBA)-Protein Structure (1975).","DOI":"10.1016\/0005-2795(75)90109-9"},{"key":"e_1_3_1_38_2","doi-asserted-by":"crossref","unstructured":"Niklas Muennighoff Nouamane Tazi Lo\u00efc Magne and Nils Reimers. 2022. MTEB: Massive text embedding benchmark. arXiv preprint arXiv:2210.07316 (2022).","DOI":"10.18653\/v1\/2023.eacl-main.148"},{"key":"e_1_3_1_39_2","doi-asserted-by":"crossref","unstructured":"Son Nguyen Thanh Trong Vu and Hieu Dinh Vo.. 2023. VFFINDER: A Graph-based Approach for Automated Silent Vulnerability-Fix Identification. In 2023 15th International Conference on Knowledge and Systems Engineering (KSE).","DOI":"10.1109\/KSE59128.2023.10299438"},{"key":"e_1_3_1_40_2","doi-asserted-by":"crossref","unstructured":"Truong Giang Nguyen Thanh Le-Cong Hong Jin Kang Xuan-Bach D Le and David Lo.. 2022. Vulcurator: a vulnerabilityfixing commit detector. In Proceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering.","DOI":"10.1145\/3540250.3558936"},{"key":"e_1_3_1_41_2","doi-asserted-by":"crossref","unstructured":"Truong Giang Nguyen Thanh Le-Cong Hong Jin Kang Ratnadira Widyasari Chengran Yang Zhipeng Zhao Bowen Xu Jiayuan Zhou Xin Xia Ahmed E Hassan et al.. 2023. Multi-granularity detector for vulnerability fixes. IEEE Transactions on Software Engineering (2023).","DOI":"10.1109\/TSE.2023.3281275"},{"key":"e_1_3_1_42_2","doi-asserted-by":"crossref","unstructured":"Giang Nguyen-Truong Hong Jin Kang David Lo Abhishek Sharma Andrew E Santosa Asankhaya Sharma and Ming Yi Ang.. 2022. Hermes: Using commit-issue linking to detect vulnerability-fixing commits. In 2022 IEEE International Conference on Software Analysis Evolution and Reengineering (SANER).","DOI":"10.1109\/SANER53432.2022.00018"},{"key":"e_1_3_1_43_2","unstructured":"NIST. 2024. NVD - Home. https:\/\/nvd.nist.gov\/ accessed 2024-09-10."},{"key":"e_1_3_1_44_2","unstructured":"NVD. 2023. NVD - CVE-2023-37061. https:\/\/nvd.nist.gov\/vuln\/detail\/CVE-2024-37061 accessed 2024-08-25."},{"key":"e_1_3_1_45_2","unstructured":"NVD. 2023. NVD - CVE-2023-48014. https:\/\/nvd.nist.gov\/vuln\/detail\/CVE-2024-48014 accessed 2024-08-25."},{"key":"e_1_3_1_46_2","unstructured":"NVD. 2023. NVD - CVE-2023-48657. https:\/\/nvd.nist.gov\/vuln\/detail\/CVE-2024-48657 accessed 2024-08-25."},{"key":"e_1_3_1_47_2","unstructured":"NVD. 2024. NVD - CVE-2024-28103. https:\/\/nvd.nist.gov\/vuln\/detail\/CVE-2024-28103 accessed 2024-08-25."},{"key":"e_1_3_1_48_2","unstructured":"NVD. 2024. NVD - CVE-2024-29199. https:\/\/nvd.nist.gov\/vuln\/detail\/CVE-2024-29199 accessed 2024-08-25."},{"key":"e_1_3_1_49_2","unstructured":"OpenSSF. 2024. Guide to coordinated vulnerability disclosure for open source software projects. https:\/\/github.com\/ossf\/oss-vulnerability-guide accessed 2024-07-26."},{"key":"e_1_3_1_50_2","doi-asserted-by":"crossref","unstructured":"Long Ouyang Jeffrey Wu Xu Jiang Diogo Almeida Carroll Wainwright Pamela Mishkin Chong Zhang Sandhini Agarwal Katarina Slama Alex Ray et al.. 2022. Training language models to follow instructions with human feedback. Advances in neural information processing systems 35 27730\u201327744.","DOI":"10.52202\/068431-2011"},{"key":"e_1_3_1_51_2","unstructured":"Shengyi Pan Lingfeng Bao Xin Xia David Lo and Shanping Li.. 2023. Fine-grained commit-level vulnerability type prediction by CWE tree structure. In 2023 IEEE\/ACM 45th International Conference on Software Engineering (ICSE)."},{"key":"e_1_3_1_52_2","unstructured":"Shengyi Pan Jiayuan Zhou Filipe Roseiro Cogo Xin Xia Lingfeng Bao Xing Hu Shanping Li and Ahmed E Hassan.. 2022. Automated unearthing of dangerous issue reports. In Proceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering."},{"key":"e_1_3_1_53_2","unstructured":"Max Peeperkorn Tom Kouwenhoven Dan Brown and Anna Jordanous.. 2024. Is temperature the creativity parameter of large language models?. arXiv preprint arXiv:2405.00492 (2024)."},{"key":"e_1_3_1_54_2","unstructured":"protobufjs. 2022. fix: do not let setProperty change the prototype (#1731) . protobufjs\/protobuf.js@3357ef7 . GitHub. https:\/\/github.com\/protobufjs\/protobuf.js\/commit\/3357ef753871b394b825d15429ceb27b26e24d63 accessed 2024-08-19."},{"key":"e_1_3_1_55_2","unstructured":"protobufjs. 2023. fix: do not let setProperty change the prototype (#1899) . protobufjs\/protobuf.js@e66379f . GitHub. https:\/\/github.com\/protobufjs\/protobuf.js\/commit\/e66379f451b0393c27d87b37fa7d271619e16b0d accessed 2024-08-19."},{"key":"e_1_3_1_56_2","doi-asserted-by":"crossref","unstructured":"Md Mahbubur Rahman Ira Ceka Chengzhi Mao Saikat Chakraborty Baishakhi Ray and Wei Le.. 2024. Towards causal deep learning for vulnerability detection. In Proceedings of the IEEE\/ACM 46th International Conference on Software Engineering.","DOI":"10.1145\/3597503.3639170"},{"key":"e_1_3_1_57_2","doi-asserted-by":"crossref","unstructured":"Matthew Renze and Erhan Guven.. 2024. The effect of sampling temperature on problem solving in large language models. arXiv preprint arXiv:2402.05201 (2024).","DOI":"10.18653\/v1\/2024.findings-emnlp.432"},{"key":"e_1_3_1_58_2","doi-asserted-by":"crossref","unstructured":"Antonino Sabetta and Michele Bezzi.. 2018. A practical approach to the automatic classification of security-relevant commits. In 2018 IEEE International conference on software maintenance and evolution (ICSME).","DOI":"10.1109\/ICSME.2018.00058"},{"key":"e_1_3_1_59_2","doi-asserted-by":"crossref","unstructured":"Da Shen Xinyun Chen Chenguang Wang Koushik Sen and Dawn Song.. 2022. Benchmarking Language Models for Code Syntax Understanding. In Findings of the Association for Computational Linguistics: EMNLP 2022.","DOI":"10.18653\/v1\/2022.findings-emnlp.224"},{"key":"e_1_3_1_60_2","unstructured":"spring projects. 2023. Polishing and minor refactoring in HandlerMappinglntrospector \u2022 spring- projects\/spring-framework@202fa5c \u2022 GitHub. https:\/\/github.com\/spring-projects\/spring-framework\/commit\/202fa5cdb3a3d0cfe6967e85fa167d978244f28a accessed 2024-08-19."},{"key":"e_1_3_1_61_2","doi-asserted-by":"crossref","unstructured":"Chandra Thapa Seung Ick Jang Muhammad Ejaz Ahmed Seyit Camtepe Josef Pieprzyk and Surya Nepal.. 2022. Transformer-based language models for software vulnerability detection. In Proceedings of the 38th Annual Computer Security Applications Conference.","DOI":"10.1145\/3564625.3567985"},{"key":"e_1_3_1_62_2","unstructured":"The New York Times. 2019. Equifax to Pay at Least $650 Million in Largest-Ever Data Breach Settlement. https:\/\/www.nytimes.com\/2019\/07\/22\/business\/equifax-settlement.html accessed 2024-08-19."},{"key":"e_1_3_1_63_2","doi-asserted-by":"crossref","unstructured":"Yue Wang Hung Le Akhilesh Gotmare Nghi Bui Junnan Li and Steven Hoi.. 2023. CodeT5+: Open Code Large Language Models for Code Understanding and Generation. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing.","DOI":"10.18653\/v1\/2023.emnlp-main.68"},{"key":"e_1_3_1_64_2","doi-asserted-by":"crossref","unstructured":"Jason Wei Xuezhi Wang Dale Schuurmans Maarten Bosma Fei Xia Ed Chi Quoc V Le Denny Zhou et al.. 2022. Chain-of-thought prompting elicits reasoning in large language models. Advances in neural information processing systems (2022).","DOI":"10.52202\/068431-1800"},{"key":"e_1_3_1_65_2","doi-asserted-by":"crossref","unstructured":"Yi Wu Nan Jiang Hung Viet Pham Thibaud Lutellier Jordan Davis Lin Tan Petr Babkin and Sameena Shah.. 2023. How effective are neural networks for fixing security vulnerabilities. In Proceedings of the 32nd ACM SIGSOFT International Symposium on Software Testing and Analysis.","DOI":"10.1145\/3597926.3598135"},{"key":"e_1_3_1_66_2","unstructured":"Zhengzi Xu Bihuan Chen Mahinthan Chandramohan Yang Liu and Fu Song.. 2017. Spain: security patch analysis for binaries towards understanding the pain and pills. In 2017 IEEE\/ACM 39th International Conference on Software Engineering (ICSE)."},{"key":"e_1_3_1_67_2","unstructured":"An Yang Baosong Yang Binyuan Hui Bo Zheng Bowen Yu Chang Zhou Chengpeng Li Chengyuan Li Dayiheng Liu Fei Huang et al.. 2024. Qwen2 technical report. arXiv preprint arXiv:2407.10671 (2024)."},{"key":"e_1_3_1_68_2","doi-asserted-by":"crossref","unstructured":"Xu Yang Shaowei Wang Yi Li and Shaohua Wang.. 2023. Does data sampling improve deep learning-based vulnerability detection? Yeas! and Nays!. In Proceedings of the 45th IEEE\/ACM International Conference on Software Engineering (ICSE).","DOI":"10.1109\/ICSE48619.2023.00192"},{"key":"e_1_3_1_69_2","doi-asserted-by":"crossref","unstructured":"JD Zamfirescu-Pereira Richmond Y Wong Bjoern Hartmann and Qian Yang.. 2023. Why Johnny can\u2019t prompt: how non-AI experts try (and fail) to design LLM prompts. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1\u201321.","DOI":"10.1145\/3544548.3581388"},{"key":"e_1_3_1_70_2","unstructured":"Jeffrey Zhou Tianjian Lu Swaroop Mishra Siddhartha Brahma Sujoy Basu Yi Luan Denny Zhou and Le Hou.. 2023. Instruction-following evaluation for large language models. arXiv preprint arXiv:2311.07911 (2023)."},{"key":"e_1_3_1_71_2","doi-asserted-by":"crossref","unstructured":"Jiayuan Zhou Michael Pacheco Jinfu Chen Xing Hu Xin Xia David Lo and Ahmed E Hassan.. 2023. Colefunda: Explainable silent vulnerability fix identification. In 2023 IEEE\/ACM 45th International Conference on Software Engineering (ICSE).","DOI":"10.1109\/ICSE48619.2023.00214"},{"key":"e_1_3_1_72_2","doi-asserted-by":"crossref","unstructured":"Jiayuan Zhou Michael Pacheco Zhiyuan Wan Xin Xia David Lo Yuan Wang and Ahmed E Hassan.. 2021. Finding a needle in a haystack: Automated mining of silent vulnerability fixes. In 2021 36th IEEE\/ACM International Conference on Automated Software Engineering (ASE).","DOI":"10.1109\/ASE51524.2021.9678720"},{"key":"e_1_3_1_73_2","unstructured":"Xin Zhou Sicong Cao Xiaobing Sun and David Lo.. 2024. Large Language Model for Vulnerability Detection and Repair: Literature Review and the Road Ahead. arXiv preprint arXiv:2404.02525 (2024)."},{"key":"e_1_3_1_74_2","doi-asserted-by":"crossref","unstructured":"Xin Zhou Kisub Kim Bowen Xu DongGyun Han and David Lo.. 2024. Out of Sight Out of Mind: Better Automatic Vulnerability Repair by Broadening Input Ranges and Sources. In Proceedings of the IEEE\/ACM 46th International Conference on Software Engineering.","DOI":"10.1145\/3597503.3639222"},{"key":"e_1_3_1_75_2","unstructured":"Yaqin Zhou Shangqing Liu Jingkai Siow Xiaoning Du and Yang Liu.. 2019. Devign: Effective vulnerability identification by learning comprehensive program semantics via graph neural networks. Advances in neural information processing systems (2019)."},{"key":"e_1_3_1_76_2","doi-asserted-by":"crossref","unstructured":"Yaqin Zhou and Asankhaya Sharma.. 2017. Automated identification of security issues from commit messages and bug reports. In Proceedings of the 2017 11th joint meeting on foundations of software engineering.","DOI":"10.1145\/3106237.3117771"},{"key":"e_1_3_1_77_2","unstructured":"Qihao Zhu Daya Guo Zhihong Shao Dejian Yang Peiyi Wang Runxin Xu Y Wu Yukun Li Huazuo Gao Shirong Ma et al.. 2024. DeepSeek-Coder-V2: Breaking the Barrier of Closed-Source Models in Code Intelligence. arXiv preprint arXiv:2406.11931."}],"container-title":["Proceedings of the ACM on Software Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3715738","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,23]],"date-time":"2026-08-23T11:04:52Z","timestamp":1787483092000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3715738"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,19]]},"references-count":77,"journal-issue":{"issue":"FSE","published-print":{"date-parts":[[2025,6,19]]}},"alternative-id":["10.1145\/3715738"],"URL":"https:\/\/doi.org\/10.1145\/3715738","relation":{},"ISSN":["2994-970X"],"issn-type":[{"value":"2994-970X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,6,19]]}}}