{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,29]],"date-time":"2026-09-29T17:55:16Z","timestamp":1790704516247,"version":"4.1.0"},"reference-count":90,"publisher":"Association for Computing Machinery (ACM)","issue":"7","funder":[{"name":"National Key Research and Development Program of China","award":["Grant No. 2024YFB4506300"],"award-info":[{"award-number":["Grant No. 2024YFB4506300"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["Grant Nos. 62322208, 12411530122"],"award-info":[{"award-number":["Grant Nos. 62322208, 12411530122"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"JSPS for the KAKENHI","award":["JP21H04877, JP22K18630"],"award-info":[{"award-number":["JP21H04877, JP22K18630"]}]},{"name":"Bilateral Program","award":["grant JPJSBP120239929"],"award-info":[{"award-number":["grant JPJSBP120239929"]}]},{"DOI":"10.13039\/501100002241","name":"Japan Science and Technology Agency","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100002241","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Adopting Sustainable Partnerships for Innovative Research Ecosystem","award":["Grant Nos JPMJAP2415"],"award-info":[{"award-number":["Grant Nos JPMJAP2415"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Softw. Eng. Methodol."],"published-print":{"date-parts":[[2026,7,31]]},"abstract":"<jats:p>Various Deep Learning-based approaches with pre-trained language models have been proposed for automatically repairing software vulnerabilities. However, these approaches are limited to a specific programming language (C\/C++). Recent advances in Large Language Models (LLMs) offer language-agnostic capabilities and strong semantic understanding, exhibiting potential to overcome multilingual vulnerability limitation. Although some work has begun to explore LLM\u2019s repair performance, their effectiveness is unsatisfactory. To address these limitations, we conducted a large-scale empirical study to investigate the performance of automated vulnerability repair approaches and state-of-the-art LLMs across seven programming languages. Results show GPT-4o, instruction-tuned with few-shot prompting, performs competitively against the leading approach, VulMaster. Additionally, the LLM-based approach shows superior performance in repairing unique vulnerabilities and is more likely to repair the most dangerous vulnerabilities. Instruction-tuned GPT-4o demonstrates strong generalization on vulnerabilities in previously unseen language, outperforming existing approaches. Analysis shows that Go consistently achieves the highest effectiveness across all model types, while C\/C++ performs the worst. Based on findings, we discuss the promising of LLM on multilingual vulnerability repair and reasons behind LLM failed cases. This work takes the first look at repair approaches and LLMs across multiple languages, highlighting the promising future of adopting LLMs to multilingual vulnerability repair.<\/jats:p>","DOI":"10.1145\/3771930","type":"journal-article","created":{"date-parts":[[2025,10,16]],"date-time":"2025-10-16T14:45:01Z","timestamp":1760625901000},"page":"1-34","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":4,"title":["On the Evaluation of Large Language Models in Multilingual Vulnerability Repair"],"prefix":"10.1145","volume":"35","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2004-0902","authenticated-orcid":false,"given":"Dong","family":"Wang","sequence":"first","affiliation":[{"name":"College of Intelligence and Computing, Tianjin University, Tianjin, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-1147-3685","authenticated-orcid":false,"given":"Junji","family":"Yu","sequence":"additional","affiliation":[{"name":"College of Intelligence and Computing, Tianjin University, Tianjin, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-7311-7060","authenticated-orcid":false,"given":"Honglin","family":"Shu","sequence":"additional","affiliation":[{"name":"Kyushu University, Fukuoka, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7211-3491","authenticated-orcid":false,"given":"Michael","family":"Fu","sequence":"additional","affiliation":[{"name":"The University of Melbourne, Melbourne, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5516-9984","authenticated-orcid":false,"given":"Chakkrit","family":"Tantithamthavorn","sequence":"additional","affiliation":[{"name":"Information Technology, Monash University, Clayton, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7058-1045","authenticated-orcid":false,"given":"Yasutaka","family":"Kamei","sequence":"additional","affiliation":[{"name":"Kyushu University, Fukuoka, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3056-9962","authenticated-orcid":false,"given":"Junjie","family":"Chen","sequence":"additional","affiliation":[{"name":"College of Intelligence and Computing, Tianjin University, Tianjin, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2026,7,11]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-022-10278-4"},{"key":"e_1_3_2_3_2","first-page":"780","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Berabi Berkay","year":"2021","unstructured":"Berkay Berabi, Jingxuan He, Veselin Raychev, and Martin Vechev. 2021. Tfix: Learning to fix coding errors with a text-to-text transformer. In Proceedings of the International Conference on Machine Learning. PMLR, 780\u2013791."},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1145\/3475960.3475985"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1145\/2382196.2382284"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","unstructured":"Max Brunsfeld. 2024. tree-sitter\/tree-sitter: V 0.23.0. DOI: 10.5281\/zenodo.13375512","DOI":"10.5281\/zenodo.13375512"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1145\/3524842.3528482"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1145\/3510003.3510219"},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-58452-8_13"},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1145\/3745764"},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2022.3147265"},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2022.3156637"},{"key":"e_1_3_2_13_2","first-page":"1","article-title":"Scaling instruction-finetuned language models","volume":"25","author":"Chung Hyung Won","year":"2022","unstructured":"Hyung Won Chung, Le Hou, Shayne Longpre, Barret Zoph, Yi Tay, William Fedus, Eric Li, Xuezhi Wang, Mostafa Dehghani, Siddhartha Brahma, et al. 2022. Scaling instruction-finetuned language models. Journal of Machine Learning Research 25 (2022), 1\u201353.","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_3_2_14_2","unstructured":"CVE. 2024. Overview. Retrieved from https:\/\/www.cve.org\/About\/Overview."},{"key":"e_1_3_2_15_2","unstructured":"CWE. 2024. About CWE. Retrieved from https:\/\/cwe.mitre.org\/about\/index.html."},{"key":"e_1_3_2_16_2","unstructured":"Abhimanyu Dubey Abhinav Jauhri Abhinav Pandey Abhishek Kadian Ahmad Al-Dahle Aiesha Letman Akhil Mathur Alan Schelten Amy Yang Angela Fan et al. 2024. The Llama 3 herd of models. arXiv:2407.21783. Retrieved from https:\/\/arxiv.org\/abs\/2407.21783"},{"key":"e_1_3_2_17_2","unstructured":"Edgescan. 2024. 2024 Vulnerability Statistics Report. Retrieved October 24 2024 from https:\/\/www.edgescan.com\/stats-report\/."},{"key":"e_1_3_2_18_2","doi-asserted-by":"crossref","unstructured":"Mohamad Fakih Rahul Dharmaji Halima Bouzidi Gustavo Quiros Araya Oluwatosin Ogundare and Mohammad Abdullah Al Faruque. 2025. LLM4CVE: Enabling iterative automated vulnerability repair with large language models. arXiv:2501.03446. Retrieved from https:\/\/arxiv.org\/abs\/2501.03446","DOI":"10.1109\/DSD67783.2025.00087"},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.1145\/3379597.3387501"},{"key":"e_1_3_2_20_2","doi-asserted-by":"crossref","unstructured":"Zhangyin Feng Daya Guo Duyu Tang Nan Duan Xiaocheng Feng Ming Gong Linjun Shou Bing Qin Ting Liu Daxin Jiang et al. 2020. CodeBERT: A pre-trained model for programming and natural languages. arXiv:2002.08155. Retrieved from https:\/\/arxiv.org\/abs\/2002.08155","DOI":"10.18653\/v1\/2020.findings-emnlp.139"},{"key":"e_1_3_2_21_2","unstructured":"Nicole Forsgren Bas Alberts Kevin Backhouse Grey Baker Greg Cecarelli Derek Jedamski Scot Kelly and Clair Sullivan. 2021. 2020 state of the Octoverse: Securing the world\u2019s software. arXiv:2110.10246. Retrieved from https:\/\/arxiv.org\/abs\/2110.10246"},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1145\/3632746"},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1145\/3540250.3549098"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1109\/APSEC60848.2023.00085"},{"key":"e_1_3_2_25_2","unstructured":"Yujia Fu Peng Liang Amjed Tahir Zengyang Li Mojtaba Shahin Jiaxin Yu and Jinfu Chen. 2023. Security weaknesses of Copilot generated code in GitHub. arXiv:2310.02059. Retrieved from https:\/\/arxiv.org\/abs\/2310.02059"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1145\/3531146.3533229"},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1109\/ASE56229.2023.00109"},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1145\/3196398.3196454"},{"key":"e_1_3_2_29_2","unstructured":"Daya Guo Shuo Ren Shuai Lu Zhangyin Feng Duyu Tang Shujie Liu Long Zhou Nan Duan Alexey Svyatkovskiy Shengyu Fu et al. 2020. Graphcodebert: Pre-training code representations with data flow. arXiv:2009.08366. Retrieved from https:\/\/arxiv.org\/abs\/2009.08366"},{"key":"e_1_3_2_30_2","unstructured":"Daya Guo Qihao Zhu Dejian Yang Zhenda Xie Kai Dong Wentao Zhang Guanting Chen Xiao Bi Yu Wu Y. K. Li et al. 2024. DeepSeek-Coder: When the large language model meets programming\u2013The rise of code intelligence. arXiv:2401.14196. Retrieved from https:\/\/arxiv.org\/abs\/2401.14196"},{"key":"e_1_3_2_31_2","volume-title":"Advances in Neural Information Processing Systems","author":"Harer Jacob","year":"2018","unstructured":"Jacob Harer, Onur Ozdemir, Tomo Lazovich, Christopher Reale, Rebecca Russell, Louis Kim, and Peter Chin. 2018. Learning to repair software vulnerabilities with generative adversarial networks. In Advances in Neural Information Processing Systems, S. Bengio, H. Wallach, H. Larochelle, K. Grauman, N. Cesa-Bianchi, and R. Garnett (Eds.), Vol. 31. Curran Associates Inc. Retrieved from https:\/\/proceedings.neurips.cc\/paper_files\/paper\/2018\/file\/68abef8ee1ac9b664a90b0bbaff4f770-Paper.pdf."},{"key":"e_1_3_2_32_2","unstructured":"Homepage. 2024. Retrieved from https:\/\/github.com\/salted-yu\/AVRStudy"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICST62969.2025.10988971"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1145\/3695988"},{"key":"e_1_3_2_35_2","unstructured":"Edward J. Hu Yelong Shen Phillip Wallis Zeyuan Allen-Zhu Yuanzhi Li Shean Wang Lu Wang and Weizhu Chen. 2021. LoRA: Low-rank adaptation of large language models. arXiv:2106.09685. Retrieved from https:\/\/arxiv.org\/abs\/2106.09685"},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1145\/3597503.3639230"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.eacl-main.74"},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.1109\/DSC.2018.00017"},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.52202\/068431-1613"},{"key":"e_1_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.1145\/3664646.3664770"},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.1145\/3540250.3549173"},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.1145\/3540250.3549081"},{"key":"e_1_3_2_43_2","first-page":"74","volume-title":"Proceedings of the Text Summarization Branches out","author":"Lin Chin-Yew","year":"2004","unstructured":"Chin-Yew Lin. 2004. Rouge: A package for automatic evaluation of summaries. In Proceedings of the Text Summarization Branches out, 74\u201381."},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.bjoms.2007.09.002"},{"key":"e_1_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.1145\/3180155.3180201"},{"key":"e_1_3_2_46_2","unstructured":"MITRE Corporation. 2023. CWE-1000: Research Concepts. Retrieved July 29 2025 from https:\/\/cwe.mitre.org\/data\/definitions\/1000.html."},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2024.findings-acl.883"},{"key":"e_1_3_2_48_2","unstructured":"Manisha Mukherjee and Vincent J. Hellendoorn. 2023. Stack over-flowing with results: The case for domain-specific pre-training over one-size-fits-all models. arXiv:2306.03268v1. Retrieved from https:\/\/arxiv.org\/abs\/2306.03268v1"},{"key":"e_1_3_2_49_2","unstructured":"National Institute of Standards and Technology (NIST). 2024. Software Vulnerability\u2014Glossary\u2014CSRC. Retrieved October 19 2024 from https:\/\/csrc.nist.gov\/glossary\/term\/software_vulnerability."},{"key":"e_1_3_2_50_2","unstructured":"Erik Nijkamp Bo Pang Hiroaki Hayashi Lifu Tu Huan Wang Yingbo Zhou Silvio Savarese and Caiming Xiong. 2022. Codegen: An open large language model for code with multi-turn program synthesis. arXiv:2203.13474. Retrieved from https:\/\/arxiv.org\/abs\/2203.13474"},{"key":"e_1_3_2_51_2","doi-asserted-by":"publisher","unstructured":"Vadim Okun Aurelien Delaitre Paul E. Black. 2013. Report on the static analysis tool exposition (SATE) IV. Special Publication (NIST SP) 500-297. National Institute of Standards and Technology. DOI: 10.6028\/NIST.SP.500-297","DOI":"10.6028\/NIST.SP.500-297"},{"key":"e_1_3_2_52_2","unstructured":"OpenAI. 2022. ChatGPT: Optimizing Language Models for Dialogue. Retrieved from https:\/\/openai.com\/blog\/chatgpt."},{"key":"e_1_3_2_53_2","unstructured":"OpenAI. 2024. Home. Retrieved from https:\/\/openai.com\/."},{"key":"e_1_3_2_54_2","unstructured":"OpenAI. 2024. GPT-4o: A Flagship Model by OpenAI. Retrieved October 19 2024 from https:\/\/openai.com\/index\/gpt-4o-and-more-tools-to-chatgpt-free."},{"key":"e_1_3_2_55_2","doi-asserted-by":"publisher","DOI":"10.52202\/068431-2011"},{"key":"e_1_3_2_56_2","first-page":"311","volume-title":"Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics","author":"Papineni Kishore","year":"2002","unstructured":"Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. BLEU: A method for automatic evaluation of machine translation. In Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics, 311\u2013318."},{"key":"e_1_3_2_57_2","doi-asserted-by":"publisher","DOI":"10.1109\/SP46215.2023.10179324"},{"key":"e_1_3_2_58_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2024.107523"},{"issue":"8","key":"e_1_3_2_59_2","first-page":"9","article-title":"Language models are unsupervised multitask learners","volume":"1","author":"Radford Alec","year":"2019","unstructured":"Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever. 2019. Language models are unsupervised multitask learners. OpenAI Blog 1, 8 (2019), 9.","journal-title":"OpenAI Blog"},{"issue":"140","key":"e_1_3_2_60_2","first-page":"1","article-title":"Exploring the limits of transfer learning with a unified text-to-text transformer","volume":"21","author":"Raffel Colin","year":"2020","unstructured":"Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J. Liu. 2020. Exploring the limits of transfer learning with a unified text-to-text transformer. Journal of Machine Learning Research 21, 140 (2020), 1\u201367.","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_3_2_61_2","unstructured":"Sofia Reis and Rui Abreu. 2021. A ground-truth dataset of real security patches. arXiv:2110.09635. Retrieved from https:\/\/arxiv.org\/abs\/2110.09635"},{"key":"e_1_3_2_62_2","doi-asserted-by":"publisher","DOI":"10.1561\/1500000019"},{"key":"e_1_3_2_63_2","unstructured":"Baptiste Roziere Jonas Gehring Fabian Gloeckle Sten Sootla Itai Gat Xiaoqing Ellen Tan Yossi Adi Jingyu Liu Tal Remez J\u00e9r\u00e9my Rapin et al. 2023. Code LLAMA: Open foundation models for code. arXiv:2308.12950. Retrieved from https:\/\/arxiv.org\/abs\/2308.12950"},{"key":"e_1_3_2_64_2","unstructured":"Rico Sennrich. 2015. Neural machine translation of rare words with subword units. arXiv:1508.07909. Retrieved from https:\/\/arxiv.org\/abs\/1508.07909"},{"key":"e_1_3_2_65_2","doi-asserted-by":"publisher","DOI":"10.1145\/3433210.3437528"},{"key":"e_1_3_2_66_2","unstructured":"Ze Sheng Zhicheng Chen Shuning Gu Heqing Huang Guofei Gu and Jeff Huang. 2025. LLMs in software security: A survey of vulnerability detection techniques and insights. arXiv:2502.07049. Retrieved from https:\/\/arxiv.org\/abs\/2502.07049"},{"issue":"3","key":"e_1_3_2_67_2","first-page":"1","article-title":"A systematic literature review on automated software vulnerability detection using machine learning","volume":"5","author":"Harzevili Nima Shiri","year":"2024","unstructured":"Nima Shiri Harzevili, Alvine Boaye Belle, Junjie Wang, Song Wang, Zhen Ming Jiang, and Nachiappan Nagappan. 2024. A systematic literature review on automated software vulnerability detection using machine learning. ACM Computing Surveys 5s7, 3 (2024), 1\u201336.","journal-title":"ACM Computing Surveys"},{"key":"e_1_3_2_68_2","doi-asserted-by":"publisher","DOI":"10.1145\/3759915"},{"key":"e_1_3_2_69_2","unstructured":"The MITRE Corporation. 2024. CVE Metrics\u2014Common Vulnerabilities and Exposures. Retrieved October 19 2024 from https:\/\/www.cve.org\/About\/Metrics."},{"key":"e_1_3_2_70_2","doi-asserted-by":"crossref","unstructured":"Zhao Tian Honglin Shu Dong Wang Xuejie Cao Yasutaka Kamei and Junjie Chen. 2024. Large language models for equivalent mutant detection: How far are We? arXiv:2408.01760. Retrieved from https:\/\/arxiv.org\/abs\/2408.01760","DOI":"10.1145\/3650212.3680395"},{"key":"e_1_3_2_71_2","doi-asserted-by":"publisher","DOI":"10.1109\/ASE56229.2023.00199"},{"key":"e_1_3_2_72_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2024.3368208"},{"key":"e_1_3_2_73_2","unstructured":"Jiexin Wang Xitong Luo Liuwen Cao Hongkui He Hailin Huang Jiayuan Xie Adam Jatowt and Yi Cai. 2024. Is your AI-generated code really safe? Evaluating large language models on secure code generation with CodeSecEval. arXiv:2407.02395. Retrieved from https:\/\/arxiv.org\/abs\/2407.02395"},{"key":"e_1_3_2_74_2","doi-asserted-by":"publisher","DOI":"10.1145\/3551349.3559549"},{"key":"e_1_3_2_75_2","doi-asserted-by":"crossref","unstructured":"Yue Wang Weishi Wang Shafiq Joty and Steven C. H. Hoi. 2021. Codet5: Identifier-aware unified pre-trained encoder-decoder models for code understanding and generation. arXiv:2109.00859. Retrieved from https:\/\/arxiv.org\/abs\/2109.00859","DOI":"10.18653\/v1\/2021.emnlp-main.685"},{"key":"e_1_3_2_76_2","unstructured":"Jason Wei Yi Tay Rishi Bommasani Colin Raffel Barret Zoph Sebastian Borgeaud Dani Yogatama Maarten Bosma Denny Zhou Donald Metzler et al. 2022. Emergent abilities of large language models. arXiv:2206.07682. Retrieved from https:\/\/arxiv.org\/abs\/2206.07682"},{"key":"e_1_3_2_77_2","doi-asserted-by":"publisher","DOI":"10.52202\/068431-1800"},{"key":"e_1_3_2_78_2","unstructured":"WhiteSource. 2022. Mend Bolt. Retrieved from https:\/\/www.mend.io\/free-developer-tools\/bolt."},{"key":"e_1_3_2_79_2","unstructured":"Thomas Wolf Lysandre Debut Victor Sanh Julien Chaumond Clement Delangue Anthony Moi Pierric Cistac Tim Rault R\u00e9mi Louf Morgan Funtowicz et al. 2019. Huggingface\u2019s transformers: State-of-the-art natural language processing. arXiv:1910.03771. Retrieved from https:\/\/arxiv.org\/abs\/1910.03771"},{"key":"e_1_3_2_80_2","doi-asserted-by":"publisher","DOI":"10.1145\/3597926.3598135"},{"key":"e_1_3_2_81_2","doi-asserted-by":"publisher","DOI":"10.1145\/3520312.3534862"},{"key":"e_1_3_2_82_2","doi-asserted-by":"publisher","DOI":"10.52202\/075280-0517"},{"key":"e_1_3_2_83_2","doi-asserted-by":"publisher","DOI":"10.1145\/3650212.3680359"},{"key":"e_1_3_2_84_2","doi-asserted-by":"publisher","DOI":"10.1145\/3713081.3731746"},{"key":"e_1_3_2_85_2","unstructured":"Zhiqiang Yuan Junwei Liu Qiancheng Zi Mingwei Liu Xin Peng and Yiling Lou. 2023. Evaluating instruction-tuned large language models on code comprehension and generation. arXiv:2308.01240. Retrieved from https:\/\/arxiv.org\/abs\/2308.01240"},{"key":"e_1_3_2_86_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2021.3058985"},{"key":"e_1_3_2_87_2","doi-asserted-by":"publisher","DOI":"10.1145\/3643651.3659892"},{"key":"e_1_3_2_88_2","doi-asserted-by":"publisher","DOI":"10.1109\/TDSC.2023.3308897"},{"issue":"5","key":"e_1_3_2_89_2","first-page":"31","article-title":"Large language model for vulnerability detection and repair: Literature review and the road ahead","volume":"34","author":"Zhou Xin","year":"2024","unstructured":"Xin Zhou, Sicong Cao, Xiaobing Sun, and David Lo. 2024. Large language model for vulnerability detection and repair: Literature review and the road ahead. ACM Transactions on Software Engineering and Methodology 34, 5, Article 145 (2024), 31 pages.","journal-title":"ACM Transactions on Software Engineering and Methodology"},{"key":"e_1_3_2_90_2","doi-asserted-by":"publisher","DOI":"10.1145\/3597503.3639222"},{"key":"e_1_3_2_91_2","unstructured":"Xizhou Zhu Weijie Su Lewei Lu Bin Li Xiaogang Wang and Jifeng Dai. 2020. Deformable DETR: Deformable transformers for end-to-end object detection. arXiv:2010.04159. Retrieved from https:\/\/arxiv.org\/abs\/2010.04159"}],"container-title":["ACM Transactions on Software Engineering and Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3771930","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,7,11]],"date-time":"2026-07-11T15:03:41Z","timestamp":1783782221000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3771930"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,7,11]]},"references-count":90,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2026,7,31]]}},"alternative-id":["10.1145\/3771930"],"URL":"https:\/\/doi.org\/10.1145\/3771930","relation":{},"ISSN":["1049-331X","1557-7392"],"issn-type":[{"value":"1049-331X","type":"print"},{"value":"1557-7392","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,7,11]]},"assertion":[{"value":"2024-12-27","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-10-04","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-07-11","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}