{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,18]],"date-time":"2026-11-18T01:22:04Z","timestamp":1794964924184,"version":"4.9.1"},"reference-count":223,"publisher":"Association for Computing Machinery (ACM)","issue":"7","license":[{"start":{"date-parts":[[2026,6,17]],"date-time":"2026-06-17T00:00:00Z","timestamp":1781654400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/legalcode"}],"funder":[{"name":"National Key Research and Development Program of China","award":["2024YFF0908001"],"award-info":[{"award-number":["2024YFF0908001"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["U24A20337 and 62372228"],"award-info":[{"award-number":["U24A20337 and 62372228"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"National Research Foundation, Singapore, and DSO National Laboratories under the AI Singapore Programme","award":["AISG2-GC-2023-008"],"award-info":[{"award-number":["AISG2-GC-2023-008"]}],"id":[{"id":"https:\/\/ror.org\/00ntacr26","id-type":"ROR","asserted-by":"crossref"}]},{"name":"National Research Foundation, Singapore, and the Cyber Security Agency of Singapore","award":["NCRP25-P04-TAICeN"],"award-info":[{"award-number":["NCRP25-P04-TAICeN"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Softw. Eng. Methodol."],"published-print":{"date-parts":[[2026,7,31]]},"abstract":"<jats:p>Language Models for Code (CodeLMs) have emerged as powerful tools for code-related tasks, outperforming traditional methods and standard machine learning approaches. However, these models are susceptible to security vulnerabilities, drawing increasing research attention from domains such as software engineering, AI, and cybersecurity. Despite the growing body of research focused on the security of CodeLMs, a comprehensive survey in this area remains absent. To address this gap, we systematically review 68 relevant papers, organizing them based on attack and defense strategies. Furthermore, we provide an overview of commonly used language models, datasets, and evaluation metrics, and highlight open source tools and promising directions for future research in securing CodeLMs.<\/jats:p>","DOI":"10.1145\/3735554","type":"journal-article","created":{"date-parts":[[2025,8,12]],"date-time":"2025-08-12T19:39:02Z","timestamp":1755027542000},"page":"1-65","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":14,"title":["Security of Language Models for Code: A Systematic Literature Review"],"prefix":"10.1145","volume":"35","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3380-5564","authenticated-orcid":false,"given":"Yuchen","family":"Chen","sequence":"first","affiliation":[{"name":"State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9236-8264","authenticated-orcid":false,"given":"Weisong","family":"Sun","sequence":"additional","affiliation":[{"name":"Nanyang Technological University, Singapore, Singapore"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9930-7111","authenticated-orcid":false,"given":"Chunrong","family":"Fang","sequence":"additional","affiliation":[{"name":"State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4765-1893","authenticated-orcid":false,"given":"Zhenpeng","family":"Chen","sequence":"additional","affiliation":[{"name":"Nanyang Technological University, Singapore, Singapore"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-0957-854X","authenticated-orcid":false,"given":"Yifei","family":"Ge","sequence":"additional","affiliation":[{"name":"State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1821-611X","authenticated-orcid":false,"given":"Tingxu","family":"Han","sequence":"additional","affiliation":[{"name":"State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2495-3805","authenticated-orcid":false,"given":"Quanjun","family":"Zhang","sequence":"additional","affiliation":[{"name":"State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7300-9215","authenticated-orcid":false,"given":"Yang","family":"Liu","sequence":"additional","affiliation":[{"name":"Nanyang Technological University, Singapore, Singapore"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9592-7022","authenticated-orcid":false,"given":"Zhenyu","family":"Chen","sequence":"additional","affiliation":[{"name":"State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7743-1296","authenticated-orcid":false,"given":"Baowen","family":"Xu","sequence":"additional","affiliation":[{"name":"State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2026,6,17]]},"reference":[{"key":"e_1_3_2_2_2","first-page":"101","volume-title":"Proceedings of the 2018 ACM Conference on Computer and Communications Security","author":"Abuhamad Mohammed","year":"2018","unstructured":"Mohammed Abuhamad, Tamer AbuHmed, Aziz Mohaisen, and DaeHun Nyang. 2018. Large-scale and language-oblivious code authorship identification. In Proceedings of the 2018 ACM Conference on Computer and Communications Security. ACM, 101\u2013114."},{"key":"e_1_3_2_3_2","unstructured":"Mohammed Abuhamad Changhun Jung David Mohaisen and DaeHun Nyang. 2023. SHIELD: Thwarting code authorship attribution. arXiv:2304.13255. Retrieved from https:\/\/arxiv.org\/abs\/2304.13255"},{"key":"e_1_3_2_4_2","first-page":"1122","volume-title":"Proceedings of the IEEE Symposium on Security and Privacy","author":"Aghakhani Hojjat","year":"2024","unstructured":"Hojjat Aghakhani, Wei Dai, Andre Manoel, Xavier Fernandes, Anant Kharkar, Christopher Kruegel, Giovanni Vigna, David Evans, Ben Zorn, and Robert Sim. 2024. TrojanPuzzle: Covertly poisoning code-suggestion models. In Proceedings of the IEEE Symposium on Security and Privacy. IEEE, 1122\u20131140."},{"key":"e_1_3_2_5_2","doi-asserted-by":"crossref","first-page":"4998","DOI":"10.18653\/v1\/2020.acl-main.449","volume-title":"Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics","author":"Ahmad Wasi Uddin","year":"2020","unstructured":"Wasi Uddin Ahmad, Saikat Chakraborty, Baishakhi Ray, and Kai-Wei Chang. 2020. A transformer-based approach for source code summarization. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, 4998\u20135007."},{"key":"e_1_3_2_6_2","first-page":"2655","volume-title":"Proceedings of the 25th Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies","author":"Ahmad Wasi Uddin","year":"2021","unstructured":"Wasi Uddin Ahmad, Saikat Chakraborty, Baishakhi Ray, and Kai-Wei Chang. 2021. Unified pre-training for program understanding and generation. In Proceedings of the 25th Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Association for Computational Linguistics, 2655\u20132668."},{"key":"e_1_3_2_7_2","doi-asserted-by":"crossref","first-page":"467","DOI":"10.1007\/978-3-031-49011-8_37","volume-title":"Proceedings of the 22nd Conference on Artificial Intelligence","volume":"14116","author":"Ahmed Areeg","year":"2023","unstructured":"Areeg Ahmed, Shahira Azab, and Yasser Abdelhamid. 2023. Source-code generation using deep learning: A survey. In Proceedings of the 22nd Conference on Artificial Intelligence. Lecture Notes in Computer Science, Vol. 14116, Springer, 467\u2013482."},{"key":"e_1_3_2_8_2","first-page":"1","volume-title":"Proceedings of the 46th IEEE\/ACM International Conference on Software Engineering","volume":"78","author":"Al-Kaswan Ali","year":"2024","unstructured":"Ali Al-Kaswan, Maliheh Izadi, and Arie van Deursen. 2024. Traces of memorisation in large language models for code. In Proceedings of the 46th IEEE\/ACM International Conference on Software Engineering. ACM, Article 78, 1\u201312."},{"key":"e_1_3_2_9_2","unstructured":"Loubna Ben Allal Raymond Li Denis Kocetkov Chenghao Mou Christopher Akiki Carlos Mu\u00f1oz Ferrandis Niklas Muennighoff Mayank Mishra Alex Gu Manan Dey et al. 2023. SantaCoder: Don\u2019t reach for the stars! arXiv:2301.03988. Retrieved from https:\/\/arxiv.org\/abs\/2301.03988"},{"key":"e_1_3_2_10_2","first-page":"1","volume-title":"Proceedings of the 7th International Conference on Learning Representations","author":"Alon Uri","year":"2019","unstructured":"Uri Alon, Shaked Brody, Omer Levy, and Eran Yahav. 2019. code2seq: Generating sequences from structured representations of code. In Proceedings of the 7th International Conference on Learning Representations. OpenReview.net, 1\u201313."},{"key":"e_1_3_2_11_2","first-page":"245","volume-title":"Proceedings of the 37th International Conference on Machine Learning, Virtual EventProceedings of Machine Learning Research","volume":"119","author":"Alon Uri","year":"2020","unstructured":"Uri Alon, Roy Sadaka, Omer Levy, and Eran Yahav. 2020. Structural language models of code. In Proceedings of the 37th International Conference on Machine Learning, Virtual Event. Proceedings of Machine Learning Research, Vol. 119, PMLR, 245\u2013256."},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1145\/3290353"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D18-1316"},{"key":"e_1_3_2_14_2","unstructured":"Amazon. 2023. Amazon CodeWhisperer. Retrieved from https:\/\/aws.amazon.com\/cn\/codewhisperer\/"},{"key":"e_1_3_2_15_2","first-page":"1","volume-title":"Proceedings of the 35th Advances in Programming Languages and Neurosymbolic Systems Workshop","author":"Anand Mrinal","year":"2021","unstructured":"Mrinal Anand, Pratik Kayal, and Mayank Singh. 2021. Adversarial robustness of program synthesis models. In Proceedings of the 35th Advances in Programming Languages and Neurosymbolic Systems Workshop. CEUR-WS.org, 1\u20137."},{"key":"e_1_3_2_16_2","unstructured":"Mrinal Anand Pratik Kayal and Mayank Singh. 2021. On adversarial robustness of synthetic code generation. arXiv:2106.11629. Retrieved from https:\/\/arxiv.org\/abs\/2106.11629"},{"key":"e_1_3_2_17_2","unstructured":"Hyrum S. Anderson and Phil Roth. 2018. EMBER: An open dataset for training static PE malware machine learning models. arXiv:1804.04637. Retrieved from https:\/\/arxiv.org\/abs\/1804.04637"},{"key":"e_1_3_2_18_2","first-page":"1","volume-title":"Proceedings of the 21st Annual Network and Distributed System Security Symposium. The Internet Society","author":"Arp Daniel","year":"2014","unstructured":"Daniel Arp, Michael Spreitzenbarth, Malte Hubner, Hugo Gascon, and Konrad Rieck. 2014. DREBIN: Effective and explainable detection of Android malware in your pocket. In Proceedings of the 21st Annual Network and Distributed System Security Symposium. The Internet Society, 1\u201316."},{"key":"e_1_3_2_19_2","doi-asserted-by":"crossref","unstructured":"M. D. Awal Mrigank Rochan and Chanchal K. Roy. 2024. Investigating adversarial attacks in software analytics via machine learning explainability. arXiv:2408.04124. Retrieved from https:\/\/arxiv.org\/abs\/2408.04124","DOI":"10.1007\/s11219-025-09727-2"},{"key":"e_1_3_2_20_2","first-page":"1","volume-title":"Proceedings of the 3rd International Conference on Learning Representations","author":"Bahdanau Dzmitry","year":"2015","unstructured":"Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2015. Neural machine translation by jointly learning to align and translate. In Proceedings of the 3rd International Conference on Learning Representations. OpenReview.net, 1\u201315."},{"key":"e_1_3_2_21_2","first-page":"896","volume-title":"Proceedings of the 37th International Conference on Machine Learning, Virtual Event","volume":"119","author":"Bielik Pavol","year":"2020","unstructured":"Pavol Bielik and Martin T. Vechev. 2020. Adversarial robustness for code. In Proceedings of the 37th International Conference on Machine Learning, Virtual Event, Vol. 119, PMLR, 896\u2013907."},{"key":"e_1_3_2_22_2","first-page":"1","volume-title":"Proceedings of the 7th International Conference on Learning Representations","author":"Brockschmidt Marc","year":"2019","unstructured":"Marc Brockschmidt, Miltiadis Allamanis, Alexander L. Gaunt, and Oleksandr Polozov. 2019. Generative code modeling with graphs. In Proceedings of the 7th International Conference on Learning Representations. OpenReview.net, 1\u201324."},{"key":"e_1_3_2_23_2","unstructured":"Gianluca Capozzi Daniele Cono D\u2019Elia Giuseppe Antonio Di Luna and Leonardo Querzoni. 2023. Adversarial attacks against binary similarity systems. arXiv:2303.11143. Retrieved from https:\/\/arxiv.org\/abs\/2303.11143"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1109\/SP.2017.49"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1049\/cit2.12028"},{"key":"e_1_3_2_26_2","first-page":"1","volume-title":"Proceedings of the 33rd AAAI Conference on Artificial IntelligenceCEUR Workshop Proceedings","volume":"2301","author":"Chen Bryant","year":"2019","unstructured":"Bryant Chen, Wilka Carvalho, Nathalie Baracaldo, Heiko Ludwig, Benjamin Edwards, Taesung Lee, Ian M. Molloy, and Biplav Srivastava. 2019. Detecting backdoor attacks on deep neural networks by activation clustering. In Proceedings of the 33rd AAAI Conference on Artificial Intelligence. CEUR Workshop Proceedings, Vol. 2301, CEUR-WS.org, 1\u201310."},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2021.04.105"},{"key":"e_1_3_2_28_2","doi-asserted-by":"crossref","unstructured":"Long Chen Wujing Zhan Wei Tian Yuhang He and Qin Zou. 2019. Deep integration: A multi-label architecture for road scene recognition. IEEE Transactions on Image Processing 28 10 (2019) 4883\u20134898.","DOI":"10.1109\/TIP.2019.2913079"},{"key":"e_1_3_2_29_2","first-page":"173","volume-title":"Proceedings of the 26th International Conference on Engineering of Complex Computer Systems","author":"Chen Penglong","year":"2022","unstructured":"Penglong Chen, Zhen Li, Yu Wen, and Lili Liu. 2022. Generating adversarial source programs using important tokens-based structural transformations. In Proceedings of the 26th International Conference on Engineering of Complex Computer Systems. IEEE, 173\u2013182."},{"key":"e_1_3_2_30_2","unstructured":"Yuchen Chen and Weisong Sun. 2024. Artifacts of This Paper. Retrieved from October 1 2024 from https:\/\/github.com\/wssun\/TiSE-LM4Code-Security"},{"key":"e_1_3_2_31_2","first-page":"750","volume-title":"Proceedings of the 28th Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, Virtual Event","author":"Chen Zhenpeng","year":"2020","unstructured":"Zhenpeng Chen, Yanbin Cao, Yuanqiang Liu, Haoyu Wang, Tao Xie, and Xuanzhe Liu. 2020. A comprehensive study on challenges in deploying deep learning based software. In Proceedings of the 28th Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, Virtual Event. ACM, 750\u2013762."},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.1145\/3338906.3338977"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1145\/3308558.3313600"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE43902.2021.00068"},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/W14-4012"},{"key":"e_1_3_2_36_2","doi-asserted-by":"crossref","first-page":"5490","DOI":"10.18653\/v1\/2022.emnlp-main.369","volume-title":"Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing","author":"Choi YunSeok","year":"2022","unstructured":"YunSeok Choi, Hyojun Kim, and Jee-Hyong Lee. 2022. TABS: Efficient textual adversarial attack for pre-trained NL code model using semantic beam search. In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 5490\u20135498."},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1145\/3643916.3644416"},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.1109\/TASL.2011.2134090"},{"key":"e_1_3_2_39_2","first-page":"4171","volume-title":"Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies","author":"Devlin Jacob","year":"2019","unstructured":"Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Association for Computational Linguistics, 4171\u20134186."},{"key":"e_1_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.1145\/3611643.3616356"},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2024.3422274"},{"key":"e_1_3_2_42_2","doi-asserted-by":"crossref","first-page":"1536","DOI":"10.18653\/v1\/2020.findings-emnlp.139","volume-title":"Proceedings of the Findings of the Association for Computational Linguistics (Findings of ACL, EMNLP \u201920)","author":"Feng Zhangyin","year":"2020","unstructured":"Zhangyin Feng, Daya Guo, Duyu Tang, Nan Duan, Xiaocheng Feng, Ming Gong, Linjun Shou, Bing Qin, Ting Liu, Daxin Jiang, and Ming Zhou. 2020. CodeBERT: A pre-trained model for programming and natural languages. In Proceedings of the Findings of the Association for Computational Linguistics (Findings of ACL, EMNLP \u201920). Association for Computational Linguistics, 1536\u20131547."},{"key":"e_1_3_2_43_2","doi-asserted-by":"crossref","first-page":"1889","DOI":"10.1145\/3449726.3463222","volume-title":"Proceedings of the 21st Genetic and Evolutionary Computation Conference, Companion Volume","author":"Ferretti Claudio","year":"2021","unstructured":"Claudio Ferretti and Martina Saletta. 2021. Deceiving neural source code classifiers: Finding adversarial examples with grammatical evolution. In Proceedings of the 21st Genetic and Evolutionary Computation Conference, Companion Volume. ACM, 1889\u20131897."},{"key":"e_1_3_2_44_2","first-page":"1","volume-title":"Proceedings of the 11th International Conference on Learning Representations","author":"Fried Daniel","year":"2023","unstructured":"Daniel Fried, Armen Aghajanyan, Jessy Lin, Sida Wang, Eric Wallace, Freda Shi, Ruiqi Zhong, Scott Yih, Luke Zettlemoyer, and Mike Lewis. 2023. InCoder: A generative model for code infilling and synthesis. In Proceedings of the 11th International Conference on Learning Representations. OpenReview.net, 1\u201314."},{"key":"e_1_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.1145\/3591227"},{"key":"e_1_3_2_46_2","unstructured":"Xiuting Ge Chunrong Fang Xuanye Li Weisong Sun Daoyuan Wu Juan Zhai Shangwei Lin Zhihong Zhao Yang Liu and Zhenyu Chen. 2024. Machine learning for actionable warning identification: A comprehensive survey. ACM Computing Surveys 1 1 (2024) 1\u201334."},{"key":"e_1_3_2_47_2","unstructured":"GitHub. 2023. GitHub Copilot. Retrieved from https:\/\/copilot.github.com"},{"key":"e_1_3_2_48_2","unstructured":"Tianyu Gu Brendan Dolan-Gavitt and Siddharth Garg. 2017. BadNets: Identifying vulnerabilities in the machine learning model supply chain. arXiv:1708.06733. Retrieved from https:\/\/arxiv.org\/abs\/1708.06733"},{"key":"e_1_3_2_49_2","doi-asserted-by":"publisher","DOI":"10.1145\/3180155.3180167"},{"key":"e_1_3_2_50_2","first-page":"1","volume-title":"Proceedings of the 9th International Conference on Learning Representations","author":"Guo Daya","year":"2021","unstructured":"Daya Guo, Shuo Ren, Shuai Lu, Zhangyin Feng, Duyu Tang, Shujie Liu, Long Zhou, Nan Duan, Alexey Svyatkovskiy, Shengyu Fu, et al. 2021. GraphCodeBERT: Pre-training code representations with data flow. In Proceedings of the 9th International Conference on Learning Representations. OpenReview.net, 1\u201318."},{"key":"e_1_3_2_51_2","doi-asserted-by":"crossref","unstructured":"Rajarshi Haldar Lingfei Wu Jinjun Xiong and Julia Hockenmaier. 2020. A multi-perspective architecture for semantic code search. arXiv:2005.06980. Retrieved from https:\/\/arxiv.org\/abs\/2005.06980","DOI":"10.18653\/v1\/2020.acl-main.758"},{"key":"e_1_3_2_52_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.aiopen.2021.08.002"},{"key":"e_1_3_2_53_2","doi-asserted-by":"publisher","DOI":"10.1145\/3379597.3387449"},{"key":"e_1_3_2_54_2","doi-asserted-by":"publisher","DOI":"10.1145\/3576915.3623175"},{"key":"e_1_3_2_55_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90"},{"key":"e_1_3_2_56_2","first-page":"1","volume-title":"Proceedings of the 46th IEEE\/ACM International Conference on Software Engineering","volume":"172","author":"He Shuai","year":"2024","unstructured":"Shuai He, Cai Fu, Hong Hu, Jiahe Chen, Jianqiang Lv, and Shuai Jiang. 2024. MalwareTotal: Multi-faceted and sequence-aware bypass tactics against static malware detection. In Proceedings of the 46th IEEE\/ACM International Conference on Software Engineering. ACM, Article 172, 1\u201312."},{"key":"e_1_3_2_57_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2020.3034721"},{"key":"e_1_3_2_58_2","first-page":"1","volume-title":"Proceedings of the Neural Information Processing Systems Track on Datasets and Benchmarks, Virtual","author":"Hendrycks Dan","year":"2021","unstructured":"Dan Hendrycks, Steven Basart, Saurav Kadavath, Mantas Mazeika, Akul Arora, Ethan Guo, Collin Burns, Samir Puranik, Horace He, Dawn Song, and Jacob Steinhardt. 2021. Measuring coding challenge competence with APPS. In Proceedings of the Neural Information Processing Systems Track on Datasets and Benchmarks, Virtual. OpenReview.net, 1\u201322."},{"key":"e_1_3_2_59_2","first-page":"526","volume-title":"Proceedings of the IEEE International Conference on Software Analysis, Evolution and Reengineering","author":"Henkel Jordan","year":"2022","unstructured":"Jordan Henkel, Goutham Ramakrishnan, Zi Wang, Aws Albarghouthi, Somesh Jha, and Thomas W. Reps. 2022. Semantic robustness of models of source code. In Proceedings of the IEEE International Conference on Software Analysis, Evolution and Reengineering. IEEE, 526\u2013537."},{"key":"e_1_3_2_60_2","doi-asserted-by":"publisher","DOI":"10.1145\/2902362"},{"key":"e_1_3_2_61_2","doi-asserted-by":"publisher","DOI":"10.1109\/MSP.2012.2205597"},{"key":"e_1_3_2_62_2","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1997.9.8.1735"},{"key":"e_1_3_2_63_2","unstructured":"Jordan Hoffmann Sebastian Borgeaud Arthur Mensch Elena Buchatskaya Trevor Cai Eliza Rutherford Diego de Las Casas Lisa Anne Hendricks Johannes Welbl Aidan Clark et al. 2022. Training compute-optimal large language models. arXiv:2203.15556. Retrieved from https:\/\/arxiv.org\/abs\/2203.15556"},{"key":"e_1_3_2_64_2","doi-asserted-by":"crossref","unstructured":"Xinyi Hou Yanjie Zhao Yue Liu Zhou Yang Kailong Wang Li Li Xiapu Luo David Lo John Grundy and Haoyu Wang. 2024. Large language models for software engineering: A systematic literature review. ACM Transactions on Software Engineering and Methodology 33 8 Article 220 (2024) 1\u201379.","DOI":"10.1145\/3695988"},{"key":"e_1_3_2_65_2","unstructured":"Yizhan Huang Yichen Li Weibin Wu Jianping Zhang and Michael R. Lyu. 2023. Do not give away my secrets: Uncovering the privacy issue of neural code completion tools. arXiv:2309.07639. Retrieved from https:\/\/arxiv.org\/abs\/2309.07639"},{"key":"e_1_3_2_66_2","unstructured":"Hamel Husain Ho-Hsiang Wu Tiferet Gazit Miltiadis Allamanis and Marc Brockschmidt. 2019. CodeSearchNet challenge: Evaluating the state of semantic code search. arXiv:1909.09436. Retrieved from https:\/\/arxiv.org\/abs\/1909.09436"},{"key":"e_1_3_2_67_2","doi-asserted-by":"crossref","unstructured":"Aftab Hussain Md. Rafiqul Islam Rabin Toufique Ahmed Mohammad Amin Alipour and Bowen Xu. 2023. Occlusion-based detection of trojan-triggering inputs in large language models of code. arXiv:2312.04004. Retrieved from https:\/\/arxiv.org\/abs\/2312.04004","DOI":"10.2139\/ssrn.4798300"},{"key":"e_1_3_2_68_2","unstructured":"Aftab Hussain Md. Rafiqul Islam Rabin Toufique Ahmed Bowen Xu Prem Devanbu and Mohammad Amin Alipour. 2023. A survey of trojans in neural models of source code: Taxonomy and techniques. arXiv:2305.03803. Retrieved from https:\/\/arxiv.org\/abs\/2305.03803"},{"key":"e_1_3_2_69_2","unstructured":"Aftab Hussain Md Rafiqul Islam Rabin and Mohammad Amin Alipour. 2023. TrojanedCM: A repository for poisoned neural models of source code. arXiv:2312.04004. Retrieved from https:\/\/arxiv.org\/abs\/2312.04004"},{"key":"e_1_3_2_70_2","unstructured":"Aftab Hussain Md. Rafiqul Islam Rabin and Mohammad Amin Alipour. 2024. On trojan signatures in large language models of code. arXiv:2402.16896. Retrieved from https:\/\/arxiv.org\/abs\/2402.16896"},{"key":"e_1_3_2_71_2","unstructured":"Aftab Hussain Md. Rafiqul Islam Rabin Navid Ayoobi and Mohammad Amin Alipour. 2024. Measuring impacts of poisoning on model parameters and neuron activations: A case study of poisoning CodeBERT. arXiv:2402.12936. Retrieved from https:\/\/arxiv.org\/abs\/2402.12936"},{"key":"e_1_3_2_72_2","doi-asserted-by":"crossref","unstructured":"Cristina Improta Pietro Liguori Roberto Natella Bojan Cukic and Domenico Cotroneo. 2023. Enhancing robustness of AI offensive code generators via data augmentation. arXiv:2306.05079. Retrieved from https:\/\/arxiv.org\/abs\/2306.05079","DOI":"10.1007\/s10664-024-10569-y"},{"key":"e_1_3_2_73_2","first-page":"255","volume-title":"Proceedings of the 24th USENIX Security Symposium","author":"Islam Aylin Caliskan","year":"2015","unstructured":"Aylin Caliskan Islam, Richard E. Harang, Andrew Liu, Arvind Narayanan, Clare R. Voss, Fabian Yamaguchi, and Rachel Greenstadt. 2015. De-anonymizing programmers via code stylometry. In Proceedings of the 24th USENIX Security Symposium. USENIX Association, 255\u2013270."},{"key":"e_1_3_2_74_2","first-page":"1","volume-title":"Proceedings of the 46th International Conference on Software Engineering","volume":"79","author":"Izadi Maliheh","year":"2024","unstructured":"Maliheh Izadi, Jonathan Katzy, Tim van Dam, Marc Otten, Razvan Mihai Popescu, and Arie van Deursen. 2024. Language models for code completion: A practical evaluation. In Proceedings of the 46th International Conference on Software Engineering. ACM, Article 79, 1\u201313."},{"key":"e_1_3_2_75_2","doi-asserted-by":"publisher","DOI":"10.1109\/SP.2018.00057"},{"key":"e_1_3_2_76_2","first-page":"14892","volume-title":"Proceedings of the 37th AAAI Conference on Artificial Intelligence (AAAI \u201923), 35th Conference on Innovative Applications of Artificial Intelligence (IAAI \u201923), 13th Symposium on Educational Advances in Artificial Intelligence (EAAI \u201923)","author":"Jha Akshita","year":"2023","unstructured":"Akshita Jha and Chandan K. Reddy. 2023. CodeAttack: Code-based adversarial attacks for pre-trained programming language models. In Proceedings of the 37th AAAI Conference on Artificial Intelligence (AAAI \u201923), 35th Conference on Innovative Applications of Artificial Intelligence (IAAI \u201923), 13th Symposium on Educational Advances in Artificial Intelligence (EAAI \u201923). AAAI Press, 14892\u201314900."},{"key":"e_1_3_2_77_2","unstructured":"Lichen Jia Bowen Tang Chenggang Wu Zhe Wang Zihan Jiang Yuanming Lai Yan Kang Ning Liu and Jingfeng Zhang. 2022. FuncFooler: A practical black-box attack against learning-based binary code similarity detection methods. arXiv:2208.14191. Retrieved from https:\/\/arxiv.org\/abs\/2208.14191"},{"key":"e_1_3_2_78_2","doi-asserted-by":"publisher","DOI":"10.5555\/3155562.3155583"},{"key":"e_1_3_2_79_2","first-page":"8018","volume-title":"Proceedings of the 34th AAAI Conference on Artificial Intelligence","author":"Jin Di","year":"2020","unstructured":"Di Jin, Zhijing Jin, Joey Tianyi Zhou, and Peter Szolovits. 2020. Is BERT really robust? A strong baseline for natural language attack on text classification and entailment. In Proceedings of the 34th AAAI Conference on Artificial Intelligence. AAAI Press, 8018\u20138025."},{"key":"e_1_3_2_80_2","first-page":"3","volume-title":"Proceedings of the 1st IEEE\/ACM International Workshop on Software Protection","author":"Junod Pascal","year":"2015","unstructured":"Pascal Junod, Julien Rinaldini, Johan Wehrli, and Julie Michielin. 2015. Obfuscator-LLVM\u2014Software protection for the masses. In Proceedings of the 1st IEEE\/ACM International Workshop on Software Protection. IEEE Computer Society, 3\u20139."},{"key":"e_1_3_2_81_2","unstructured":"Rafael-Michael Karampatsis and Charles Sutton. 2019. Maybe deep neural networks are the best choice for modeling source code. arXiv:1903.05734. Retrieved from https:\/\/arxiv.org\/abs\/1903.05734"},{"key":"e_1_3_2_82_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE43902.2021.00026"},{"key":"e_1_3_2_83_2","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/D14-1181"},{"key":"e_1_3_2_84_2","first-page":"46","volume-title":"Proceedings of the 15th International Conference on Evaluation and Assessment in Software Engineering","author":"Kitchenham Barbara A.","year":"2011","unstructured":"Barbara A. Kitchenham, Pearl Brereton, Zhi Li, David Budgen, and Andrew James Burn. 2011. Repeatability of systematic literature reviews. In Proceedings of the 15th International Conference on Evaluation and Assessment in Software Engineering. IET\u2014The Institute of Engineering and Technology\/IEEE Xplore, 46\u201355."},{"key":"e_1_3_2_85_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2022.3174092"},{"key":"e_1_3_2_86_2","first-page":"1106","volume-title":"Proceedings of the 26th Annual Conference on Neural Information Processing Systems","author":"Krizhevsky Alex","year":"2012","unstructured":"Alex Krizhevsky, Ilya Sutskever, and Geoffrey E. Hinton. 2012. ImageNet classification with deep convolutional neural networks. In Proceedings of the 26th Annual Conference on Neural Information Processing Systems. OpenReview.net, 1106\u20131114."},{"key":"e_1_3_2_87_2","doi-asserted-by":"crossref","unstructured":"Triet Huynh Minh Le Hao Chen and Muhammad Ali Babar. 2021. Deep learning for source code modeling and generation: Models applications and challenges. ACM Computing Surveys 53 3 Article 62 (2021) 1\u201338.","DOI":"10.1145\/3383458"},{"key":"e_1_3_2_88_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2019.00087"},{"key":"e_1_3_2_89_2","unstructured":"Dianqi Li Yizhe Zhang Hao Peng Liqun Chen Chris Brockett Ming-Ting Sun and Bill Dolan. 2020. Contextualized perturbation for textual adversarial attack. arXiv:2009.07502. Retrieved from https:\/\/arxiv.org\/abs\/2009.07502"},{"issue":"3","key":"e_1_3_2_90_2","first-page":"1","article-title":"Poison attack and poison detection on deep source code processing models","volume":"33","author":"Li Jia","year":"2024","unstructured":"Jia Li, Zhuo Li, Huangzhao Zhang, Ge Li, Zhi Jin, Xing Hu, and Xin Xia. 2024. Poison attack and poison detection on deep source code processing models. ACM Transactions on Software Engineering and Methodology 33, 3, Article 62 (2024), 1\u201331.","journal-title":"ACM Transactions on Software Engineering and Methodology"},{"key":"e_1_3_2_91_2","first-page":"6193","volume-title":"Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing","author":"Li Linyang","year":"2020","unstructured":"Linyang Li, Ruotian Ma, Qipeng Guo, Xiangyang Xue, and Xipeng Qiu. 2020. BERT-ATTACK: Adversarial attack against BERT using BERT. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 6193\u20136202."},{"key":"e_1_3_2_92_2","first-page":"1","article-title":"StarCoder: May the source be with you!","volume":"2023","author":"Li Raymond","year":"2023","unstructured":"Raymond Li, Loubna Ben Allal, Yangtian Zi, Niklas Muennighoff, Denis Kocetkov, Chenghao Mou, Marc Marone, Christopher Akiki, Jia Li, and Jenny Chim and. 2023. StarCoder: May the source be with you! Transactions on Machine Learning Research 2023 (2023), 1\u201355.","journal-title":"Transactions on Machine Learning Research"},{"issue":"3","key":"e_1_3_2_93_2","first-page":"1","article-title":"Bias behind the wheel: Fairness testing of autonomous driving systems","volume":"34","author":"Li Xinyue","year":"2024","unstructured":"Xinyue Li, Zhenpeng Chen, Jie M. Zhang, Federica Sarro, Ying Zhang, and Xuanzhe Liu. 2024. Bias behind the wheel: Fairness testing of autonomous driving systems. ACM Transactions on Software Engineering and Methodology 34, 3 (2024), 1\u201324.","journal-title":"ACM Transactions on Software Engineering and Methodology"},{"key":"e_1_3_2_94_2","first-page":"3835","volume-title":"Proceedings of the 36th International Conference on Machine LearningProceedings of Machine Learning Research","volume":"97","author":"Li Yujia","year":"2019","unstructured":"Yujia Li, Chenjie Gu, Thomas Dullien, Oriol Vinyals, and Pushmeet Kohli. 2019. Graph matching networks for learning the similarity of graph structured objects. In Proceedings of the 36th International Conference on Machine Learning. Proceedings of Machine Learning Research, Vol. 97, PMLR, 3835\u20133845."},{"key":"e_1_3_2_95_2","first-page":"7236","volume-title":"Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics","author":"Li Yanzhou","year":"2023","unstructured":"Yanzhou Li, Shangqing Liu, Kangjie Chen, Xiaofei Xie, Tianwei Zhang, and Yang Liu. 2023. Multi-target backdoor attacks for code pre-trained models. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, 7236\u20137254."},{"key":"e_1_3_2_96_2","first-page":"3017","volume-title":"Proceedings of the 29th International Conference on Computational Linguistics","author":"Li Yiyang","year":"2022","unstructured":"Yiyang Li, Hongqiu Wu, and Hai Zhao. 2022. Semantic-preserving adversarial code comprehension. In Proceedings of the 29th International Conference on Computational Linguistics. International Committee on Computational Linguistics, 3017\u20133028."},{"key":"e_1_3_2_97_2","first-page":"1906","volume-title":"Proceedings of the 44th IEEE\/ACM International Conference on Software Engineering","author":"Li Zhen","year":"2022","unstructured":"Zhen Li, Qian (Guenevere) Chen, Chen Chen, Yayi Zou, and Shouhuai Xu. 2022. RoPGen: Towards robust code authorship attribution via automatic coding style transformation. In Proceedings of the 44th IEEE\/ACM International Conference on Software Engineering. ACM, 1906\u20131918."},{"key":"e_1_3_2_98_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2022.12.030"},{"key":"e_1_3_2_99_2","doi-asserted-by":"crossref","unstructured":"Pietro Liguori Erfan Al-Hossami Domenico Cotroneo Roberto Natella Bojan Cukic and Samira Shaikh. 2021. Shellcode_IA32: A dataset for automatic shellcode generation. arXiv:2104.13100. Retrieved from https:\/\/arxiv.org\/abs\/2104.13100","DOI":"10.18653\/v1\/2021.nlp4prog-1.7"},{"key":"e_1_3_2_100_2","doi-asserted-by":"publisher","DOI":"10.1109\/JPROC.2020.2993293"},{"key":"e_1_3_2_101_2","first-page":"2618","volume-title":"Findings of the Association for Computational Linguistics","author":"Liu Chenxiao","year":"2021","unstructured":"Chenxiao Liu and Xiaojun Wan. 2021. CodeQA: A question answering dataset for source code comprehension. In Findings of the Association for Computational Linguistics. Association for Computational Linguistics, 2618\u20132632."},{"key":"e_1_3_2_102_2","unstructured":"Junwei Liu Kaixin Wang Yixuan Chen Xin Peng Zhenpeng Chen Lingming Zhang and Yiling Lou. 2024. Large language model-based agents for software engineering: A survey. arXiv:2409.02977. Retrieved from https:\/\/arxiv.org\/abs\/2409.02977"},{"key":"e_1_3_2_103_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIFS.2021.3080507"},{"key":"e_1_3_2_104_2","first-page":"1","volume-title":"Proceedings of the 25th Annual Network and Distributed System Security Symposium","author":"Liu Yingqi","year":"2018","unstructured":"Yingqi Liu, Shiqing Ma, Yousra Aafer, Wen-Chuan Lee, Juan Zhai, Weihang Wang, and Xiangyu Zhang. 2018. Trojaning attack on neural networks. In Proceedings of the 25th Annual Network and Distributed System Security Symposium. The Internet Society, 1\u201315."},{"key":"e_1_3_2_105_2","doi-asserted-by":"crossref","unstructured":"Yue Liu Chakkrit Tantithamthavorn Li Li and Yepang Liu. 2023. Deep learning for Android malware defenses: A systematic literature review. ACM Computing Surveys 55 8 Article 153 (2023) 1\u201336.","DOI":"10.1145\/3544968"},{"key":"e_1_3_2_106_2","first-page":"1","volume-title":"Proceedings of the Neural Information Processing Systems Track on Datasets and Benchmarks, Virtual","author":"Lu Shuai","year":"2021","unstructured":"Shuai Lu, Daya Guo, Shuo Ren, Junjie Huang, Alexey Svyatkovskiy, Ambrosio Blanco, Colin B. Clement, Dawn Drain, Daxin Jiang, Duyu Tang, et al. 2021. CodeXGLUE: A machine learning benchmark dataset for code understanding and generation. In Proceedings of the Neural Information Processing Systems Track on Datasets and Benchmarks, Virtual. OpenReview.net, 1\u201314."},{"key":"e_1_3_2_107_2","doi-asserted-by":"publisher","DOI":"10.5555\/3620237.3620387"},{"key":"e_1_3_2_108_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2010.28"},{"key":"e_1_3_2_109_2","first-page":"1","volume-title":"Proceedings of the 6th International Conference on Learning Representations","author":"Madry Aleksander","year":"2018","unstructured":"Aleksander Madry, Aleksandar Makelov, Ludwig Schmidt, Dimitris Tsipras, and Adrian Vladu. 2018. Towards deep learning models resistant to adversarial attacks. In Proceedings of the 6th International Conference on Learning Representations. OpenReview.net, 1\u201328."},{"key":"e_1_3_2_110_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2016.2630689"},{"issue":"4","key":"e_1_3_2_111_2","doi-asserted-by":"crossref","first-page":"2259","DOI":"10.1109\/TDSC.2021.3051852","article-title":"Function representations for binary similarity","volume":"19","author":"Massarelli Luca","year":"2021","unstructured":"Luca Massarelli, Giuseppe Antonio Di Luna, Fabio Petroni, Leonardo Querzoni, and Roberto Baldoni. 2021. Function representations for binary similarity. IEEE Transactions on Dependable and Secure Computing 19, 4 (2021), 2259\u20132273.","journal-title":"IEEE Transactions on Dependable and Secure Computing"},{"key":"e_1_3_2_112_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE43902.2021.00041"},{"key":"e_1_3_2_113_2","first-page":"291","volume-title":"Proceedings of the 9th ACM Conference on Data and Application Security and Privacy","author":"Matyukhina Alina","year":"2019","unstructured":"Alina Matyukhina, Natalia Stakhanova, Mila Dalla Preda, and Celine Perley. 2019. Adversarial authorship attribution in open-source projects. In Proceedings of the 9th ACM Conference on Data and Application Security and Privacy. ACM, 291\u2013302."},{"key":"e_1_3_2_114_2","unstructured":"Xiaozhu Meng Barton P. Miller and Somesh Jha. 2018. Adversarial binaries for authorship identification. arXiv:1809.08316. Retrieved from https:\/\/arxiv.org\/abs\/1809.08316"},{"key":"e_1_3_2_115_2","doi-asserted-by":"publisher","DOI":"10.3390\/a16100478"},{"key":"e_1_3_2_116_2","unstructured":"Meta. 2023. Code Llama: Open Foundation Models for Code. Retrieved from https:\/\/ai.meta.com\/research\/publications\/code-llamaopen-foundation-models-for-code\/"},{"key":"e_1_3_2_117_2","doi-asserted-by":"publisher","DOI":"10.1063\/1.1699114"},{"key":"e_1_3_2_118_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2018.2877759"},{"key":"e_1_3_2_119_2","doi-asserted-by":"publisher","DOI":"10.5555\/3015812.3016002"},{"key":"e_1_3_2_120_2","first-page":"7777","volume-title":"Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics","author":"Na CheolWon","year":"2023","unstructured":"CheolWon Na, YunSeok Choi, and Jee-Hyong Lee. 2023. DIP: Dead code insertion based black-box attack for programming language model. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, 7777\u20137791."},{"key":"e_1_3_2_121_2","first-page":"253","volume-title":"Proceedings of the 36th IEEE\/ACM International Conference on Automated Software Engineering","author":"Nguyen Phuong T.","year":"2021","unstructured":"Phuong T. Nguyen, Claudio Di Sipio, Juri Di Rocco, Massimiliano Di Penta, and Davide Di Ruscio. 2021. Adversarial attacks to API recommender systems: Time to wake up and smell the coffee \\( f \\) . In Proceedings of the 36th IEEE\/ACM International Conference on Automated Software Engineering. IEEE, 253\u2013265."},{"key":"e_1_3_2_122_2","unstructured":"Thanh-Dat Nguyen Yang Zhou Xuan-Bach Dinh Le Patanamon Thongtanunam and David Lo. 2023. Adversarial attacks on code models with discriminative graph patterns. arXiv:2308.11161. Retrieved from https:\/\/arxiv.org\/abs\/2308.11161"},{"key":"e_1_3_2_123_2","first-page":"2133","volume-title":"Proceedings of the 32nd USENIX Security Symposium","author":"Niu Liang","year":"2023","unstructured":"Liang Niu, Muhammad Shujaat Mirza, Zayd Maradni, and Christina P\u00f6pper. 2023. CodexLeaks: Privacy leaks from code generation language models in GitHub Copilot. In Proceedings of the 32nd USENIX Security Symposium. USENIX Association, 2133\u20132150."},{"key":"e_1_3_2_124_2","doi-asserted-by":"publisher","DOI":"10.1145\/3579643"},{"key":"e_1_3_2_125_2","first-page":"1141","volume-title":"Proceedings of the IEEE Symposium on Security and Privacy","author":"Oh Sanghak","year":"2024","unstructured":"Sanghak Oh, Kiho Lee, Seonhye Park, Doowon Kim, and Hyoungshick Kim. 2024. Poisoned ChatGPT finds work for idle hands: Exploring developers\u2019 coding practices with insecure suggestions from poisoned AI models. In Proceedings of the IEEE Symposium on Security and Privacy. IEEE, 1141\u20131159."},{"key":"e_1_3_2_126_2","first-page":"1504","volume-title":"Proceedings of the IEEE Congress on Evolutionary Computation","author":"O\u2019Neill Michael","year":"2014","unstructured":"Michael O\u2019Neill, Miguel Nicolau, and Alexandros Agapitos. 2014. Experiments in program synthesis with grammatical evolution: A focus on Integer Sorting. In Proceedings of the IEEE Congress on Evolutionary Computation. IEEE 1504\u20131511."},{"key":"e_1_3_2_127_2","unstructured":"OpenAI. 2023. Code Interpreter. Retrieved from https:\/\/openai.com\/blog\/chatgpt-plugins#code-interpreter"},{"key":"e_1_3_2_128_2","unstructured":"OpenAI. 2023. Codex. Retrieved from https:\/\/openai.com\/blog\/openai-codex"},{"key":"e_1_3_2_129_2","unstructured":"David N. Palacio Nathan Cooper Alvaro Rodriguez Kevin Moran and Denys Poshyvanyk. 2023. Toward a theory of causation for interpreting neural code models. arXiv:2302.03788. Retrieved from https:\/\/arxiv.org\/abs\/2302.03788"},{"key":"e_1_3_2_130_2","doi-asserted-by":"publisher","DOI":"10.1145\/3052973.3053009"},{"key":"e_1_3_2_131_2","first-page":"311","volume-title":"Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics","author":"Papineni Kishore","year":"2002","unstructured":"Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. BLEU: A method for automatic evaluation of machine translation. In Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics. ACL, 311\u2013318."},{"key":"e_1_3_2_132_2","first-page":"36","volume-title":"Proceedings of the 14th IEEE Conference on Software Testing, Verification and Validation","author":"Pour Maryam Vahdat","year":"2021","unstructured":"Maryam Vahdat Pour, Zhuo Li, Lei Ma, and Hadi Hemmati. 2021. A search-based testing framework for deep neural networks of source code embedding. In Proceedings of the 14th IEEE Conference on Software Testing, Verification and Validation. IEEE, 36\u201346."},{"key":"e_1_3_2_133_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.emnlp-main.752"},{"key":"e_1_3_2_134_2","unstructured":"Shiyi Qi Yuanhang Yang Shuzheng Gao Cuiyun Gao and Zenglin Xu. 2023. BadCS: A backdoor attack framework for code search. arXiv:2305.05503. Retrieved from https:\/\/arxiv.org\/abs\/2305.05503"},{"key":"e_1_3_2_135_2","doi-asserted-by":"publisher","DOI":"10.5555\/3361338.3361372"},{"issue":"1","key":"e_1_3_2_136_2","first-page":"1","article-title":"Improving language understanding by generative pre-training","volume":"1","author":"Radford Alec","year":"2018","unstructured":"Alec Radford, Karthik Narasimhan, Tim Salimans, and Ilya Sutskever. 2018. Improving language understanding by generative pre-training. OpenAI 1, 1 (2018), 1\u201312.","journal-title":"OpenAI"},{"issue":"8","key":"e_1_3_2_137_2","first-page":"9","article-title":"Language models are unsupervised multitask learners","volume":"1","author":"Radford Alec","year":"2019","unstructured":"Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. 2019. Language models are unsupervised multitask learners. OpenAI Blog 1, 8 (2019), 9.","journal-title":"OpenAI Blog"},{"key":"e_1_3_2_138_2","first-page":"1","article-title":"Exploring the limits of transfer learning with a unified text-to-text transformer","volume":"21","author":"Raffel Colin","year":"2020","unstructured":"Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J. Liu. 2020. Exploring the limits of transfer learning with a unified text-to-text transformer. Journal of Machine Learning Research 21, Article 140 (2020), 1\u201367.","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_3_2_139_2","first-page":"2892","volume-title":"Proceedings of the 26th International Conference on Pattern Recognition","author":"Ramakrishnan Goutham","year":"2022","unstructured":"Goutham Ramakrishnan and Aws Albarghouthi. 2022. Backdoors in neural models of source code. In Proceedings of the 26th International Conference on Pattern Recognition. IEEE, 2892\u20132899."},{"key":"e_1_3_2_140_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2018.2803055"},{"key":"e_1_3_2_141_2","unstructured":"Shuo Ren Daya Guo Shuai Lu Long Zhou Shujie Liu Duyu Tang Neel Sundaresan Ming Zhou Ambrosio Blanco and Shuai Ma. 2020. CodeBLEU: A method for automatic evaluation of code synthesis. arXiv:2009.10297. Retrieved from https:\/\/arxiv.org\/abs\/2009.10297"},{"key":"e_1_3_2_142_2","doi-asserted-by":"publisher","DOI":"10.1145\/3211346.3211353"},{"key":"e_1_3_2_143_2","first-page":"1559","volume-title":"Proceedings of the 30th USENIX Security Symposium","author":"Schuster Roei","year":"2021","unstructured":"Roei Schuster, Congzheng Song, Eran Tromer, and Vitaly Shmatikov. 2021. You autocomplete me: Poisoning vulnerabilities in neural code completion. In Proceedings of the 30th USENIX Security Symposium. USENIX Association, 1559\u20131575."},{"key":"e_1_3_2_144_2","doi-asserted-by":"publisher","DOI":"10.1109\/32.799955"},{"key":"e_1_3_2_145_2","first-page":"1487","volume-title":"Proceedings of the 30th USENIX Security Symposium","author":"Severi Giorgio","year":"2021","unstructured":"Giorgio Severi, Jim Meyer, Scott E. Coull, and Alina Oprea. 2021. Explanation-guided backdoor poisoning attacks against malware classifiers. In Proceedings of the 30th USENIX Security Symposium. USENIX Association, 1487\u20131504."},{"key":"e_1_3_2_146_2","doi-asserted-by":"crossref","unstructured":"Murray Shanahan. 2024. Talking about large language models. ACM Computing Surveys 67 2 (2024) 68\u201379.","DOI":"10.1145\/3624724"},{"key":"e_1_3_2_147_2","doi-asserted-by":"publisher","DOI":"10.1145\/3549035.3561184"},{"key":"e_1_3_2_148_2","doi-asserted-by":"publisher","DOI":"10.1145\/2420950.2420987"},{"key":"e_1_3_2_149_2","first-page":"587","volume-title":"Proceedings of the 2017 ACM Conference on Computer and Communications Security","author":"Song Congzheng","year":"2017","unstructured":"Congzheng Song, Thomas Ristenpart, and Vitaly Shmatikov. 2017. Machine learning models that remember too much. In Proceedings of the 2017 ACM Conference on Computer and Communications Security. ACM, 587\u2013601."},{"key":"e_1_3_2_150_2","unstructured":"Jacob M. Springer Bryn Marie Reinstadler and Una-May O\u2019Reilly. 2020. STRATA: Simple gradient-free attacks for models of code. arXiv:2009.13562. Retrieved from https:\/\/arxiv.org\/abs\/2009.13562"},{"key":"e_1_3_2_151_2","first-page":"1","volume-title":"Proceedings of the 9th International Conference on Learning Representations","author":"Srikant Shashank","year":"2021","unstructured":"Shashank Srikant, Sijia Liu, Tamara Mitrovska, Shiyu Chang, Quanfu Fan, Gaoyuan Zhang, and Una-May O\u2019Reilly. 2021. Generating adversarial computer programs using optimized obfuscations. In Proceedings of the 9th International Conference on Learning Representations. OpenReview.net, 1\u201316."},{"key":"e_1_3_2_152_2","volume-title":"Guidelines for Performing Systematic Literature Reviews in Software Engineering","author":"Staffs Keele","year":"2007","unstructured":"Keele Staffs. 2007. Guidelines for Performing Systematic Literature Reviews in Software Engineering. Technical report, ver. 2.3 EBSE Technical Report. EBSE."},{"key":"e_1_3_2_153_2","unstructured":"Stunnix. 2002. Stunnix. Retrieved from http:\/\/stunnix.com\/"},{"key":"e_1_3_2_154_2","first-page":"1","volume-title":"Proceedings of the 33rd ACM International Conference on the Foundations of Software Engineering","author":"Sun Weisong","year":"2025","unstructured":"Weisong Sun, Yuchen Chen, Chunrong Fang, Yebo Feng, Yuan Xiao, An Guo, Quanjun Zhang, Yang Liu, Baowen Xu, and Zhenyu Chen. 2025. Eliminating backdoors in neural code models for secure code understanding. In Proceedings of the 33rd ACM International Conference on the Foundations of Software Engineering. ACM, 1\u201323."},{"key":"e_1_3_2_155_2","first-page":"9692","volume-title":"Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics","author":"Sun Weisong","year":"2023","unstructured":"Weisong Sun, Yuchen Chen, Guanhong Tao, Chunrong Fang, Xiangyu Zhang, Quanjun Zhang, and Bin Luo. 2023. Backdooring neural code search. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, 9692\u20139708."},{"key":"e_1_3_2_156_2","first-page":"1","volume-title":"Proceedings of the 47th IEEE\/ACM International Conference on Software Engineering","author":"Sun Weisong","year":"2025","unstructured":"Weisong Sun, Yuchen Chen, Mengzhe Yuan, Chunrong Fang, Zhenpeng Chen, Chong Wang, Yang Liu, Baowen Xu, and Zhenyu Chen. 2025. Show me your code! Kill code poisoning: A lightweight method based on code naturalness. In Proceedings of the 47th IEEE\/ACM International Conference on Software Engineering. IEEE Computer Society, 1\u201312."},{"key":"e_1_3_2_157_2","doi-asserted-by":"publisher","DOI":"10.1145\/3510003.3510140"},{"key":"e_1_3_2_158_2","doi-asserted-by":"publisher","DOI":"10.1145\/3656341"},{"key":"e_1_3_2_159_2","first-page":"419","volume-title":"Proceedings of the 46th IEEE\/ACM International Conference on Software Engineering","author":"Sun Weisong","year":"2024","unstructured":"Weisong Sun, Yun Miao, Yuekang Li, Hongyu Zhang, Chunrong Fang, Yi Liu, Gelei Deng, Yang Liu, and Zhenyu Chen. 2024. Source code summarization in the era of large language models. In Proceedings of the 46th IEEE\/ACM International Conference on Software Engineering. IEEE\/ACM, 419\u2013431."},{"key":"e_1_3_2_160_2","doi-asserted-by":"publisher","DOI":"10.1145\/3650212.3680300"},{"key":"e_1_3_2_161_2","first-page":"3319","volume-title":"Proceedings of the 34th International Conference on Machine Learning","volume":"70","author":"Sundararajan Mukund","year":"2017","unstructured":"Mukund Sundararajan, Ankur Taly, and Qiqi Yan. 2017. Axiomatic attribution for deep networks. In Proceedings of the 34th International Conference on Machine Learning, Vol. 70, PMLR, 3319\u20133328."},{"key":"e_1_3_2_162_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSME.2014.77"},{"key":"e_1_3_2_163_2","first-page":"1433","volume-title":"Proceedings of the 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering, Virtual Event","author":"Svyatkovskiy Alexey","year":"2020","unstructured":"Alexey Svyatkovskiy, Shao Kun Deng, Shengyu Fu, and Neel Sundaresan. 2020. IntelliCode compose: Code generation using transformer. In Proceedings of the 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering, Virtual Event. ACM, 1433\u20131443."},{"key":"e_1_3_2_164_2","doi-asserted-by":"publisher","DOI":"10.1145\/3292500.3330699"},{"key":"e_1_3_2_165_2","first-page":"1","volume-title":"Proceedings of the 2nd International Conference on Learning Representations, Conference Track Proceedings","author":"Szegedy Christian","year":"2014","unstructured":"Christian Szegedy, Wojciech Zaremba, Ilya Sutskever, Joan Bruna, Dumitru Erhan, Ian J. Goodfellow, and Rob Fergus. 2014. Intriguing properties of neural networks. In Proceedings of the 2nd International Conference on Learning Representations, Conference Track Proceedings. OpenReview.net, 1\u201310."},{"key":"e_1_3_2_166_2","unstructured":"Ross Taylor Marcin Kardas Guillem Cucurull Thomas Scialom Anthony Hartshorn Elvis Saravia Andrew Poulton Viktor Kerkez and Robert Stojnic. 2022. Galactica: A large language model for science. arXiv:2211.09085. Retrieved from https:\/\/arxiv.org\/abs\/2211.09085"},{"key":"e_1_3_2_167_2","first-page":"807","volume-title":"Proceedings of the 21st IEEE International Conference on Software Quality, Reliability and Security","author":"Tian Junfeng","year":"2021","unstructured":"Junfeng Tian, Chenxin Wang, Zhen Li, and Yu Wen. 2021. Generating adversarial examples of source code classification models via Q-learning-based Markov decision process. In Proceedings of the 21st IEEE International Conference on Software Quality, Reliability and Security. IEEE 807\u2013818."},{"key":"e_1_3_2_168_2","doi-asserted-by":"publisher","DOI":"10.1109\/ASE56229.2023.00149"},{"key":"e_1_3_2_169_2","first-page":"588","volume-title":"Proceedings of the 20th IEEE\/ACM International Conference on Mining Software Repositories","author":"Tony Catherine","year":"2023","unstructured":"Catherine Tony, Markus Mutas, Nicol\u00e1s E. D\u00edaz Ferreyra, and Riccardo Scandariato. 2023. LLMSecEval: A dataset of natural language prompts for security evaluations. In Proceedings of the 20th IEEE\/ACM International Conference on Mining Software Repositories. IEEE, 588\u2013592."},{"key":"e_1_3_2_170_2","doi-asserted-by":"publisher","DOI":"10.5555\/3241094.3241142"},{"key":"e_1_3_2_171_2","first-page":"8011","volume-title":"Proceedings of the 2018 32nd Conference on Neural Information Processing Systems","author":"Tran Brandon","year":"2018","unstructured":"Brandon Tran, Jerry Li, and Aleksander Madry. 2018. Spectral signatures in backdoor attacks. In Proceedings of the 2018 32nd Conference on Neural Information Processing Systems. OpenReview.net, 8011\u20138021."},{"key":"e_1_3_2_172_2","first-page":"13","volume-title":"Proceedings of the 34th IEEE\/ACM International Conference on Automated Software Engineering","author":"Wan Yao","year":"2019","unstructured":"Yao Wan, Jingdong Shu, Yulei Sui, Guandong Xu, Zhou Zhao, Jian Wu, and Philip S. Yu. 2019. Multi-modal attention network learning for semantic source code retrieval. In Proceedings of the 34th IEEE\/ACM International Conference on Automated Software Engineering. IEEE, 13\u201325."},{"key":"e_1_3_2_173_2","doi-asserted-by":"publisher","DOI":"10.1145\/3540250.3549153"},{"key":"e_1_3_2_174_2","unstructured":"Chong Wang Zhenpeng Chen Tianlin Li Yilun Zhao and Yang Liu. 2024. Towards trustworthy LLMs for code: A data-centric synergistic auditing framework. arXiv:2410.09048. Retrieved from https:\/\/arxiv.org\/abs\/2410.09048"},{"key":"e_1_3_2_175_2","first-page":"39","volume-title":"Proceedings of the 20th IEEE\/ACM International Conference on Mining Software Repositories","author":"Wang Chao","year":"2023","unstructured":"Chao Wang, Zhenpeng Chen, and Minghui Zhou. 2023. AutoML from software engineering perspective: Landscapes and challenges. In Proceedings of the 20th IEEE\/ACM International Conference on Mining Software Repositories. IEEE, 39\u201351."},{"key":"e_1_3_2_176_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIFS.2020.3044773"},{"key":"e_1_3_2_177_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2022.3173346"},{"key":"e_1_3_2_178_2","doi-asserted-by":"crossref","unstructured":"Yue Wang Hung Le Akhilesh Deepak Gotmare Nghi D. Q. Bui Junnan Li and Steven C. H. Hoi. 2023. CodeT5+: Open code large language models for code understanding and generation. arXiv:2305.07922. Retrieved from https:\/\/arxiv.org\/abs\/2305.07922","DOI":"10.18653\/v1\/2023.emnlp-main.68"},{"key":"e_1_3_2_179_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.emnlp-main.685"},{"key":"e_1_3_2_180_2","doi-asserted-by":"publisher","DOI":"10.1145\/3485275"},{"key":"e_1_3_2_181_2","doi-asserted-by":"publisher","DOI":"10.1145\/3468264.3468558"},{"key":"e_1_3_2_182_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE48619.2023.00191"},{"key":"e_1_3_2_183_2","first-page":"1","volume-title":"Proceedings of the 18th International Conference on Evaluation and Assessment in Software Engineering","volume":"38","author":"Wohlin Claes","year":"2014","unstructured":"Claes Wohlin. 2014. Guidelines for snowballing in systematic literature studies and a replication in software engineering. In Proceedings of the 18th International Conference on Evaluation and Assessment in Software Engineering. ACM, Article 38, 1\u201310."},{"key":"e_1_3_2_184_2","doi-asserted-by":"publisher","DOI":"10.1145\/3691620.3695055"},{"key":"e_1_3_2_185_2","unstructured":"Fangzhou Wu Xiaogeng Liu and Chaowei Xiao. 2023. DeceptPrompt: Exploiting LLM-driven code generation via adversarial natural language instructions. arXiv:2312.04730. Retrieved from https:\/\/arxiv.org\/abs\/2312.04730"},{"key":"e_1_3_2_186_2","first-page":"1","volume-title":"Proceedings of the 34th ACM SIGSOFT International Symposium on Software Testing and Analysis","author":"Xiao Yuan","year":"2025","unstructured":"Yuan Xiao, Yuchen Chen, Shiqing Ma, Haocheng Huang, Chunrong Fang, Yanwei Chen, Weisong Sun, Yunfeng Zhu, Xiaofang Zhang, and Zhenyu Chen. 2025. DeCoMa: Detecting and purifying code dataset watermarks through dual channel code abstraction. In Proceedings of the 34th ACM SIGSOFT International Symposium on Software Testing and Analysis. ACM, 1\u201323."},{"key":"e_1_3_2_187_2","doi-asserted-by":"publisher","DOI":"10.1145\/3133956.3134018"},{"key":"e_1_3_2_188_2","first-page":"485","volume-title":"Proceedings of the IEEE International Conference on Software Analysis, Evolution and Reengineering","author":"Yamamoto Hiroki","year":"2023","unstructured":"Hiroki Yamamoto, Dong Wang, Gopi Krishnan Rajbahadur, Masanari Kondo, Yasutaka Kamei, and Naoyasu Ubayashi. 2023. Towards privacy preserving cross project defect prediction with federated learning. In Proceedings of the IEEE International Conference on Software Analysis, Evolution and Reengineering. IEEE, Taipa, Macao, 485\u2013496."},{"key":"e_1_3_2_189_2","unstructured":"Guang Yang Yu Zhou Xiang Chen Xiangyu Zhang Terry Yue Zhuo David Lo and Taolue Chen. 2024. DeCE: Deceptive cross-entropy loss designed for defending backdoor attacks. arXiv:2407.08956. Retrieved from https:\/\/arxiv.org\/abs\/2407.08956"},{"key":"e_1_3_2_190_2","doi-asserted-by":"publisher","DOI":"10.1145\/3630010"},{"key":"e_1_3_2_191_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIFS.2024.3402153"},{"key":"e_1_3_2_192_2","doi-asserted-by":"publisher","DOI":"10.1145\/3510003.3510146"},{"key":"e_1_3_2_193_2","unstructured":"Zhou Yang Zhensu Sun Terry Yue Zhuo Premkumar T. Devanbu and David Lo. 2024. Robustness security privacy explainability efficiency and usability of large language models for code. arXiv:2403.07506. Retrieved from https:\/\/arxiv.org\/abs\/2403.07506"},{"key":"e_1_3_2_194_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2024.3361661"},{"key":"e_1_3_2_195_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2024.3482719"},{"key":"e_1_3_2_196_2","first-page":"1","volume-title":"Proceedings of the 46th IEEE\/ACM International Conference on Software Engineering","volume":"72","author":"Yang Zhou","year":"2024","unstructured":"Zhou Yang, Zhipeng Zhao, Chenyu Wang, Jieke Shi, Dongsun Kim, DongGyun Han, and David Lo. 2024. Unveiling memorization in code models. In Proceedings of the 46th IEEE\/ACM International Conference on Software Engineering. ACM, Article 72, 1\u201313."},{"key":"e_1_3_2_197_2","doi-asserted-by":"crossref","unstructured":"Kaichun Yao Hao Wang Chuan Qin Hengshu Zhu Yanjun Wu and Libo Zhang. 2025. CARL: Unsupervised code-based adversarial attacks for programming language models via reinforcement learning. ACM Transactions on Software Engineering and Methodology 34 1 Article 22 (2025) 1\u201332.","DOI":"10.1145\/3688839"},{"key":"e_1_3_2_198_2","doi-asserted-by":"publisher","DOI":"10.1145\/3428230"},{"key":"e_1_3_2_199_2","first-page":"1149","volume-title":"Proceedings of the International Conference on Parallel & Distributed Processing with Applications, Big Data & Cloud Computing, Sustainable Computing & Communications, Social Computing & Networking","author":"Yi Xiaoyu","year":"2023","unstructured":"Xiaoyu Yi, Gaolei Li, Ao Ding, Yan Zheng, Yuqing Li, and Jianhua Li. 2023. AdvBinSD: Poisoning the binary code similarity detector via isolated instruction sequences. In Proceedings of the International Conference on Parallel & Distributed Processing with Applications, Big Data & Cloud Computing, Sustainable Computing & Communications, Social Computing & Networking. IEEE, 1149\u20131156."},{"key":"e_1_3_2_200_2","first-page":"1","volume-title":"Proceedings of the 15th Asia-Pacific Symposium on Internetware","author":"Yi Xiaoyu","year":"2024","unstructured":"Xiaoyu Yi, Gaolei Li, Wenkai Huang, Xi Lin, Jianhua Li, and Yuchen Liu. 2024. LateBA: Latent backdoor attack on deep bug search via infrequent execution codes. In Proceedings of the 15th Asia-Pacific Symposium on Internetware. ACM, 1\u201310."},{"key":"e_1_3_2_201_2","doi-asserted-by":"publisher","DOI":"10.3390\/electronics12040936"},{"key":"e_1_3_2_202_2","doi-asserted-by":"publisher","DOI":"10.1145\/3546066"},{"key":"e_1_3_2_203_2","doi-asserted-by":"publisher","DOI":"10.1145\/3533767.3534390"},{"key":"e_1_3_2_204_2","unstructured":"Chi Zhang Zifan Wang Ravi Mangal Matt Fredrikson Limin Jia and Corina S. Pasareanu. 2023. Transfer attacks and defenses for large language models on coding tasks. arXiv:2311.13445. Retrieved from https:\/\/arxiv.org\/abs\/2311.13445"},{"key":"e_1_3_2_205_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2010.12.010"},{"key":"e_1_3_2_206_2","doi-asserted-by":"publisher","DOI":"10.1145\/3511887"},{"key":"e_1_3_2_207_2","first-page":"1169","volume-title":"Proceedings of the 34th AAAI Conference on Artificial Intelligence","author":"Zhang Huangzhao","year":"2020","unstructured":"Huangzhao Zhang, Zhuo Li, Ge Li, Lei Ma, Yang Liu, and Zhi Jin. 2020. Generating adversarial examples for holding robustness of source code processing models. In Proceedings of the 34th AAAI Conference on Artificial Intelligence. AAAI Press, 1169\u20131176."},{"issue":"3","key":"e_1_3_2_208_2","first-page":"1","article-title":"CodeBERT-Attack: Adversarial attack against source code deep learning models via pre-trained model","volume":"36","author":"Zhang Huangzhao","year":"2024","unstructured":"Huangzhao Zhang, Shuai Lu, Zhuo Li, Zhi Jin, Lei Ma, Yang Liu, and Ge Li. 2024. CodeBERT-Attack: Adversarial attack against source code deep learning models via pre-trained model. Journal of Software: Evolution and Process 36, 3 (2024), 1\u201329.","journal-title":"Journal of Software: Evolution and Process"},{"key":"e_1_3_2_209_2","unstructured":"Jie Zhang Wei Ma Qiang Hu Xiaofei Xie Yves Le Traon and Yang Liu. 2023. RNNS: Representation nearest neighbor search black-box attack on code models. arXiv:2305.05896. Retrieved from https:\/\/arxiv.org\/abs\/2305.05896"},{"key":"e_1_3_2_210_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2019.00086"},{"key":"e_1_3_2_211_2","doi-asserted-by":"crossref","first-page":"4344","DOI":"10.18653\/v1\/2023.emnlp-main.264","volume-title":"Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing","author":"Zhang Jinchuan","year":"2023","unstructured":"Jinchuan Zhang, Yan Zhou, Binyuan Hui, Yaxin Liu, Ziming Li, and Songlin Hu. 2023. TrojanSQL: SQL injection against natural language interface to database. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 4344\u20134359."},{"key":"e_1_3_2_212_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2019.2962027"},{"key":"e_1_3_2_213_2","doi-asserted-by":"publisher","DOI":"10.1145\/3631974"},{"key":"e_1_3_2_214_2","first-page":"10593","volume-title":"Findings of the Association for Computational Linguistics","author":"Zhang Sheng","year":"2024","unstructured":"Sheng Zhang, Hui Li, and Rongrong Ji. 2024. Code membership inference for detecting unauthorized data use in code pre-trained language models. In Findings of the Association for Computational Linguistics. Association for Computational Linguistics, 10593\u201310603."},{"issue":"3","key":"e_1_3_2_215_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3374217","article-title":"Adversarial attacks on deep-learning models in natural language processing: A survey","volume":"11","author":"Zhang Wei Emma","year":"2020","unstructured":"Wei Emma Zhang, Quan Z. Sheng, Ahoud Alhazmi, and Chenliang Li. 2020. Adversarial attacks on deep-learning models in natural language processing: A survey. ACM Transactions on Intelligent Systems and Technology 11, 3, Article 24 (2020), 1\u201341.","journal-title":"ACM Transactions on Intelligent Systems and Technology"},{"key":"e_1_3_2_216_2","doi-asserted-by":"crossref","first-page":"392","DOI":"10.1007\/978-3-031-54528-3_22","volume-title":"Proceedings of the 19th EAI International Conference on Collaborative Computing: Networking, Applications and Worksharing","volume":"562","author":"Zhang Yuxin","year":"2023","unstructured":"Yuxin Zhang, Ruoting Wu, Jie Liao, and Liang Chen. 2023. Structural adversarial attack for code representation models. In Proceedings of the 19th EAI International Conference on Collaborative Computing: Networking, Applications and Worksharing. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, Vol. 562, Springer, 392\u2013413."},{"key":"e_1_3_2_217_2","first-page":"2365","volume-title":"Proceedings of the 32nd USENIX Security Symposium","author":"Zhang Zhuo","year":"2023","unstructured":"Zhuo Zhang, Guanhong Tao, Guangyu Shen, Shengwei An, Qiuling Xu, Yingqi Liu, Yapeng Ye, Yaoxuan Wu, and Xiangyu Zhang. 2023. PELICAN: Exploiting backdoors of naturally trained deep learning models in binary code analysis. In Proceedings of the 32nd USENIX Security Symposium. USENIX Association, 2365\u20132382."},{"key":"e_1_3_2_218_2","unstructured":"Wayne Xin Zhao Kun Zhou Junyi Li Tianyi Tang Xiaolei Wang Yupeng Hou Yingqian Min Beichen Zhang Junjie Zhang Zican Dong et al. 2023. A survey of large language models. arXiv:2303.18223. Retrieved from https:\/\/arxiv.org\/abs\/2303.18223"},{"key":"e_1_3_2_219_2","doi-asserted-by":"publisher","DOI":"10.1145\/3660808"},{"key":"e_1_3_2_220_2","first-page":"10197","volume-title":"Proceedings of the 33rd Conference on Neural Information Processing Systems","author":"Zhou Yaqin","year":"2019","unstructured":"Yaqin Zhou, Shangqing Liu, Jing Kai Siow, Xiaoning Du, and Yang Liu. 2019. Devign: Effective vulnerability identification by learning comprehensive program semantics via graph neural networks. In Proceedings of the 33rd Conference on Neural Information Processing Systems. OpenReview.net, 10197\u201310207."},{"key":"e_1_3_2_221_2","doi-asserted-by":"crossref","unstructured":"Yu Zhou Xiaoqing Zhang Juanjuan Shen Tingting Han Taolue Chen and Harald C. Gall. 2022. Adversarial robustness of deep code comment generation. ACM Transactions on Software Engineering and Methodology 31 4 Article 60 (2022) 1\u201330.","DOI":"10.1145\/3501256"},{"key":"e_1_3_2_222_2","first-page":"7614","volume-title":"Proceedings of the 36th International Conference on Machine Learning","volume":"97","author":"Zhu Chen","year":"2019","unstructured":"Chen Zhu, W. Ronny Huang, Hengduo Li, Gavin Taylor, Christoph Studer, and Tom Goldstein. 2019. Transferable clean-label poisoning attacks on deep neural nets. In Proceedings of the 36th International Conference on Machine Learning, Vol. 97, PMLR, 7614\u20137623."},{"key":"e_1_3_2_223_2","first-page":"708","volume-title":"Proceedings of the IEEE International Conference on Software Analysis, Evolution and Reengineering","author":"Zhu Rui","year":"2023","unstructured":"Rui Zhu and Cunming Zhang. 2023. How robust is a large pre-trained language model for code generation \\( f \\) a case on attacking GPT2. In Proceedings of the IEEE International Conference on Software Analysis, Evolution and Reengineering. IEEE, 708\u2013712."},{"key":"e_1_3_2_224_2","unstructured":"Terry Yue Zhuo Zhou Yang Zhensu Sun Yufei Wang Li Li Xiaoning Du Zhenchang Xing and David Lo. 2023. Data augmentation approaches for source code models: A survey. arXiv:2305.19915. Retrieved from https:\/\/arxiv.org\/abs\/2305.19915"}],"container-title":["ACM Transactions on Software Engineering and Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3735554","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,17]],"date-time":"2026-06-17T14:54:19Z","timestamp":1781708059000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3735554"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,6,17]]},"references-count":223,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2026,7,31]]}},"alternative-id":["10.1145\/3735554"],"URL":"https:\/\/doi.org\/10.1145\/3735554","relation":{},"ISSN":["1049-331X","1557-7392"],"issn-type":[{"value":"1049-331X","type":"print"},{"value":"1557-7392","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,6,17]]},"assertion":[{"value":"2024-10-19","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-04-07","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-06-17","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}