{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,17]],"date-time":"2026-07-17T14:59:37Z","timestamp":1784300377622,"version":"3.55.0"},"publisher-location":"New York, NY, USA","reference-count":75,"publisher":"ACM","license":[{"start":{"date-parts":[[2024,12,2]],"date-time":"2024-12-02T00:00:00Z","timestamp":1733097600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2024,12,2]]},"DOI":"10.1145\/3658644.3690298","type":"proceedings-article","created":{"date-parts":[[2024,12,9]],"date-time":"2024-12-09T12:19:20Z","timestamp":1733746760000},"page":"2266-2280","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":25,"title":["PromSec: Prompt Optimization for Secure Generation of Functional Source Code with Large Language Models (LLMs)"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3375-0310","authenticated-orcid":false,"given":"Mahmoud","family":"Nazzal","sequence":"first","affiliation":[{"name":"New Jersey Institute of Technology, Newark, NJ, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7660-9512","authenticated-orcid":false,"given":"Issa","family":"Khalil","sequence":"additional","affiliation":[{"name":"Qatar Computing Research Institute, Doha, Qatar"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1583-713X","authenticated-orcid":false,"given":"Abdallah","family":"Khreishah","sequence":"additional","affiliation":[{"name":"New Jersey Institute of Technology, Newark, NJ, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1032-8275","authenticated-orcid":false,"given":"NhatHai","family":"Phan","sequence":"additional","affiliation":[{"name":"New Jersey Institute of Technology, Newark, NJ, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2024,12,9]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"International Conference on Learning Representations.","author":"Allamanis Miltiadis","year":"2018","unstructured":"Miltiadis Allamanis, Marc Brockschmidt, and Mahmoud Khademi. 2018. Learning to represent programs with graphs. In International Conference on Learning Representations."},{"key":"e_1_3_2_1_2_1","unstructured":"astunparse Contributors. 2023. astunparse Documentation. Accessed: 2024-04-04. (2023). https:\/\/astunparse.readthedocs.io\/en\/latest\/."},{"key":"e_1_3_2_1_3_1","unstructured":"Jacob Austin Hanna Hajishirzi Daniel S. Weld and Luke Davis. 2021. Program synthesis with large language models. In NeurIPS."},{"key":"e_1_3_2_1_4_1","unstructured":"Manish Bhatt et al. 2024. Cyberseceval 2: a wide-ranging cybersecurity evaluation suite for large language models. arXiv preprint arXiv:2404.13161."},{"key":"e_1_3_2_1_5_1","unstructured":"2020. Breaking down the 5 most common sql injection threats. Accessed: 2024-04-04. (2020). https:\/\/www.pentest-tools.com\/blog\/sql-injection-threats."},{"key":"e_1_3_2_1_6_1","unstructured":"Tom B Brown et al. 2020. Language models are few-shot learners. Advances in neural information processing systems 33 1877--1901."},{"key":"e_1_3_2_1_7_1","unstructured":"2020. Buffer overflow attacks explained (with examples). Accessed: 2024-04-04. (2020). https:\/\/www.comparitech.com."},{"key":"e_1_3_2_1_8_1","volume-title":"Mohamed Amine Ferrag, and Lucas C Cordeiro","author":"Charalambous Yiannis","year":"2023","unstructured":"Yiannis Charalambous, Norbert Tihanyi, Ridhi Jain, Youcheng Sun, Mohamed Amine Ferrag, and Lucas C Cordeiro. 2023. A new era in software security: towards self-healing software via large language models and formal verification. arXiv preprint arXiv:2305.14752."},{"key":"e_1_3_2_1_9_1","unstructured":"Mark Chen et al. 2021. Evaluating large language models trained on code. In NeurIPS."},{"key":"e_1_3_2_1_10_1","unstructured":"Ting Chen Simon Kornblith Mohammad Norouzi and Geoffrey Hinton. 2020. A simple framework for contrastive learning of visual representations. arXiv preprint arXiv:2002.05709."},{"key":"e_1_3_2_1_11_1","volume-title":"Sequencer: sequence-to-sequence learning for end-to-end program repair","author":"Chen Zimin","unstructured":"Zimin Chen, Steve Kalra, Luc Luc, Michael Pradel, and Koushik Sen. 2019. Sequencer: sequence-to-sequence learning for end-to-end program repair. In IEEE Transactions on Software Engineering."},{"key":"e_1_3_2_1_12_1","unstructured":"CodeLlama. 2023. Codellama-13b-instruct: advanced coding assistant. https:\/\/codellama.com\/13b-instruct. Accessed: 2024-04-04. (2023)."},{"key":"e_1_3_2_1_13_1","unstructured":"CodeLlama. 2024. Codellama-70b-instruct: advanced coding assistant. https:\/\/codellama.com\/13b-instruct. Accessed: 2024-04-04. (2024)."},{"key":"e_1_3_2_1_14_1","unstructured":"2023. Company tech functions leveraging off-the-shelf coder augmentation solutions. (2023). https:\/\/www.bcg.com."},{"key":"e_1_3_2_1_15_1","volume-title":"Welcome to bandit ? bandit documentation. [Online","author":"Developers B.","year":"2023","unstructured":"B. Developers. 2022. Welcome to bandit ? bandit documentation. [Online; accessed 1. June 2023]. https:\/\/bandit.readthedocs.io\/en\/latest\/."},{"key":"e_1_3_2_1_16_1","volume-title":"International Conference on Learning Representations (ICLR).","author":"Dinella Elizabeth","year":"2020","unstructured":"Elizabeth Dinella, Hanjun Dai, Ziyang Li, Mayur Naik, Le Song, and Ke Wang. 2020. Hoppity: learning graph transformations to detect and fix bugs in programs. In International Conference on Learning Representations (ICLR)."},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3395363.3397362"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE-Companion.2019.00026"},{"key":"e_1_3_2_1_19_1","unstructured":"GitHub. 2023. Github community discussion. https:\/\/github.com\/orgs\/community\/discussions\/72942. Accessed: 2024-04-04. (2023)."},{"key":"e_1_3_2_1_20_1","unstructured":"Ian Goodfellow Jean Pouget-Abadie Mehdi Mirza Bing Xu David Warde-Farley Sherjil Ozair Aaron Courville and Yoshua Bengio. 2014. Generative adversarial nets. In Advances in neural information processing systems 2672--2680."},{"key":"e_1_3_2_1_21_1","unstructured":"Google. 2023. Google bard: revolutionary language ai. https:\/\/bard.google.com. Accessed: 2024-04-04. (2023)."},{"key":"e_1_3_2_1_22_1","unstructured":"Yiyang Hao Ge Li Yongqiang Liu Xiaowei Miao He Zong Siyuan Jiang Yang Liu and He Wei. 2022. Aixbench: a code generation benchmark dataset. arXiv preprint arXiv:2206.13179."},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3576915.3623175"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00975"},{"key":"e_1_3_2_1_25_1","volume-title":"The International Handbook of Information Technology in Primary and Secondary Education","author":"Henderson Michael","unstructured":"Michael Henderson and Lynette Henderson. 2018. Ethical issues in web-based learning. In The International Handbook of Information Technology in Primary and Secondary Education. Springer, 1223--1234."},{"key":"e_1_3_2_1_26_1","unstructured":"2023. How cios can leverage genai for software development. (2023). https:\/\/www.bcg.com."},{"key":"e_1_3_2_1_27_1","volume-title":"Codeql documentation. [Online","author":"GitHub Inc. 2021.","year":"2023","unstructured":"GitHub Inc. 2021. Codeql documentation. [Online; accessed 4-Dec-2023]. (2021). https:\/\/codeql.github.com\/docs\/."},{"key":"e_1_3_2_1_28_1","volume-title":"Elias Bou-Harb, and Peyman Najafirad.","author":"Islam Nafis Tanveer","year":"2024","unstructured":"Nafis Tanveer Islam, Joseph Khoury, Andrew Seong, Gonzalo De La Torre Parra, Elias Bou-Harb, and Peyman Najafirad. 2024. Llm-powered code vulnerability repair with reinforcement learning and semantic reward. arXiv preprint arXiv:2401.03374."},{"key":"e_1_3_2_1_29_1","unstructured":"Nafis Tanveer Islam and Peyman Najafirad. 2024. Code security vulnerability repair using reinforcement learning with large language models. arXiv preprint arXiv:2401.07031."},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/TC.1986.1676696"},{"key":"e_1_3_2_1_31_1","unstructured":"Thomas N Kipf and Max Welling. 2016. Variational graph auto-encoders. In Neural Information Processing Systems (NIPS)."},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3383458"},{"key":"e_1_3_2_1_33_1","unstructured":"Celine Lee Justin Gottschlich and Dan Roth. 2021. Toward code generation: a survey and lessons from semantic parsing. arXiv preprint arXiv:2105.03317."},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/INFOCOM.2019.8737631"},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1186\/s42400-018-0002-y"},{"key":"e_1_3_2_1_36_1","unstructured":"Zekun Li Baolin Peng Pengcheng He Michel Galley Jianfeng Gao and Xifeng Yan. 2023. Guiding large language models via directional stimulus prompting. arXiv preprint arXiv:2302.11520."},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE48619.2023.00040"},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3560815"},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"crossref","unstructured":"Xiao Liu Yanan Zheng Zhengxiao Du Ming Ding Yujie Qian Zhilin Yang and Jie Tang. 2023. Gpt understands too. AI Open.","DOI":"10.1016\/j.aiopen.2023.08.012"},{"key":"e_1_3_2_1_40_1","unstructured":"Shuai Lu Daya Li Shuming Fang Chaojie Xu Shao Guo Ming Zhang Nan Zou and Zhoujun Huang. 2021. Codexglue: a benchmark dataset and open challenge for code intelligence. arXiv preprint arXiv:2102.04664."},{"key":"e_1_3_2_1_41_1","unstructured":"OpenAI. 2023. Gpt-3.5 turbo: enhanced language model. https:\/\/openai.com\/gpt-3.5-turbo. Accessed: 2024-04-04. (2023)."},{"key":"e_1_3_2_1_42_1","unstructured":"OpenAI. 2023. Gpt-4: next generation language model. https:\/\/openai.com\/gpt-4. Accessed: 2024-04-04. (2023)."},{"key":"e_1_3_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/SP46214.2022.9833571"},{"key":"e_1_3_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/SP46215.2023.10179420"},{"key":"e_1_3_2_1_45_1","doi-asserted-by":"crossref","unstructured":"Neil Perry Megha Srivastava Deepak Kumar and Dan Boneh. 2022. Do users write more insecure code with ai assistants? arXiv preprint arXiv:2211.03622.","DOI":"10.1145\/3576915.3623157"},{"key":"e_1_3_2_1_46_1","volume-title":"Chenguang Zhu, and Michael Zeng.","author":"Pryzant Reid","year":"2023","unstructured":"Reid Pryzant, Dan Iter, Jerry Li, Yin Tat Lee, Chenguang Zhu, and Michael Zeng. 2023. Automatic prompt optimization with\" gradient descent\" and beam search. arXiv preprint arXiv:2305.03495."},{"key":"e_1_3_2_1_47_1","unstructured":"Python Software Foundation. 2023. Python 3.9 Documentation: parser Access Python parse trees. Accessed: 2024-04-04. (2023). https:\/\/docs.python.org\/3.9\/library\/parser.html."},{"key":"e_1_3_2_1_48_1","unstructured":"Guanghui Qin and Jason Eisner. 2021. Learning how to ask: querying lms with mixtures of soft prompts. arXiv preprint arXiv:2104.06599."},{"key":"e_1_3_2_1_49_1","unstructured":"Alec Radford Karthik Narasimhan Tim Salimans Ilya Sutskever et al. 2018. Improving language understanding by generative pre-training. OpenAI."},{"key":"e_1_3_2_1_50_1","doi-asserted-by":"crossref","unstructured":"Herbert Robbins and Sutton Monro. 1951. A stochastic approximation method. The annals of mathematical statistics 400--407.","DOI":"10.1214\/aoms\/1177729586"},{"key":"e_1_3_2_1_51_1","unstructured":"Gustavo Sandoval Hammond Pearce Teo Nys Ramesh Karri Brendan Dolan-Gavitt and Siddharth Garg. 2022. Security implications of large language model code assistants: a user study. arXiv preprint arXiv:2208.09727."},{"key":"e_1_3_2_1_52_1","volume-title":"Eric Wallace, and Sameer Singh.","author":"Shin Taylor","year":"2020","unstructured":"Taylor Shin, Yasaman Razeghi, Robert L Logan IV, Eric Wallace, and Sameer Singh. 2020. Autoprompt: eliciting knowledge from language models with automatically generated prompts. arXiv preprint arXiv:2010.15980."},{"key":"e_1_3_2_1_53_1","unstructured":"Mohammed Latif Siddiq Beatrice Casey and Joanna Santos. 2023. A lightweight framework for high-quality code generation. arXiv preprint arXiv:2307.08220."},{"key":"e_1_3_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1109\/SCAM55253.2022.00014"},{"key":"e_1_3_2_1_55_1","unstructured":"Mohammed Latif Siddiq and Joanna Santos. 2023. Generate and pray: using sallms to evaluate the security of llm generated code. arXiv preprint arXiv:2311.00889."},{"key":"e_1_3_2_1_56_1","unstructured":"2023. Spotbugs: find bugs in java programs. https:\/\/spotbugs.github.io. Accessed: 2024-04-04. (2023)."},{"key":"e_1_3_2_1_57_1","unstructured":"The MITRE Corporation. 2023. Mitre corporation. https:\/\/www.mitre.org. Accessed: 2024-04-04. (2023)."},{"key":"e_1_3_2_1_58_1","unstructured":"2023. Thoughts on the impact of large language models on software development. (2023). https:\/\/e-dorigatti.github.io."},{"key":"e_1_3_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41597-022-01143-6"},{"key":"e_1_3_2_1_60_1","volume-title":"2019 IEEE\/ACM 27th International Conference on Program Comprehension (ICPC). IEEE, 347--357","author":"Tufano Michele","year":"2019","unstructured":"Michele Tufano, Cody Watson, Gabriele Bavota, Massimiliano Di Penta, Martin White, and Denys Poshyvanyk. 2019. Empirical study on the discrepancy between performance and reusability of code transformation models. In 2019 IEEE\/ACM 27th International Conference on Program Comprehension (ICPC). IEEE, 347--357."},{"key":"e_1_3_2_1_61_1","unstructured":"Ashish Vaswani Noam Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan N Gomez Lukasz Kaiser and Illia Polosukhin. 2017. Attention is all you need. In Advances in neural information processing systems 5998--6008."},{"key":"e_1_3_2_1_62_1","unstructured":"Petar Velickovic William Fedus William L Hamilton Pietro Lio Yoshua Bengio and R Devon Hjelm. 2018. Deep graph infomax. arXiv preprint arXiv:1809.10341."},{"key":"e_1_3_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v32i1.11872"},{"key":"e_1_3_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1109\/SP46215.2023.10179479"},{"key":"e_1_3_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1109\/SANER48275.2020.9054857"},{"key":"e_1_3_2_1_66_1","volume-title":"J. International Conference on Learning Representations (ICLR","author":"Welling Max","year":"2016","unstructured":"Max Welling and Thomas N Kipf. 2016. Semi-supervised classification with graph convolutional networks. In J. International Conference on Learning Representations (ICLR 2017)."},{"key":"e_1_3_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1145\/2970276.2970326"},{"key":"e_1_3_2_1_68_1","volume-title":"A comprehensive survey on graph neural networks","author":"Wu Zonghan","unstructured":"Zonghan Wu, Shirui Pan, Fengwen Chen, Guodong Long, Chengqi Zhang, and S Yu Philip. 2020. A comprehensive survey on graph neural networks. IEEE transactions on neural networks and learning systems, 32, 1, 4--24."},{"key":"e_1_3_2_1_69_1","unstructured":"Hanwei Xu Yujun Chen Yulun Du Nan Shao Yanggang Wang Haiyu Li and Zhilin Yang. 2022. Gps: genetic prompt search for efficient few-shot learning. arXiv preprint arXiv:2210.17041."},{"key":"e_1_3_2_1_70_1","unstructured":"Yuning You Tianlong Chen Yongduo Sui Ting Wang Yang Shen and Zhangyang Wang. 2020. Graph contrastive learning with augmentations. arXiv preprint arXiv:2010.13902."},{"key":"e_1_3_2_1_71_1","doi-asserted-by":"crossref","unstructured":"Hao Yu et al. 2023. Codereval: a benchmark of pragmatic code generation with generative pre-trained models. arXiv preprint arXiv:2302.00288.","DOI":"10.1145\/3597503.3623316"},{"key":"e_1_3_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1145\/3236024.3236068"},{"key":"e_1_3_2_1_73_1","unstructured":"Yaqin Zhou Shangqing Liu Jingkai Siow Xiaoning Du and Yang Liu. 2019. Devign: effective vulnerability identification by learning comprehensive program semantics via graph neural networks. Advances in neural information processing systems 32."},{"key":"e_1_3_2_1_74_1","volume-title":"Ziwen Han, Keiran Paster, Silviu Pitis, Harris Chan, and Jimmy Ba.","author":"Zhou Yongchao","year":"2022","unstructured":"Yongchao Zhou, Andrei Ioan Muresanu, Ziwen Han, Keiran Paster, Silviu Pitis, Harris Chan, and Jimmy Ba. 2022. Large language models are human-level prompt engineers. arXiv preprint arXiv:2211.01910."},{"key":"e_1_3_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.1145\/3520312.3534864"}],"event":{"name":"CCS '24: ACM SIGSAC Conference on Computer and Communications Security","location":"Salt Lake City UT USA","acronym":"CCS '24","sponsor":["SIGSAC ACM Special Interest Group on Security, Audit, and Control"]},"container-title":["Proceedings of the 2024 on ACM SIGSAC Conference on Computer and Communications Security"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3658644.3690298","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3658644.3690298","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,22]],"date-time":"2025-08-22T05:59:07Z","timestamp":1755842347000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3658644.3690298"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,12,2]]},"references-count":75,"alternative-id":["10.1145\/3658644.3690298","10.1145\/3658644"],"URL":"https:\/\/doi.org\/10.1145\/3658644.3690298","relation":{},"subject":[],"published":{"date-parts":[[2024,12,2]]},"assertion":[{"value":"2024-12-09","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}