{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,18]],"date-time":"2026-07-18T20:35:24Z","timestamp":1784406924486,"version":"3.55.0"},"reference-count":362,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2025,2,5]],"date-time":"2025-02-05T00:00:00Z","timestamp":1738713600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,2,5]],"date-time":"2025-02-05T00:00:00Z","timestamp":1738713600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Cybersecurity"],"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>The rapid development of large language models (LLMs) has opened new avenues across various fields, including cybersecurity, which faces an evolving threat landscape and demand for innovative technologies. Despite initial explorations into the application of LLMs in cybersecurity, there is a lack of a comprehensive overview of this research area. This paper addresses this gap by providing a systematic literature review, covering the analysis of over 300 works, encompassing 25 LLMs and more than 10 downstream scenarios. Our comprehensive overview addresses three key research questions: the construction of cybersecurity-oriented LLMs, the application of LLMs to various cybersecurity tasks, the challenges and further research in this area. This study aims to shed light on the extensive potential of LLMs in enhancing cybersecurity practices and serve as a valuable resource for applying LLMs in this field. We also maintain and regularly update a list of practical guides on LLMs for cybersecurity\u00a0at <jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" xlink:href=\"https:\/\/github.com\/tmylla\/Awesome-LLM4Cybersecurity\" ext-link-type=\"uri\">https:\/\/github.com\/tmylla\/Awesome-LLM4Cybersecurity<\/jats:ext-link>.<\/jats:p>","DOI":"10.1186\/s42400-025-00361-w","type":"journal-article","created":{"date-parts":[[2025,2,5]],"date-time":"2025-02-05T10:26:21Z","timestamp":1738751181000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":192,"title":["When LLMs meet cybersecurity: a systematic literature review"],"prefix":"10.1186","volume":"8","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1135-2031","authenticated-orcid":false,"given":"Jie","family":"Zhang","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Haoyu","family":"Bu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hui","family":"Wen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yongji","family":"Liu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Haiqiang","family":"Fei","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rongrong","family":"Xi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lun","family":"Li","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yun","family":"Yang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hongsong","family":"Zhu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dan","family":"Meng","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2025,2,5]]},"reference":[{"key":"361_CR3","doi-asserted-by":"publisher","unstructured":"Ahmed T, Devanbu P (2023) Better patching using llm prompting, via self-consistency. In: 2023 38th IEEE\/ACM International Conference on Automated Software Engineering (ASE), pp 1742\u20131746, https:\/\/doi.org\/10.1109\/ASE56229.2023.00065","DOI":"10.1109\/ASE56229.2023.00065"},{"key":"361_CR1","unstructured":"Ahmad B, Tan B, Karri R et\u00a0al (2023a) Flag: finding line anomalies (in code) with generative AI. Preprint at arXiv:2306.12643"},{"key":"361_CR2","unstructured":"Ahmad B, Thakur S, Tan B et\u00a0al (2023b) Fixing hardware security bugs with large language models. Preprint at arXiv:2302.01215"},{"key":"361_CR4","unstructured":"Alam MT, Bhusal D, Nguyen L et\u00a0al (2024) CTIBench: a benchmark for evaluating LLMs in cyber threat intelligence. In: The Thirty-eight Conference on Neural Information Processing Systems Datasets and Benchmarks Track"},{"key":"361_CR5","unstructured":"Ali T, Kostakos P (2023) Huntgpt: integrating machine learning-based anomaly detection and explainable AI with large language models (llms). Preprint at arXiv:2309.16021"},{"key":"361_CR6","unstructured":"Almazrouei E, Alobeidli H, Alshamsi A et\u00a0al (2023) The falcon series of open language models. Preprint at arXiv:2311.16867"},{"key":"361_CR7","unstructured":"Alrashedy K, Aljasser A (2024) Can llms patch security issues? Preprint at arXiv:2312.00024"},{"key":"361_CR8","doi-asserted-by":"publisher","unstructured":"An K, Yang F, Lu J et\u00a0al (2024) Nissist: an incident mitigation copilot based on troubleshooting guides. In: Endriss U, Melo FS, Bach K et\u00a0al (eds) ECAI 2024 - 27th European Conference on Artificial Intelligence, 19-24 October 2024, Santiago de Compostela, Spain - Including 13th Conference on Prestigious Applications of Intelligent Systems (PAIS 2024), Frontiers in Artificial Intelligence and Applications, vol 392. IOS Press, pp 4471\u2013447https:\/\/doi.org\/10.3233\/FAIA241032","DOI":"10.3233\/FAIA241032"},{"issue":"6","key":"361_CR9","doi-asserted-by":"publisher","first-page":"1333","DOI":"10.3390\/electronics12061333","volume":"12","author":"\u00d6 Aslan","year":"2023","unstructured":"Aslan \u00d6, Aktu\u011f SS, Ozkan-Okay M et al (2023) A comprehensive review of cyber security vulnerabilities, threats, attacks, and solutions. Electronics 12(6):1333","journal-title":"Electronics"},{"key":"361_CR10","unstructured":"Asmita, Oliinyk Y, Scott M et\u00a0al (2024) Fuzzing busybox: leveraging LLM and crash reuse for embedded bug unearthing. In: Balzarotti D, Xu W (eds) 33rd USENIX Security Symposium, USENIX Security 2024, Philadelphia, PA, USA, August 14-16, 2024. USENIX Association, https:\/\/www.usenix.org\/conference\/usenixsecurity24\/presentation\/asmita"},{"key":"361_CR11","first-page":"21","volume-title":"Handbook of research on cybersecurity issues and challenges for business and FinTech applications","author":"N Azizi","year":"2023","unstructured":"Azizi N, Haass O (2023) Cybersecurity issues and challenges. Handbook of research on cybersecurity issues and challenges for business and FinTech applications. IGI Global, Palmdale, pp 21\u201348"},{"key":"361_CR12","unstructured":"Bakhshandeh A, Keramatfar A, Norouzi A et\u00a0al (2023) Using chatgpt as a static application security testing tool. Preprint at arXiv:2308.14434"},{"key":"361_CR13","first-page":"1","volume":"11","author":"S Barnum","year":"2012","unstructured":"Barnum S (2012) Standardizing cyber threat intelligence information with the structured threat information expression (stix). Mitre Corp 11:1\u201322","journal-title":"Mitre Corp"},{"issue":"1","key":"361_CR14","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1561\/3300000041","volume":"6","author":"C Barrett","year":"2023","unstructured":"Barrett C, Boyd B, Bursztein E et al (2023) Identifying and mitigating the security risks of generative AI. Found Trends\u00ae Priv Secur 6(1):1\u201352","journal-title":"Found Trends\u00ae Priv Secur"},{"key":"361_CR15","unstructured":"Beckerich M, Plein L, Coronado S (2023) Ratgpt: turning online llms into proxies for malware attacks. Preprint at arXiv:2308.09183"},{"key":"361_CR16","doi-asserted-by":"publisher","unstructured":"Begou N, Vinoy J, Duda A et\u00a0al (2023) Exploring the dark side of ai: Advanced phishing attack design and deployment using chatgpt. In: 2023 IEEE Conference on Communications and Network Security (CNS), pp 1\u20136, https:\/\/doi.org\/10.1109\/CNS59707.2023.10288940","DOI":"10.1109\/CNS59707.2023.10288940"},{"key":"361_CR17","unstructured":"Bhatt M, Chennabasappa S, Nikolaidis C et\u00a0al (2023) Purple llama cyberseceval: A secure coding benchmark for language models. Preprint at arXiv:2312.04724"},{"key":"361_CR18","unstructured":"Bhusal D, Alam MT, Nguyen L et\u00a0al (2024) Secure: benchmarking generative large language models for cybersecurity advisory. Preprint at arXiv:2405.20441"},{"key":"361_CR19","unstructured":"Bills S, Cammarata N, Mossing D et\u00a0al (2023) Language models can explain neurons in language models. https:\/\/openaipublic.blob.core.windows.net\/neuron-explainer\/paper\/index.html"},{"issue":"2","key":"361_CR20","first-page":"i","volume":"18","author":"A Bozkurt","year":"2023","unstructured":"Bozkurt A, Sharma RC (2023) Generative ai and prompt engineering: The art of whispering to let the genie out of the algorithmic world. Asian Journal of Distance Education 18(2):i\u2013vii","journal-title":"Asian Journal of Distance Education"},{"key":"361_CR21","first-page":"1877","volume":"33","author":"T Brown","year":"2020","unstructured":"Brown T, Mann B, Ryder N et al (2020) Language models are few-shot learners. Adv Neural Inf Process Syst 33:1877\u20131901","journal-title":"Adv Neural Inf Process Syst"},{"key":"361_CR22","unstructured":"Buscemi A (2023) A comparative study of code generation using chatgpt 3.5 across 10 programming languages. Preprint at arXiv:2308.04477"},{"key":"361_CR23","unstructured":"Cao T, Huang C, Li Y et\u00a0al (2024) Phishagent: a robust multimodal agent for phishing webpage detection. Preprint at arXiv:2408.10738"},{"key":"361_CR24","unstructured":"Carlini N, Tramer F, Wallace E et\u00a0al (2021) Extracting training data from large language models. In: USENIX Security, pp 2633\u20132650"},{"key":"361_CR25","unstructured":"Carlini N, Jagielski M, Zhang C et\u00a0al (2022) The privacy onion effect: memorization is relative. In: NeurIPS, http:\/\/papers.nips.cc\/paper_files\/paper\/2022\/hash\/564b5f8289ba846ebc498417e834c253-Abstract-Conference.html"},{"key":"361_CR26","unstructured":"Carlsmith J (2022) Is power-seeking AI an existential risk? Preprint at arXiv:2206.13353"},{"key":"361_CR27","unstructured":"Charalambous Y, Manino E, Cordeiro LC (2024) Automated repair of AI code with large language models and formal verification. Preprint at arXiv:2405.08848"},{"key":"361_CR28","unstructured":"Charan PVS, Chunduri H, Anand PM et\u00a0al (2023) From text to mitre techniques: Exploring the malicious use of large language models for generating cyber attack payloads. Preprint at arXiv:2305.15336"},{"key":"361_CR29","unstructured":"Chauvin T (2024) eyeballvul: a future-proof benchmark for vulnerability detection in the wild. Preprint at arXiv:2407.08708"},{"key":"361_CR30","unstructured":"Chen T, Li L, Zhu L et\u00a0al (2023a) Vullibgen: Identifying vulnerable third-party libraries via generative pre-trained model. Preprint at arXiv:2308.04662"},{"key":"361_CR32","doi-asserted-by":"publisher","unstructured":"Chen Y, Ding Z, Alowain L et\u00a0al (2023b) Diversevul: a new vulnerable source code dataset for deep learning based vulnerability detection. In: Proceedings of the 26th International Symposium on Research in Attacks, Intrusions and Defenses. Association for Computing Machinery, New York, NY, USA, RAID \u201923, p 654-668, https:\/\/doi.org\/10.1145\/3607199.3607242","DOI":"10.1145\/3607199.3607242"},{"key":"361_CR31","unstructured":"Chen X, Lin M, Sch\u00e4rli N et\u00a0al (2024a) Teaching large language models to self-debug. In: The Twelfth International Conference on Learning Representations, ICLR 2024, Vienna, Austria, May 7-11, 2024. OpenReview.net, https:\/\/openreview.net\/forum?id=KuPixIqPiq"},{"key":"361_CR33","doi-asserted-by":"publisher","unstructured":"Chen Y, Wu J, Ling X et\u00a0al (2024b) When large language models confront repository-level automatic program repair: how well they done? In: Proceedings of the 2024 IEEE\/ACM 46th International Conference on Software Engineering: Companion Proceedings, ICSE Companion 2024, Lisbon, Portugal, April 14-20, 2024. ACM, pp 459\u2013471, https:\/\/doi.org\/10.1145\/3639478.3647633","DOI":"10.1145\/3639478.3647633"},{"key":"361_CR34","unstructured":"Cheshkov A, Zadorozhny P, Levichev R (2023) Evaluation of chatgpt model for vulnerability detection. Preprint at arXiv:2304.07232"},{"key":"361_CR35","unstructured":"Chiang WL, Li Z, Lin Z et\u00a0al (2023) Vicuna: an open-source chatbot impressing gpt-4 with 90%* chatgpt quality. See https:\/\/vicuna lmsys org. 2(3):6. Accessed 14 April 2023"},{"key":"361_CR36","unstructured":"Chu J, Liu Y, Yang Z et\u00a0al (2024) Comprehensive assessment of jailbreak attacks against llms. Preprint at arXiv:2402.05668"},{"key":"361_CR37","unstructured":"Clairoux-Trepanier V, Beauchamp IM, Ruellan E et\u00a0al (2024) The use of large language models (llm) for cyber threat intelligence (cti) in cybercrime forums. Preprint at arXiv:2408.03354"},{"key":"361_CR38","unstructured":"Clark J, Amodei D (2016) Faulty reward functions in the wild. Internet: https:\/\/blogopenaicom\/faulty-reward-functions"},{"key":"361_CR39","doi-asserted-by":"crossref","unstructured":"Cui H, Du Y, Yang Q et\u00a0al (2024) Llmind: Orchestrating ai and iot with llm for complex task execution. Preprint at arXiv:2312.09007","DOI":"10.1109\/MCOM.002.2400106"},{"key":"361_CR40","unstructured":"Dang Y, Huang K, Huo J et\u00a0al (2024) Explainable and interpretable multimodal large language models: a comprehensive survey. Preprint at arXiv:2412.02104"},{"key":"361_CR41","doi-asserted-by":"crossref","unstructured":"Das BC, Amini MH, Wu Y (2024) Security and privacy challenges of large language models: a survey. Preprint at arXiv:2402.00888","DOI":"10.1145\/3712001"},{"key":"361_CR42","doi-asserted-by":"publisher","first-page":"109291","DOI":"10.1016\/J.ENGAPPAI.2024.109291","volume":"138","author":"D de Fitero-Dominguez","year":"2024","unstructured":"de Fitero-Dominguez D, Garc\u00eda-L\u00f3pez E, Garc\u00eda-Cabot A (2024) Enhanced automated code vulnerability repair using large language models. Eng Appl Artif Intell 138:109291. https:\/\/doi.org\/10.1016\/J.ENGAPPAI.2024.109291","journal-title":"Eng Appl Artif Intell"},{"key":"361_CR238","unstructured":"de\u00a0Jesus Coelho\u00a0da Silva G, Westphall CB (2024) A survey of large language models in cybersecurity. Preprint at arXiv:2402.16968"},{"key":"361_CR43","unstructured":"Dehghan M, Wu JJ, Fard FH et\u00a0al (2024) Mergerepair: An exploratory study on merging task-specific adapters in code llms for automated program repair. Preprint at arXiv:2408.09568"},{"key":"361_CR44","unstructured":"Deng G, Liu Y, Mayoral-Vilches V et\u00a0al (2023a) Pentestgpt: An llm-empowered automatic penetration testing tool. Preprint at arXiv:2308.06782"},{"key":"361_CR46","doi-asserted-by":"publisher","unstructured":"Deng Y, Xia CS, Peng H et\u00a0al (2023b) Large language models are zero-shot fuzzers: fuzzing deep-learning libraries via large language models. In: Proceedings of the 32nd ACM SIGSOFT International Symposium on Software Testing and Analysis. Association for Computing Machinery, New York, NY, USA, ISSTA 2023, p 423-435, https:\/\/doi.org\/10.1145\/3597926.3598067","DOI":"10.1145\/3597926.3598067"},{"key":"361_CR47","doi-asserted-by":"crossref","unstructured":"Deng Y, Xia CS, Yang C et\u00a0al (2023c) Large language models are edge-case fuzzers: Testing deep learning libraries via fuzzgpt. Preprint at arXiv:2304.02014","DOI":"10.1145\/3597926.3598067"},{"key":"361_CR45","doi-asserted-by":"publisher","unstructured":"Deng G, Liu Y, Li Y et\u00a0al (2024) Masterkey: automated jailbreaking of large language model chatbots. In: Proceedings 2024 Network and Distributed System Security Symposium. Internet Society, NDSS 2024, https:\/\/doi.org\/10.14722\/ndss.2024.24188","DOI":"10.14722\/ndss.2024.24188"},{"key":"361_CR48","unstructured":"Dettmers T, Pagnoni A, Holtzman A et\u00a0al (2024) Qlora: efficient finetuning of quantized llms. Adv Neural Inf Process Syst. 36"},{"key":"361_CR49","doi-asserted-by":"crossref","unstructured":"Dev S, Jha A, Goyal J et\u00a0al (2023) Building stereotype repositories with llms and community engagement for scale and depth. Cross-Cultural Considerations in NLP@ EACL 84","DOI":"10.18653\/v1\/2023.c3nlp-1.9"},{"issue":"3","key":"361_CR50","doi-asserted-by":"publisher","first-page":"220","DOI":"10.1038\/s42256-023-00626-4","volume":"5","author":"N Ding","year":"2023","unstructured":"Ding N, Qin Y, Yang G et al (2023) Parameter-efficient fine-tuning of large-scale pre-trained language models. Nat Machi Intell 5(3):220\u2013235","journal-title":"Nat Machi Intell"},{"key":"361_CR51","doi-asserted-by":"publisher","unstructured":"Ding P, Kuang J, Ma D et\u00a0al (2024) A wolf in sheep\u2019s clothing: Generalized nested jailbreak prompts can fool large language models easily. In: Duh K, G\u00f3mez-Adorno H, Bethard S (eds) Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), NAACL 2024, Mexico City, Mexico, June 16-21, 2024. Association for Computational Linguistics, pp 2136\u20132153, https:\/\/doi.org\/10.18653\/V1\/2024.NAACL-LONG.118","DOI":"10.18653\/V1\/2024.NAACL-LONG.118"},{"key":"361_CR52","doi-asserted-by":"crossref","unstructured":"Donadel D, Marchiori F, Pajola L et\u00a0al (2024) Can llms understand computer networks? towards a virtual system administrator. Preprint at arXiv:2404.12689","DOI":"10.1109\/LCN60385.2024.10639641"},{"key":"361_CR53","unstructured":"Dong G, Yuan H, Lu K et\u00a0al (2023) How abilities in large language models are affected by supervised fine-tuning data composition. Preprint at arXiv:2310.05492"},{"key":"361_CR54","unstructured":"Dong X, Wang Y, Yu PS et\u00a0al (2024) Disclosure and mitigation of gender bias in llms. Preprint at arXiv:2402.11190"},{"key":"361_CR55","doi-asserted-by":"publisher","unstructured":"Du X, Wen M, Zhu J et\u00a0al (2024a) Generalization-enhanced code vulnerability detection via multi-task instruction fine-tuning. In: Ku L, Martins A, Srikumar V (eds) Findings of the Association for Computational Linguistics, ACL 2024, Bangkok, Thailand and virtual meeting, August 11-16, 2024. Association for Computational Linguistics, pp 10507\u201310521, https:\/\/doi.org\/10.18653\/V1\/2024.FINDINGS-ACL.625","DOI":"10.18653\/V1\/2024.FINDINGS-ACL.625"},{"key":"361_CR56","unstructured":"Du X, Zheng G, Wang K et\u00a0al (2024b) Vul-rag: Enhancing llm-based vulnerability detection via knowledge-level rag. Preprint at arXiv:2406.11147"},{"issue":"1","key":"361_CR57","first-page":"12","volume":"1","author":"N Elhage","year":"2021","unstructured":"Elhage N, Nanda N, Olsson C et al (2021) A mathematical framework for transformer circuits. Trans Circuits Thread 1(1):12","journal-title":"Trans Circuits Thread"},{"key":"361_CR58","unstructured":"Elhage N, Hume T, Olsson C et\u00a0al (2022) Toy models of superposition. Trans Circuits Thread"},{"key":"361_CR59","doi-asserted-by":"publisher","unstructured":"Esmradi A, Yip DW, Chan C (2023) A comprehensive survey of attack techniques, implementation, and mitigation strategies in large language models. In: Wang G, Wang H, Min G et\u00a0al (eds) Ubiquitous Security - Third International Conference, UbiSec 2023, Exeter, UK, November 1-3, 2023, Revised Selected Papers, Communications in Computer and Information Science, vol 2034. Springer, pp 76\u201395, https:\/\/doi.org\/10.1007\/978-981-97-1274-8_6","DOI":"10.1007\/978-981-97-1274-8_6"},{"key":"361_CR60","unstructured":"Fang C, Miao N, Srivastav S et\u00a0al (2024a) Large language models for code analysis: Do llms really do their job? In: Balzarotti D, Xu W (eds) 33rd USENIX Security Symposium, USENIX Security 2024, Philadelphia, PA, USA, August 14-16, 2024. USENIX Association, https:\/\/www.usenix.org\/conference\/usenixsecurity24\/presentation\/fang"},{"key":"361_CR61","unstructured":"Fang R, Bindu R, Gupta A et\u00a0al (2024b) Llm agents can autonomously exploit one-day vulnerabilities. Preprint at arXiv:2404.08144"},{"key":"361_CR62","unstructured":"Fang R, Bindu R, Gupta A et\u00a0al (2024c) Llm agents can autonomously hack websites. Preprint at arXiv:2402.06664"},{"key":"361_CR63","unstructured":"Fang R, Bindu R, Gupta A et\u00a0al (2024d) Teams of llm agents can exploit zero-day vulnerabilities. Preprint at arXiv:2406.01637"},{"key":"361_CR64","unstructured":"Fayyazi R, Yang SJ (2023) On the uses of large language models to interpret ambiguous cyberattack descriptions. Preprint at arXiv:2306.14062"},{"key":"361_CR65","unstructured":"Fayyazi R, Taghdimi R, Yang SJ (2024) Advancing ttp analysis: Harnessing the power of encoder-only and decoder-only language models with retrieval augmented generation. Preprint at arXiv:2401.00280"},{"key":"361_CR66","doi-asserted-by":"publisher","unstructured":"Feng S, Chen C (2024) Prompting is all you need: Automated android bug replay with large language models. In: Proceedings of the 46th IEEE\/ACM International Conference on Software Engineering, ICSE 2024, Lisbon, Portugal, April 14-20, 2024. ACM, pp 67:1\u201367:13,https:\/\/doi.org\/10.1145\/3597503.3608137","DOI":"10.1145\/3597503.3608137"},{"key":"361_CR67","unstructured":"Ferrag MA, Battah A, Tihanyi N et\u00a0al (2023) Securefalcon: The next cyber reasoning system for cyber security. Preprint at arXiv:2307.06616"},{"key":"361_CR68","doi-asserted-by":"crossref","unstructured":"Ferrag MA, Alwahedi F, Battah A et\u00a0al (2024a) Generative ai and large language models for cyber security: All insights you need. Preprint at arXiv:2405.12750","DOI":"10.2139\/ssrn.4853709"},{"key":"361_CR69","doi-asserted-by":"publisher","first-page":"23733","DOI":"10.1109\/ACCESS.2024.3363469","volume":"12","author":"MA Ferrag","year":"2024","unstructured":"Ferrag MA, Ndhlovu M, Tihanyi N et al (2024b) Revolutionizing cyber threat detection with large language models: a privacy-preserving bert-based lightweight model for iot\/iiot devices. IEEE Access 12:23733\u201323750. https:\/\/doi.org\/10.1109\/ACCESS.2024.3363469","journal-title":"IEEE Access"},{"key":"361_CR70","doi-asserted-by":"crossref","unstructured":"Fieblinger R, Alam MT, Rastogi N (2024) Actionable cyber threat intelligence using knowledge graphs and large language models. In: 2024 IEEE European Symposium on Security and Privacy Workshops (EuroS &PW), IEEE, pp 100\u2013111","DOI":"10.1109\/EuroSPW61312.2024.00018"},{"key":"361_CR71","unstructured":"Francia J, Hansen D, Schooley B et\u00a0al (2024) Assessing AI vs human-authored spear phishing sms attacks: An empirical study using the trapd method. Preprint at arXiv:2406.13049"},{"key":"361_CR72","doi-asserted-by":"publisher","unstructured":"Fujima H, Kumamoto T, Yoshida Y (2023) Using chatgpt to analyze ransomware messages and to predict ransomware threats. https:\/\/doi.org\/10.21203\/rs.3.rs-3645967\/v1","DOI":"10.21203\/rs.3.rs-3645967\/v1"},{"key":"361_CR73","unstructured":"Gao L, la\u00a0Tour TD, Tillman H et\u00a0al (2024) Scaling and evaluating sparse autoencoders. Preprint at arXiv:2406.04093"},{"key":"361_CR74","unstructured":"Gao Z, Wang H, Zhou Y et\u00a0al (2023) How far have we gone in vulnerability detection using large language models. Preprint at arXiv:2311.12420"},{"key":"361_CR75","unstructured":"Ge Y, Hua W, Mei K et\u00a0al (2024) Openagi: When llm meets domain experts. Adv Neural Inf Process Syst. 36"},{"key":"361_CR76","doi-asserted-by":"crossref","unstructured":"Ghelani D (2022) Cyber security, cyber threats, implications and future perspectives: a review. Authorea Preprints","DOI":"10.22541\/au.166385207.73483369\/v1"},{"key":"361_CR77","unstructured":"Gon\u00e7alves J, Dias T, Maia E et\u00a0al (2024) Scope: Evaluating llms for software vulnerability detection. Preprint at arXiv:2407.14372"},{"key":"361_CR78","doi-asserted-by":"crossref","unstructured":"Guastalla M, Li Y, Hekmati A et\u00a0al (2023) Application of large language models to ddos attack detection. In: International Conference on Security and Privacy in Cyber-Physical Systems and Smart Vehicles, Springer, pp 83\u201399","DOI":"10.1007\/978-3-031-51630-6_6"},{"key":"361_CR79","doi-asserted-by":"publisher","unstructured":"Gulati A, Qin J, Chiu C et\u00a0al (2020) Conformer: Convolution-augmented transformer for speech recognition. In: Meng H, Xu B, Zheng TF (eds) 21st Annual Conference of the International Speech Communication Association, Interspeech 2020, Virtual Event, Shanghai, China, October 25-29, 2020. ISCA, pp 5036\u20135040, https:\/\/doi.org\/10.21437\/INTERSPEECH.2020-3015","DOI":"10.21437\/INTERSPEECH.2020-3015"},{"key":"361_CR80","unstructured":"Guo H, Yang J, Liu J et\u00a0al (2024a) OWL: A large language model for IT operations. In: The Twelfth International Conference on Learning Representations, ICLR 2024, Vienna, Austria, May 7-11, 2024. OpenReview.net, https:\/\/openreview.net\/forum?id=SZOQ9RKYJu"},{"key":"361_CR81","doi-asserted-by":"crossref","unstructured":"Guo Y, Patsakis C, Hu Q et\u00a0al (2024b) Outside the comfort zone: Analysing llm capabilities in software vulnerability detection. In: European symposium on research in computer security, Springer, pp 271\u2013289","DOI":"10.1007\/978-3-031-70879-4_14"},{"key":"361_CR82","doi-asserted-by":"publisher","first-page":"80218","DOI":"10.1109\/ACCESS.2023.3300381","volume":"11","author":"M Gupta","year":"2023","unstructured":"Gupta M, Akiri C, Aryal K et al (2023) From chatgpt to threatgpt: impact of generative AI in cybersecurity and privacy. IEEE Access 11:80218\u201380245. https:\/\/doi.org\/10.1109\/ACCESS.2023.3300381","journal-title":"IEEE Access"},{"key":"361_CR83","doi-asserted-by":"publisher","unstructured":"Han X, Yuan S, Trabelsi M (2023) Loggpt: Log anomaly detection via GPT. In: He J, Palpanas T, Hu X et\u00a0al (eds) IEEE International Conference on Big Data, BigData 2023, Sorrento, Italy, December 15-18, 2023. IEEE, pp 1117\u20131122, https:\/\/doi.org\/10.1109\/BIGDATA59044.2023.10386543","DOI":"10.1109\/BIGDATA59044.2023.10386543"},{"key":"361_CR84","doi-asserted-by":"publisher","unstructured":"Happe A, Cito J (2023) Getting pwn\u2019d by AI: Penetration testing with large language models. In: Proceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering. Association for Computing Machinery, New York, NY, USA, ESEC\/FSE 2023, p 2082-2086, https:\/\/doi.org\/10.1145\/3611643.3613083","DOI":"10.1145\/3611643.3613083"},{"key":"361_CR85","unstructured":"Happe A, Kaplan A, Cito J (2023) Evaluating llms for privilege-escalation scenarios. Preprint at arXiv:2310.11409"},{"key":"361_CR86","unstructured":"Hays S, White DJ (2024) Employing llms for incident response planning and review. Preprint at arXiv:2403.01271"},{"key":"361_CR87","doi-asserted-by":"publisher","unstructured":"He J, Vechev M (2023) Large language models for code: Security hardening and adversarial testing. In: Proceedings of the 2023 ACM SIGSAC Conference on Computer and Communications Security. ACM, CCS \u201923, https:\/\/doi.org\/10.1145\/3576915.3623175","DOI":"10.1145\/3576915.3623175"},{"key":"361_CR88","unstructured":"He J, Vero M, Krasnopolska G et\u00a0al (2024) Instruction tuning for secure code generation. In: Forty-first International Conference on Machine Learning, ICML 2024, Vienna, Austria, July 21-27, 2024. OpenReview.net, https:\/\/openreview.net\/forum?id=MgTzMaYHvG"},{"key":"361_CR89","doi-asserted-by":"publisher","unstructured":"He R, Liu L, Ye H et\u00a0al (2021) On the effectiveness of adapter-based tuning for pretrained language model adaptation. In: Zong C, Xia F, Li W et\u00a0al (eds) Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, ACL\/IJCNLP 2021, (Volume 1: Long Papers), Virtual Event, August 1-6, 2021. Association for Computational Linguistics, pp 2208\u20132222, https:\/\/doi.org\/10.18653\/V1\/2021.ACL-LONG.172","DOI":"10.18653\/V1\/2021.ACL-LONG.172"},{"key":"361_CR90","doi-asserted-by":"crossref","unstructured":"Heiding F, Schneier B, Vishwanath A et\u00a0al (2023) Devising and detecting phishing: Large language models vs. smaller human models. Preprint at arXiv:2308.12287","DOI":"10.1109\/ACCESS.2024.3375882"},{"key":"361_CR91","doi-asserted-by":"crossref","unstructured":"Hendrycks D, Mazeika M, Woodside T (2023) An overview of catastrophic AI risks. Preprint at arXiv:2306.12001","DOI":"10.1201\/9781003530336-1"},{"key":"361_CR92","unstructured":"Hossen MI, Zhang J, Cao Y et\u00a0al (2024) Assessing cybersecurity vulnerabilities in code large language models. Preprint at arXiv:2404.18567"},{"key":"361_CR93","doi-asserted-by":"crossref","unstructured":"Hou X, Zhao Y, Liu Y et\u00a0al (2023) Large language models for software engineering: a systematic literature review. ACM Trans Softw Eng Methodol","DOI":"10.1145\/3695988"},{"key":"361_CR94","unstructured":"Hu EJ, Shen Y, Wallis P et\u00a0al (2022) Lora: Low-rank adaptation of large language models. In: The Tenth International Conference on Learning Representations, ICLR 2022, Virtual Event, April 25-29, 2022. OpenReview.net, https:\/\/openreview.net\/forum?id=nZeVKeeFYf9"},{"key":"361_CR95","unstructured":"Hu J, Zhang Q, Yin H (2023a) Augmenting greybox fuzzing with generative AI. Preprint at arXiv:2306.06782"},{"key":"361_CR96","doi-asserted-by":"publisher","unstructured":"Hu S, Huang T, Ilhan F et\u00a0al (2023b) Large language model-powered smart contract vulnerability detection: New perspectives. In: 5th IEEE International Conference on Trust, Privacy and Security in Intelligent Systems and Applications, TPS-ISA 2023, Atlanta, GA, USA, November 1-4, 2023. IEEE, pp 297\u2013306, https:\/\/doi.org\/10.1109\/TPS-ISA58951.2023.00044","DOI":"10.1109\/TPS-ISA58951.2023.00044"},{"key":"361_CR97","doi-asserted-by":"publisher","DOI":"10.1016\/J.COSE.2024.103999","volume":"145","author":"Y Hu","year":"2024","unstructured":"Hu Y, Zou F, Han J et al (2024) LLM-TIKG: threat intelligence knowledge graph construction utilizing large language model. Comput Secur 145:103999. https:\/\/doi.org\/10.1016\/J.COSE.2024.103999","journal-title":"Comput Secur"},{"key":"361_CR98","doi-asserted-by":"crossref","unstructured":"Huang J, Zhu Q (2023) Penheal: a two-stage llm framework for automated pentesting and optimal remediation. In: Proceedings of the Workshop on Autonomous Cybersecurity, pp 11\u201322","DOI":"10.1145\/3689933.3690831"},{"key":"361_CR99","unstructured":"Huang L, Yu W, Ma W et\u00a0al (2023a) A survey on hallucination in large language models: principles, taxonomy, challenges, and open questions. ACM Trans Inf Syst"},{"key":"361_CR100","unstructured":"Huang Y, Du H, Zhang X et\u00a0al (2023b) Large language models for networking: Applications, enabling techniques, and challenges. Preprint at arXiv:2311.17474"},{"key":"361_CR101","unstructured":"Huang Y, Sun L, Wang H et\u00a0al (2024) Trustllm: Trustworthiness in large language models. In: Forty-first International Conference on Machine Learning, ICML 2024,Vienna, Austria, July 21-27, 2024"},{"key":"361_CR102","unstructured":"Huben R, Cunningham H, Smith LR et\u00a0al (2023) Sparse autoencoders find highly interpretable features in language models. In: The Twelfth International Conference on Learning Representations"},{"key":"361_CR103","unstructured":"Hubinger E, Denison C, Mu J et\u00a0al (2024) Sleeper agents: Training deceptive llms that persist through safety training. Preprint at arXiv:2401.05566"},{"key":"361_CR104","unstructured":"Ibrahim A, Th\u00e9rien B, Gupta K et\u00a0al (2024) Simple and scalable strategies to continually pre-train large language models. Preprint at arXiv:2403.08763"},{"key":"361_CR105","unstructured":"Inan H, Upasani K, Chi J et\u00a0al (2023) Llama guard: Llm-based input-output safeguard for human-AI conversations. Preprint at arXiv:2312.06674"},{"key":"361_CR106","doi-asserted-by":"publisher","unstructured":"Ince P, Luo X, Yu J et\u00a0al (2024) Detect Llama - Finding Vulnerabilities in Smart Contracts Using Large Language Models, Springer, Singapore, p 424-443. https:\/\/doi.org\/10.1007\/978-981-97-5101-3_23","DOI":"10.1007\/978-981-97-5101-3_23"},{"key":"361_CR107","unstructured":"Islam NT, Khoury J, Seong A et\u00a0al (2024) Llm-powered code vulnerability repair with reinforcement learning and semantic reward. Preprint at arXiv:2401.03374"},{"key":"361_CR108","doi-asserted-by":"crossref","unstructured":"Jamal S, Wimmer H (2023) An improved transformer-based model for detecting phishing, spam, and ham: a large language model approach. Preprint at arXiv:2311.04913","DOI":"10.21203\/rs.3.rs-3608294\/v1"},{"key":"361_CR109","unstructured":"Jensen RIT, Tawosi V, Alamir S (2024) Software vulnerability and functionality assessment using llms. Preprint at arXiv:2403.08429"},{"key":"361_CR110","unstructured":"Ji H, Yang J, Chai L et\u00a0al (2024) Sevenllm: Benchmarking, eliciting, and enhancing abilities of large language models in cyber threat intelligence. Preprint at arXiv:2405.03446"},{"issue":"12","key":"361_CR111","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3571730","volume":"55","author":"Z Ji","year":"2023","unstructured":"Ji Z, Lee N, Frieske R et al (2023) Survey of hallucination in natural language generation. ACM Comput Surv 55(12):1\u201338","journal-title":"ACM Comput Surv"},{"key":"361_CR113","unstructured":"Jiang N, Wang C, Liu K et\u00a0al (2023a) Nova+: Generative language models for binaries. Preprint at arXiv:2311.13721"},{"key":"361_CR114","unstructured":"Jiang S, Chen X, Tang R (2023b) Prompt packer: deceiving llms through compositional instruction with hidden attacks. Preprint at arXiv:2310.10077"},{"key":"361_CR112","unstructured":"Jiang AQ, Sablayrolles A, Roux A et\u00a0al (2024a) Mixtral of experts. Preprint at arXiv:2401.04088"},{"key":"361_CR115","doi-asserted-by":"crossref","unstructured":"Jiang Y, Liang J, Ma F et\u00a0al (2024b) When fuzzing meets llms: Challenges and opportunities. In: Companion Proceedings of the 32nd ACM International Conference on the Foundations of Software Engineering, pp 492\u2013496","DOI":"10.1145\/3663529.3663784"},{"key":"361_CR116","unstructured":"Jin J, Tang B, Ma M et\u00a0al (2024) Crimson: Empowering strategic reasoning in cybersecurity through large language models. Preprint at arXiv:2403.00878"},{"key":"361_CR117","doi-asserted-by":"publisher","unstructured":"Jin M, Shahriar S, Tufano M et\u00a0al (2023) Inferfix: end-to-end program repair with llms. In: Chandra S, Blincoe K, Tonella P (eds) Proceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, ESEC\/FSE 2023, San Francisco, CA, USA, December 3-9, 2023. ACM, pp 1646\u20131656https:\/\/doi.org\/10.1145\/3611643.3613892","DOI":"10.1145\/3611643.3613892"},{"key":"361_CR118","doi-asserted-by":"publisher","unstructured":"Kabir S, Udo-Imeh DN, Kou B et\u00a0al (2024) Is stack overflow obsolete? an empirical study of the characteristics of chatgpt answers to stack overflow questions. In: Mueller FF, Kyburz P, Williamson JR et\u00a0al (eds) Proceedings of the CHI Conference on Human Factors in Computing Systems, CHI 2024, Honolulu, HI, USA, May 11-16, 2024. ACM, pp 935:1\u2013935:17, https:\/\/doi.org\/10.1145\/3613904.3642596","DOI":"10.1145\/3613904.3642596"},{"key":"361_CR119","unstructured":"Kaheh M, Kholgh DK, Kostakos P (2023) Cyber sentinel: Exploring conversational agents in streamlining security tasks with gpt-4. Preprint at arXiv:2309.16422"},{"issue":"3","key":"361_CR120","doi-asserted-by":"publisher","first-page":"59","DOI":"10.1007\/S10922-024-09831-X","volume":"32","author":"E Karlsen","year":"2024","unstructured":"Karlsen E, Luo X, Zincir-Heywood N et al (2024) Benchmarking large language models for log analysis, security, and interpretation. J Netw Syst Manag 32(3):59. https:\/\/doi.org\/10.1007\/S10922-024-09831-X","journal-title":"J Netw Syst Manag"},{"key":"361_CR121","unstructured":"Kaur P, Kashyap GS, Kumar A et\u00a0al (2024) From text to transformation: A comprehensive review of large language models\u2019 versatility. Preprint at arXiv:2402.16142"},{"key":"361_CR122","doi-asserted-by":"crossref","unstructured":"Kaur R, Gabrijel\u010di\u010d D, Klobu\u010dar T (2023) Artificial intelligence for cybersecurity: Literature review and future research directions. Information Fusion NA:101804","DOI":"10.1016\/j.inffus.2023.101804"},{"key":"361_CR123","doi-asserted-by":"crossref","unstructured":"Kavian A, Pourhashem\u00a0Kallehbasti MM, Kazemi S et\u00a0al (2024) Llm security guard for code. In: Proceedings of the 28th International Conference on Evaluation and Assessment in Software Engineering, pp 600\u2013603","DOI":"10.1145\/3661167.3661263"},{"key":"361_CR124","unstructured":"Keller J, Nowakowski J (2024) Ai-powered patching: the future of automated vulnerability fixes. Tech. rep., google"},{"key":"361_CR125","unstructured":"Khare A, Dutta S, Li Z et\u00a0al (2023) Understanding the effectiveness of large language models in detecting security vulnerabilities. Preprint at arXiv:2311.16169"},{"key":"361_CR126","doi-asserted-by":"publisher","unstructured":"Khoury R, Avila AR, Brunelle J et\u00a0al (2023) How secure is code generated by chatgpt? In: IEEE International Conference on Systems, Man, and Cybernetics, SMC 2023, Honolulu, Oahu, HI, USA, October 1-4, 2023. IEEE, pp 2445\u20132451, https:\/\/doi.org\/10.1109\/SMC53992.2023.10394237","DOI":"10.1109\/SMC53992.2023.10394237"},{"key":"361_CR127","unstructured":"Kong J, Cheng M, Xie X et\u00a0al (2024) Contrastrepair: Enhancing conversation-based automated program repair via contrastive test case pairs. Preprint at arXiv:2403.01971"},{"key":"361_CR128","unstructured":"Kouliaridis V, Karopoulos G, Kambourakis G (2024) Assessing the effectiveness of llms in android application vulnerability analysis. Preprint at arXiv:2406.18894"},{"key":"361_CR129","unstructured":"Kour G, Zalmanovici M, Zwerdling N et\u00a0al (2023) Unveiling safety vulnerabilities of large language models. Preprint at arXiv:2311.04124"},{"key":"361_CR130","doi-asserted-by":"crossref","unstructured":"Kulsum U, Zhu H, Xu B et\u00a0al (2024) A case study of llm for automated vulnerability repair: Assessing impact of reasoning and patch validation feedback. In: Proceedings of the 1st ACM International Conference on AI-Powered Software, pp 103\u2013111","DOI":"10.1145\/3664646.3664770"},{"issue":"3","key":"361_CR131","doi-asserted-by":"publisher","first-page":"31","DOI":"10.57159\/gadl.jcmm.2.3.23064","volume":"2","author":"S Kumar","year":"2023","unstructured":"Kumar S, Gupta U, Singh AK et al (2023) Artificial intelligence: revolutionizing cyber security in the digital era. J Comput Mech Manag 2(3):31\u201342","journal-title":"J Comput Mech Manag"},{"key":"361_CR132","doi-asserted-by":"crossref","unstructured":"Kumar SS, Cummings M, Stimpson A (2024) Strengthening llm trust boundaries: A survey of prompt injection attacks surender suresh kumar dr. ml cummings dr. alexander stimpson. In: 2024 IEEE 4th International Conference on Human-Machine Systems (ICHMS), IEEE, pp 1\u20136","DOI":"10.1109\/ICHMS59971.2024.10555871"},{"key":"361_CR133","doi-asserted-by":"publisher","first-page":"181","DOI":"10.1016\/j.aiopen.2024.09.002","volume":"5","author":"J Lai","year":"2024","unstructured":"Lai J, Gan W, Wu J et al (2024) Large language models in law: a survey. AI Open. 5:181","journal-title":"AI Open."},{"key":"361_CR134","doi-asserted-by":"crossref","unstructured":"Lapid R, Langberg R, Sipper M (2023) Open sesame! universal black box jailbreaking of large language models. Preprint at arXiv:2309.01446","DOI":"10.3390\/app14167150"},{"key":"361_CR135","doi-asserted-by":"publisher","unstructured":"Le TK, Alimadadi S, Ko SY (2024) A study of vulnerability repair in javascript programs with large language models. In: Chua T, Ngo C, Lee RK et\u00a0al (eds) Companion Proceedings of the ACM on Web Conference 2024, WWW 2024, Singapore, Singapore, May 13-17, 2024. ACM, pp 666\u2013669, https:\/\/doi.org\/10.1145\/3589335.3651463","DOI":"10.1145\/3589335.3651463"},{"key":"361_CR136","unstructured":"Lee YT, Vijayakumar H, Qian Z et\u00a0al (2024) Static detection of filesystem vulnerabilities in android systems. Preprint at arXiv:2407.11279"},{"key":"361_CR137","doi-asserted-by":"publisher","unstructured":"Lemieux C, Inala JP, Lahiri SK et\u00a0al (2023) Codamosa: Escaping coverage plateaus in test generation $$\\cdot$$ with pre-trained large language models. In: 2023 IEEE\/ACM 45th International Conference on Software Engineering (ICSE), pp 919\u2013931, https:\/\/doi.org\/10.1109\/ICSE48619.2023.00085","DOI":"10.1109\/ICSE48619.2023.00085"},{"key":"361_CR138","doi-asserted-by":"publisher","unstructured":"Lester B, Al-Rfou R, Constant N (2021) The power of scale for parameter-efficient prompt tuning. In: Moens M, Huang X, Specia L et\u00a0al (eds) Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, EMNLP 2021, Virtual Event \/ Punta Cana, Dominican Republic, 7-11 November, 2021. Association for Computational Linguistics, pp 3045\u20133059, https:\/\/doi.org\/10.18653\/V1\/2021.EMNLP-MAIN.243","DOI":"10.18653\/V1\/2021.EMNLP-MAIN.243"},{"key":"361_CR139","unstructured":"Levi M, Alluouche Y, Ohayon D et\u00a0al (2024) Cyberpal. ai: Empowering llms with expert-driven cybersecurity instructions. Preprint at arXiv:2408.09304"},{"key":"361_CR140","unstructured":"Li G, Li Y, Guannan W et\u00a0al (2023a) Seceval: A comprehensive benchmark for evaluating cybersecurity knowledge of foundation models. https:\/\/github.com\/XuanwuAI\/SecEval"},{"key":"361_CR142","doi-asserted-by":"publisher","unstructured":"Li H, Guo D, Fan W et\u00a0al (2023b) Multi-step jailbreaking privacy attacks on chatgpt. In: Bouamor H, Pino J, Bali K (eds) Findings of the Association for Computational Linguistics: EMNLP 2023, Singapore, December 6-10, 2023. Association for Computational Linguistics, pp 4138\u20134153, https:\/\/doi.org\/10.18653\/V1\/2023.FINDINGS-EMNLP.272","DOI":"10.18653\/V1\/2023.FINDINGS-EMNLP.272"},{"key":"361_CR143","unstructured":"Li H, Hao Y, Zhai Y et\u00a0al (2023c) The hitchhiker\u2019s guide to program analysis: a journey with large language models. Preprint at arXiv:2308.00245"},{"key":"361_CR146","unstructured":"Li R, Allal LB, Zi Y et\u00a0al (2023d) Starcoder: may the source be with you! Trans Mach Learn Res 2023. https:\/\/openreview.net\/forum?id=KoFOg41haE"},{"key":"361_CR148","unstructured":"Li Y, Du M, Song R et\u00a0al (2023e) A survey on fairness in large language models. Preprint at arXiv:2308.10149"},{"key":"361_CR149","doi-asserted-by":"crossref","unstructured":"Li Y, Wang S, Ding H et\u00a0al (2023f) Large language models in finance: a survey. In: Proceedings of the Fourth ACM International Conference on AI in Finance, pp 374\u2013382","DOI":"10.1145\/3604237.3626869"},{"key":"361_CR141","doi-asserted-by":"crossref","unstructured":"Li G, Zhi C, Chen J et\u00a0al (2024a) Exploring parameter-efficient fine-tuning of large language model on automated program repair. In: Proceedings of the 39th IEEE\/ACM International Conference on Automated Software Engineering, pp 719\u2013731","DOI":"10.1145\/3691620.3695066"},{"key":"361_CR144","doi-asserted-by":"crossref","unstructured":"Li J, Rabbi F, Cheng C et\u00a0al (2024b) An exploratory study on fine-tuning large language models for secure code generation. Preprint at arXiv:2408.09078","DOI":"10.1145\/3650105.3652299"},{"key":"361_CR145","unstructured":"Li N, Pan A, Gopal A et\u00a0al (2024c) The WMDP benchmark: Measuring and reducing malicious use with unlearning. In: Forty-first International Conference on Machine Learning, ICML 2024, Vienna, Austria, July 21-27, 2024. OpenReview.net"},{"key":"361_CR150","unstructured":"Li Z, Dutta S, Naik M (2024d) Llm-assisted static analysis for detecting security vulnerabilities. Preprint at arXiv:2405.17238"},{"key":"361_CR147","doi-asserted-by":"publisher","first-page":"8176","DOI":"10.1016\/j.egyr.2021.08.126","volume":"7","author":"Y Li","year":"2021","unstructured":"Li Y, Liu Q (2021) A comprehensive review study of cyber-attacks and cyber security; emerging trends and recent developments. Energy Rep 7:8176\u20138186","journal-title":"Energy Rep"},{"key":"361_CR151","unstructured":"Lin YZ, Mamun M, Chowdhury MA et\u00a0al (2023) Hw-v2w-map: Hardware vulnerability to weakness mapping framework for root cause analysis with gpt-assisted mitigation suggestion. Preprint at arXiv:2312.13530"},{"key":"361_CR152","unstructured":"Lin Z, Cui J, Liao X et\u00a0al (2024) Malla: Demystifying real-world large language model integrated malicious services. In: Balzarotti D, Xu W (eds) 33rd USENIX Security Symposium, USENIX Security 2024, Philadelphia, PA, USA, August 14-16, 2024. USENIX Association, https:\/\/www.usenix.org\/conference\/usenixsecurity24\/presentation\/lin-zilong"},{"key":"361_CR153","doi-asserted-by":"crossref","unstructured":"Liu B, Huo W, Zhang C et\u00a0al (2018) $$\\alpha$$diff: cross-version binary code similarity detection with dnn. In: Proceedings of the 33rd ACM\/IEEE international conference on automated software engineering, pp 667\u2013678","DOI":"10.1145\/3238147.3238199"},{"key":"361_CR154","doi-asserted-by":"publisher","unstructured":"Liu H, Wang Y, Fan W et\u00a0al (2023a) Trustworthy ai: A computational perspective. ACM Transactions on Intelligent Systems and Technology p 1-59. https:\/\/doi.org\/10.1145\/3546872, http:\/\/dx.doi.org\/10.1145\/3546872","DOI":"10.1145\/3546872"},{"key":"361_CR155","unstructured":"Liu J, Huang J, Huo Y et\u00a0al (2023b) Log-based anomaly detection based on evt theory with feedback. Preprint at arXiv:2306.05032"},{"key":"361_CR157","unstructured":"Liu P, Liu J, Fu L et\u00a0al (2023c) How chatgpt is solving vulnerability management problem. Preprint at arXiv:2311.06530"},{"key":"361_CR158","unstructured":"Liu P, Sun C, Zheng Y et\u00a0al (2023d) Harnessing the power of llm to support binary taint analysis. Preprint at arXiv:2310.08275"},{"key":"361_CR160","doi-asserted-by":"crossref","unstructured":"Liu X, Zheng Y, Du Z et\u00a0al (2023e) Gpt understands, too. AI Open. NA","DOI":"10.1016\/j.aiopen.2023.08.012"},{"key":"361_CR161","unstructured":"Liu Y, Jia Y, Geng R et\u00a0al (2023f) Prompt injection attacks and defenses in llm-integrated applications. Preprint at arXiv:2310.12815"},{"key":"361_CR159","doi-asserted-by":"crossref","unstructured":"Liu X, Ji K, Fu Y et\u00a0al (2021) P-tuning v2: Prompt tuning can be comparable to fine-tuning universally across scales and tasks. Preprint at arXiv:2110.07602","DOI":"10.18653\/v1\/2022.acl-short.8"},{"key":"361_CR165","unstructured":"Liu Z (2023) Secqa: A concise question-answering dataset for evaluating large language models in computer security. Preprint at arXiv:2312.15838"},{"key":"361_CR156","unstructured":"Liu J, Xia CS, Wang Y et\u00a0al (2024a) Is your code generated by chatgpt really correct? rigorous evaluation of large language models for code generation. Adv Neural Inf Process Syst. 36"},{"key":"361_CR162","unstructured":"Liu Y, Pei C, Xu L et\u00a0al (2024b) Opseval: A comprehensive it operations benchmark suite for large language models. Preprint at arXiv:2310.07637"},{"key":"361_CR163","doi-asserted-by":"publisher","unstructured":"Liu Y, Tao S, Meng W et\u00a0al (2024c) Interpretable online log analysis using large language models with prompt strategies. In: Steinmacher I, Linares-V\u00e1squez M, Moran KP et\u00a0al (eds) Proceedings of the 32nd IEEE\/ACM International Conference on Program Comprehension, ICPC 2024, Lisbon, Portugal, April 15-16, 2024. ACM, pp 35\u201346, https:\/\/doi.org\/10.1145\/3643916.3644408","DOI":"10.1145\/3643916.3644408"},{"key":"361_CR164","unstructured":"Liu Y, Yuan Y, Wang C et\u00a0al (2024d) From summary to action: Enhancing large language models for complex tasks with open world apis. Preprint at arXiv:2402.18157"},{"key":"361_CR167","doi-asserted-by":"publisher","unstructured":"Liu Z, Chen C, Wang J et\u00a0al (2024e) Make LLM a testing expert: Bringing human-like interaction to mobile GUI testing via functionality-aware decisions. In: Proceedings of the 46th IEEE\/ACM International Conference on Software Engineering, ICSE 2024, Lisbon, Portugal, April 14-20, 2024. ACM, pp 100:1\u2013100:13, https:\/\/doi.org\/10.1145\/3597503.3639180","DOI":"10.1145\/3597503.3639180"},{"key":"361_CR168","unstructured":"Liu Z, Shi J, Buford JF (2024f) Cyberbench: A multi-task benchmark for evaluating large language models in cybersecurity. In: AAAI 2024 Workshop on Artificial Intelligence for Cyber Security"},{"key":"361_CR166","doi-asserted-by":"publisher","unstructured":"Liu Z, Liao Q, Gu W et\u00a0al (2023g) Software vulnerability detection with gpt and in-context learning. In: 2023 8th International Conference on Data Science in Cyberspace (DSC), pp 229\u2013236, https:\/\/doi.org\/10.1109\/DSC59305.2023.00041","DOI":"10.1109\/DSC59305.2023.00041"},{"issue":"6","key":"361_CR169","doi-asserted-by":"publisher","first-page":"1548","DOI":"10.1109\/TSE.2024.3392499","volume":"50","author":"Z Liu","year":"2024","unstructured":"Liu Z, Tang Y, Luo X et al (2024) No need to lift a finger anymore? assessing the quality of code generation by chatgpt. IEEE Trans Software Eng 50(6):1548\u20131584. https:\/\/doi.org\/10.1109\/TSE.2024.3392499","journal-title":"IEEE Trans Software Eng"},{"key":"361_CR170","unstructured":"Lozhkov A, Li R, Allal LB et\u00a0al (2024) Starcoder 2 and the stack v2: The next generation. Preprint at arXiv:2402.19173"},{"key":"361_CR171","unstructured":"Lu H, Peng H, Nan G et\u00a0al (2024) Malsight: Exploring malicious source code and benign pseudocode for iterative binary malware summarization. Preprint at arXiv:2406.18379"},{"key":"361_CR172","unstructured":"Luo Z, Xu C, Zhao P et\u00a0al (2024) Wizardcoder: Empowering code large language models with evol-instruct. In: The Twelfth International Conference on Learning Representations, ICLR 2024, Vienna, Austria, May 7-11, 2024. OpenReview.net, https:\/\/openreview.net\/forum?id=UnUwSIgK5W"},{"key":"361_CR173","doi-asserted-by":"crossref","unstructured":"Mahyari AA (2024) Harnessing the power of llms in source code vulnerability detection. Preprint at arXiv:2408.03489","DOI":"10.1109\/MILCOM61039.2024.10774025"},{"key":"361_CR174","doi-asserted-by":"publisher","unstructured":"Mani SK, Zhou Y, Hsieh K et\u00a0al (2023) Enhancing network management using code generated by large language models. In: Proceedings of the 22nd ACM Workshop on Hot Topics in Networks. Association for Computing Machinery, New York, NY, USA, HotNets \u201923, p 196-204, https:\/\/doi.org\/10.1145\/3626111.3628183","DOI":"10.1145\/3626111.3628183"},{"key":"361_CR175","unstructured":"Mao Q, Li Z, Hu X et\u00a0al (2024a) Towards effectively detecting and explaining vulnerabilities using large language models. Preprint at arXiv:2406.09701"},{"key":"361_CR176","doi-asserted-by":"crossref","unstructured":"Mao Z, Li J, Li M et\u00a0al (2024b) Multi-role consensus through llms discussions for vulnerability detection. Preprint at arXiv:2403.14274","DOI":"10.1109\/QRS-C63300.2024.00173"},{"key":"361_CR177","unstructured":"Mathews NS, Brus Y, Aafer Y et\u00a0al (2024) Llbezpeky: Leveraging large language models for vulnerability detection. Preprint at arXiv:2401.01269"},{"key":"361_CR178","doi-asserted-by":"publisher","unstructured":"Maynez J, Narayan S, Bohnet B et\u00a0al (2020) On faithfulness and factuality in abstractive summarization. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, Online, pp 1906\u20131919, https:\/\/doi.org\/10.18653\/v1\/2020.acl-main.173","DOI":"10.18653\/v1\/2020.acl-main.173"},{"key":"361_CR179","doi-asserted-by":"crossref","unstructured":"Meng R, Mirchev M, B\u00f6hme M et\u00a0al (2024) Large language model guided protocol fuzzing. In: 31st Annual Network and Distributed System Security Symposium, NDSS 2024, San Diego, California, USA, February 26 - March 1, 2024. The Internet Society, https:\/\/www.ndss-symposium.org\/ndss-paper\/large-language-model-guided-protocol-fuzzing\/","DOI":"10.14722\/ndss.2024.24556"},{"key":"361_CR180","unstructured":"Miao Y, Bai Y, Chen L et\u00a0al (2023) An empirical study of netops capability of pre-trained large language models. Preprint at arXiv:2309.05557"},{"key":"361_CR181","doi-asserted-by":"publisher","DOI":"10.1016\/J.FSIDI.2023.301683","volume":"48","author":"G Michelet","year":"2024","unstructured":"Michelet G, Breitinger F (2024) Chatgpt, llama, can you write my report? an experiment on assisted digital forensics reports written using (local) large language models. Forensic Sci Int Digit Investig 48:301683. https:\/\/doi.org\/10.1016\/J.FSIDI.2023.301683","journal-title":"Forensic Sci Int Digit Investig"},{"issue":"1","key":"361_CR182","first-page":"65","volume":"4","author":"M Mijwil","year":"2023","unstructured":"Mijwil M, Aljanabi M et al (2023) Towards artificial intelligence-based cybersecurity: the practices and chatgpt generated ways to combat cybercrime. Iraqi J Comput Sci Math 4(1):65\u201370","journal-title":"Iraqi J Comput Sci Math"},{"key":"361_CR183","unstructured":"Minaee S, Mikolov T, Nikzad N et\u00a0al (2024) Large language models: a survey. Preprint at arXiv:2402.06196"},{"key":"361_CR184","unstructured":"Mitra S, Neupane S, Chakraborty T et\u00a0al (2024) Localintel: Generating organizational threat intelligence from global and local cyber knowledge. Preprint at arXiv:2401.10036"},{"key":"361_CR185","doi-asserted-by":"crossref","unstructured":"Mohammed SP, Hossain G (2024) Chatgpt in education, healthcare, and cybersecurity: Opportunities and challenges. In: 2024 IEEE 14th Annual Computing and Communication Workshop and Conference (CCWC), IEEE, pp 0316\u20130321","DOI":"10.1109\/CCWC60891.2024.10427923"},{"key":"361_CR186","unstructured":"Moskal S, Laney S, Hemberg E et\u00a0al (2023) Llms killed the script kiddie: How agents supported by large language models change the landscape of network threat testing. Preprint at arXiv:2310.06936"},{"key":"361_CR187","unstructured":"Motlagh FN, Hajizadeh M, Majd M et\u00a0al (2024) Large language models in cybersecurity: state-of-the-art. Preprint at arXiv:2402.00891"},{"key":"361_CR188","doi-asserted-by":"crossref","unstructured":"Mtsweni J, Gcaza N, Thaba M (2018) A unified cybersecurity framework for complex environments. In: Proceedings of the Annual Conference of the South African Institute of Computer Scientists and Information Technologists, pp 1\u20139","DOI":"10.1145\/3278681.3278682"},{"key":"361_CR189","doi-asserted-by":"crossref","unstructured":"Murthy S, Bakar AA, Rahim FA et\u00a0al (2019) A comparative study of data anonymization techniques. In: HPSC, IEEE, pp 306\u2013309","DOI":"10.1109\/BigDataSecurity-HPSC-IDS.2019.00063"},{"key":"361_CR190","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2023.110475","volume":"268","author":"B Nagy","year":"2023","unstructured":"Nagy B, Heged\u0171s I, S\u00e1ndor N et al (2023) Privacy-preserving federated learning and its application to natural language processing. Knowledge-Based Syst 268:110475","journal-title":"Knowledge-Based Syst"},{"key":"361_CR191","unstructured":"Nahmias D, Engelberg G, Klein D et\u00a0al (2024) Prompted contextual vectors for spear-phishing detection. Preprint at arXiv:2402.08309"},{"key":"361_CR192","unstructured":"Nijkamp E, Hayashi H, Xiong C et\u00a0al (2023a) Codegen2: Lessons for training llms on programming and natural languages. Preprint at arXiv:2305.02309"},{"key":"361_CR193","unstructured":"Nijkamp E, Pang B, Hayashi H et\u00a0al (2023b) Codegen: An open large language model for code with multi-turn program synthesis. In: The Eleventh International Conference on Learning Representations, ICLR 2023, Kigali, Rwanda, May 1-5, 2023. OpenReview.net, https:\/\/openreview.net\/forum?id=iaYcJKpY2B_"},{"key":"361_CR194","doi-asserted-by":"publisher","unstructured":"Omar M, Shiaeles S (2023) Vuldetect: A novel technique for detecting software vulnerabilities using language models. In: IEEE International Conference on Cyber Security and Resilience, CSR 2023, Venice, Italy, July 31 - Aug. 2, 2023. IEEE, pp 105\u2013110, https:\/\/doi.org\/10.1109\/CSR57506.2023.10224924","DOI":"10.1109\/CSR57506.2023.10224924"},{"key":"361_CR195","first-page":"27730","volume":"35","author":"L Ouyang","year":"2022","unstructured":"Ouyang L, Wu J, Jiang X et al (2022) Training language models to follow instructions with human feedback. Adv Neural Inf Process Syst 35:27730\u201327744","journal-title":"Adv Neural Inf Process Syst"},{"key":"361_CR196","unstructured":"Palacio DN, Velasco A, Rodriguez-Cardenas D et\u00a0al (2023) Evaluating and explaining large language models for code using syntactic structures. Preprint at arXiv:2308.03873"},{"key":"361_CR197","unstructured":"Pankajakshan R, Biswal S, Govindarajulu Y et\u00a0al (2024) Mapping llm security landscapes: a comprehensive stakeholder risk assessment proposal. Preprint at arXiv:2403.13309"},{"key":"361_CR198","unstructured":"Paria S, Dasgupta A, Bhunia S (2023) Divas: An llm-based end-to-end framework for soc security analysis and policy-based protection. Preprint at arXiv:2308.06932"},{"key":"361_CR199","doi-asserted-by":"publisher","unstructured":"Pasupuleti R, Vadapalli R, Mader C (2023) Cyber security issues and challenges related to generative ai and chatgpt. In: 2023 Tenth International Conference on Social Networks Analysis, Management and Security (SNAMS), pp 1\u20135, https:\/\/doi.org\/10.1109\/SNAMS60348.2023.10375472","DOI":"10.1109\/SNAMS60348.2023.10375472"},{"key":"361_CR200","doi-asserted-by":"publisher","unstructured":"Pearce H, Ahmad B, Tan B et\u00a0al (2022a) Asleep at the keyboard? assessing the security of github copilot\u2019s code contributions. In: 2022 IEEE Symposium on Security and Privacy (SP), pp 754\u2013768, https:\/\/doi.org\/10.1109\/SP46214.2022.9833571","DOI":"10.1109\/SP46214.2022.9833571"},{"key":"361_CR201","unstructured":"Pearce H, Tan B, Krishnamurthy P et\u00a0al (2022b) Pop quiz! can a large language model help with reverse engineering? Preprint at arXiv:2202.01142"},{"key":"361_CR202","doi-asserted-by":"publisher","unstructured":"Pearce H, Tan B, Ahmad B et\u00a0al (2023) Examining zero-shot vulnerability repair with large language models. In: 2023 IEEE Symposium on Security and Privacy (SP), pp 2339\u20132356, https:\/\/doi.org\/10.1109\/SP46215.2023.10179324","DOI":"10.1109\/SP46215.2023.10179324"},{"key":"361_CR203","unstructured":"Pedro R, Castro D, Carreira P et\u00a0al (2023) From prompt injections to sql injection attacks: How protected is your llm-integrated web application? Preprint at arXiv:2308.01990"},{"key":"361_CR204","doi-asserted-by":"crossref","unstructured":"Peris C, Dupuy C, Majmudar J et\u00a0al (2023) Privacy in the time of language models. In: WSDM, pp 1291\u20131292","DOI":"10.1145\/3539597.3575792"},{"key":"361_CR205","doi-asserted-by":"publisher","unstructured":"Perrina F, Marchiori F, Conti M et\u00a0al (2023) AGIR: automating cyber threat intelligence reporting with natural language generation. In: He J, Palpanas T, Hu X et\u00a0al (eds) IEEE International Conference on Big Data, BigData 2023, Sorrento, Italy, December 15-18, 2023. IEEE, pp 3053\u20133062, https:\/\/doi.org\/10.1109\/BIGDATA59044.2023.10386116","DOI":"10.1109\/BIGDATA59044.2023.10386116"},{"key":"361_CR206","doi-asserted-by":"publisher","unstructured":"Piet J, Alrashed M, Sitawarin C et\u00a0al (2024) Jatmo: Prompt injection defense by task-specific finetuning. In: Garc\u00eda-Alfaro J, Kozik R, Choras M et\u00a0al (eds) Computer Security - ESORICS 2024 - 29th European Symposium on Research in Computer Security, Bydgoszcz, Poland, September 16-20, 2024, Proceedings, Part I, Lecture Notes in Computer Science, vol 14982. Springer, pp 105\u2013124, https:\/\/doi.org\/10.1007\/978-3-031-70879-4_6","DOI":"10.1007\/978-3-031-70879-4_6"},{"key":"361_CR207","unstructured":"Prapty RT, Kundu A, Iyengar A (2024) Using retriever augmented large language models for attack graph generation. Preprint at arXiv:2408.05855"},{"issue":"21","key":"361_CR208","doi-asserted-by":"publisher","first-page":"6878","DOI":"10.3390\/s24216878","volume":"24","author":"D Pratama","year":"2024","unstructured":"Pratama D, Suryanto N, Adiputra AA et al (2024) Cipher: Cybersecurity intelligent penetration-testing helper for ethical researcher. Sensors 24(21):6878. https:\/\/doi.org\/10.3390\/s24216878","journal-title":"Sensors"},{"key":"361_CR209","unstructured":"Prenner JA, Robbes R (2021) Automatic program repair with openai\u2019s codex: Evaluating quixbugs. Preprint at arXiv:2111.03922"},{"key":"361_CR210","doi-asserted-by":"publisher","unstructured":"Purba MD, Ghosh A, Radford BJ et\u00a0al (2023) Software vulnerability detection using large language models. In: 2023 IEEE 34th International Symposium on Software Reliability Engineering Workshops (ISSREW), pp 112\u2013119, https:\/\/doi.org\/10.1109\/ISSREW60843.2023.00058","DOI":"10.1109\/ISSREW60843.2023.00058"},{"key":"361_CR211","doi-asserted-by":"publisher","unstructured":"Qi J, Huang S, Luan Z et\u00a0al (2023) Loggpt: Exploring chatgpt for log-based anomaly detection. In: IEEE International Conference on High Performance Computing & Communications, Data Science & Systems, Smart City & Dependability in Sensor, Cloud & Big Data Systems & Application, HPCC\/DSS\/SmartCity\/DependSys 2023, Melbourne, Australia, December 17-21, 2023. IEEE, pp 273\u2013280, https:\/\/doi.org\/10.1109\/HPCC-DSS-SMARTCITY-DEPENDSYS60770.2023.00045","DOI":"10.1109\/HPCC-DSS-SMARTCITY-DEPENDSYS60770.2023.00045"},{"key":"361_CR212","unstructured":"Qiao B, Li L, Zhang X et\u00a0al (2023) Taskweaver: A code-first agent framework. Preprint at arXiv:2311.17541"},{"key":"361_CR213","unstructured":"Qin Y, Liang S, Ye Y et\u00a0al (2024) Toolllm: Facilitating large language models to master 16000+ real-world apis. In: The Twelfth International Conference on Learning Representations, ICLR 2024, Vienna, Austria, May 7-11, 2024. OpenReview.net, https:\/\/openreview.net\/forum?id=dHng2O0Jjr"},{"key":"361_CR214","unstructured":"Qiu H, Zhang S, Li A et\u00a0al (2023) Latent jailbreak: A benchmark for evaluating text safety and output robustness of large language models. Preprint at arXiv:2307.08487"},{"key":"361_CR215","unstructured":"Radford A, Narasimhan K (2018) Improving language understanding by generative pre-training. https:\/\/api.semanticscholar.org\/CorpusID:49313245"},{"key":"361_CR216","unstructured":"Rajapaksha S, Rani R, Karafili E (2024) A rag-based question-answering solution for cyber-attack investigation and attribution. Preprint at arXiv:2408.06272"},{"key":"361_CR217","doi-asserted-by":"crossref","unstructured":"Reti D, Becker N, Angeli T et\u00a0al (2024) Act as a honeytoken generator! an investigation into honeytoken generation with large language models. Preprint at arXiv:2404.16118","DOI":"10.1145\/3689935.3690394"},{"key":"361_CR218","doi-asserted-by":"publisher","unstructured":"Rigaki M, Luk\u00e1s O, Catania CA et\u00a0al (2024) Out of the cage: How stochastic parrots win in cyber security environments. In: Rocha AP, Steels L, van\u00a0den Herik HJ (eds) Proceedings of the 16th International Conference on Agents and Artificial Intelligence, ICAART 2024, Volume 3, Rome, Italy, February 24-26, 2024. SCITEPRESS, pp 774\u2013781, https:\/\/doi.org\/10.5220\/0012391800003636","DOI":"10.5220\/0012391800003636"},{"key":"361_CR219","unstructured":"Roy SS, Thota P, Naragam KV et\u00a0al (2024) From chatbots to phishbots? \u2013 preventing phishing scams created using chatgpt, google bard and claude. Preprint at arXiv:2310.19181"},{"key":"361_CR220","unstructured":"Roziere B, Gehring J, Gloeckle F et\u00a0al (2023) Code llama: Open foundation models for code. Preprint at arXiv:2308.12950"},{"key":"361_CR221","unstructured":"Ruan J, Chen Y, Zhang B et\u00a0al (2023) Tptu: Large language model-based ai agents for task planning and tool usage. Preprint at arXiv:2308.03427"},{"key":"361_CR222","doi-asserted-by":"publisher","first-page":"155498","DOI":"10.1109\/ACCESS.2024.3427369","volume":"12","author":"D Saha","year":"2024","unstructured":"Saha D, Tarek S, Yahyaei K et al (2024) LLM for soc security: a paradigm shift. IEEE Access 12:155498\u2013155521. https:\/\/doi.org\/10.1109\/ACCESS.2024.3427369","journal-title":"IEEE Access"},{"key":"361_CR223","doi-asserted-by":"crossref","unstructured":"Sahoo P, Singh AK, Saha S et\u00a0al (2024) A systematic survey of prompt engineering in large language models: Techniques and applications. Preprint at arXiv:2402.07927","DOI":"10.1007\/979-8-8688-0569-1_4"},{"key":"361_CR224","unstructured":"Sandoval G, Pearce H, Nys T et\u00a0al (2023) Lost at c: A user study on the security implications of large language model code assistants. In: 32nd USENIX Security Symposium (USENIX Security 23). USENIX Association, Anaheim, CA, pp 2205\u20132222, https:\/\/www.usenix.org\/conference\/usenixsecurity23\/presentation\/sandoval"},{"key":"361_CR225","doi-asserted-by":"publisher","unstructured":"Sarabi A, Yin T, Liu M (2023) An llm-based framework for fingerprinting internet-connected devices. In: Proceedings of the 2023 ACM on Internet Measurement Conference. Association for Computing Machinery, New York, NY, USA, IMC \u201923, p 478-484, https:\/\/doi.org\/10.1145\/3618257.3624845","DOI":"10.1145\/3618257.3624845"},{"issue":"10","key":"361_CR226","doi-asserted-by":"publisher","first-page":"2119","DOI":"10.1111\/risa.13309","volume":"39","author":"NM Scala","year":"2019","unstructured":"Scala NM, Reilly AC, Goethals PL et al (2019) Risk and the five hard problems of cybersecurity. Risk Anal 39(10):2119\u20132126","journal-title":"Risk Anal"},{"key":"361_CR227","doi-asserted-by":"publisher","DOI":"10.1016\/j.fsidi.2023.301609","volume":"46","author":"M Scanlon","year":"2023","unstructured":"Scanlon M, Breitinger F, Hargreaves C et al (2023) Chatgpt for digital forensic investigation: the good, the bad, and the unknown. Forensic Sci Int Digit Investig. 46:301609. https:\/\/doi.org\/10.1016\/j.fsidi.2023.301609 (https:\/\/www.sciencedirect.com\/science\/article\/pii\/S266628172300121X)","journal-title":"Forensic Sci Int Digit Investig."},{"key":"361_CR228","unstructured":"Schwartz Y, Benshimol L, Mimran D et\u00a0al (2024) Llmcloudhunter: Harnessing llms for automated extraction of detection rules from cloud-based cti. Preprint at arXiv:2407.05194"},{"key":"361_CR229","unstructured":"Sekhari A, Acharya J, Kamath G et\u00a0al (2021) Remember what you want to forget: Algorithms for machine unlearning. In: NeurIPS, pp 18075\u201318086"},{"key":"361_CR230","unstructured":"Shao M, Jancheska S, Udeshi M et\u00a0al (2024) Nyu ctf dataset: A scalable open-source benchmark dataset for evaluating llms in offensive security. Preprint at arXiv:2406.05590"},{"key":"361_CR231","doi-asserted-by":"publisher","unstructured":"Sharma P, Dash B (2023) Impact of big data analytics and chatgpt on cybersecurity. In: 2023 4th International Conference on Computing and Communication Systems (I3CS), pp 1\u20136, https:\/\/doi.org\/10.1109\/I3CS58314.2023.10127411","DOI":"10.1109\/I3CS58314.2023.10127411"},{"key":"361_CR232","doi-asserted-by":"crossref","unstructured":"Shen X, Chen Z, Backes M et\u00a0al (2023) \u201cdo anything now\u201d: Characterizing and evaluating in-the-wild jailbreak prompts on large language models. Preprint at arXiv:2308.03825","DOI":"10.1145\/3658644.3670388"},{"key":"361_CR233","unstructured":"Shestov A, Levichev R, Mussabayev R et\u00a0al (2024) Finetuning large language models for vulnerability detection. Preprint at arXiv:2401.17010"},{"key":"361_CR234","unstructured":"Shi J, Liu Y, Zhou P et\u00a0al (2023) Badgpt: Exploring security vulnerabilities of chatgpt via backdoor attacks to instructgpt. Preprint at arXiv:2304.12298"},{"key":"361_CR235","doi-asserted-by":"publisher","unstructured":"Siddiq ML, Santos JCS (2022) Securityeval dataset: mining vulnerability examples to evaluate machine learning-based code generation techniques. In: Proceedings of the 1st International Workshop on Mining Software Repositories Applications for Privacy and Security. Association for Computing Machinery, New York, NY, USA, MSR4P &S 2022, p 29-33, https:\/\/doi.org\/10.1145\/3549035.3561184","DOI":"10.1145\/3549035.3561184"},{"key":"361_CR236","unstructured":"Siddiq ML, Santos JCS (2023) Generate and pray: Using sallms to evaluate the security of llm generated code. Preprint at arXiv:2311.00889"},{"key":"361_CR237","unstructured":"Silva A, Fang S, Monperrus M (2023) Repairllama: Efficient representations and fine-tuned adapters for program repair. Preprint at arXiv:2312.15698"},{"key":"361_CR239","doi-asserted-by":"publisher","unstructured":"Singla T, Anandayuvaraj D, Kalu KG et\u00a0al (2023) An empirical study on using large language models to analyze software supply chain security failures. In: Proceedings of the 2023 Workshop on Software Supply Chain Offensive Research and Ecosystem Defenses. Association for Computing Machinery, New York, NY, USA, SCORED \u201923, p 5-15, https:\/\/doi.org\/10.1145\/3605770.3625214","DOI":"10.1145\/3605770.3625214"},{"key":"361_CR240","unstructured":"Siracusano G, Sanvito D, Gonzalez R et\u00a0al (2023) Time for action: Automated analysis of cyber threat intelligence in the wild. Preprint at arXiv:2307.10214"},{"key":"361_CR241","doi-asserted-by":"publisher","unstructured":"Sladic M, Valeros V, Catania CA et\u00a0al (2024) LLM in the shell: Generative honeypots. In: IEEE European Symposium on Security and Privacy Workshops, EuroS &PW 2024, Vienna, Austria, July 8-12, 2024. IEEE, pp 430\u2013435, https:\/\/doi.org\/10.1109\/EUROSPW61312.2024.00054","DOI":"10.1109\/EUROSPW61312.2024.00054"},{"key":"361_CR242","doi-asserted-by":"publisher","unstructured":"Sobania D, Briesch M, Hanna C et\u00a0al (2023) An analysis of the automatic bug fixing performance of chatgpt. In: IEEE\/ACM International Workshop on Automated Program Repair, APR@ICSE 2023, Melbourne, Australia, May 16, 2023. IEEE, pp 23\u201330, https:\/\/doi.org\/10.1109\/APR59189.2023.00012","DOI":"10.1109\/APR59189.2023.00012"},{"key":"361_CR243","unstructured":"Stewart I (2024) A framework to evaluate the risks of llms for assisting cbrn production processes. https:\/\/nonproliferation.org\/a-framework-to-evaluate-the-risks-of-llms-for-assisting-cbrn-production-processes\/, Accessed 31 Dec 2024"},{"key":"361_CR244","doi-asserted-by":"crossref","unstructured":"Storhaug A, Li J, Hu T (2023) Efficient avoidance of vulnerabilities in auto-completed smart contract code using vulnerability-constrained decoding. In: 2023 IEEE 34th International Symposium on Software Reliability Engineering (ISSRE), IEEE, pp 683\u2013693","DOI":"10.1109\/ISSRE59848.2023.00035"},{"key":"361_CR245","doi-asserted-by":"publisher","unstructured":"Sun C, Lo D, Khoo S et\u00a0al (2011) Towards more accurate retrieval of duplicate bug reports. In: Alexander P, Pasareanu CS, Hosking JG (eds) 26th IEEE\/ACM International Conference on Automated Software Engineering (ASE 2011), Lawrence, KS, USA, November 6-10, 2011. IEEE Computer Society, pp 253\u2013262, https:\/\/doi.org\/10.1109\/ASE.2011.6100061","DOI":"10.1109\/ASE.2011.6100061"},{"key":"361_CR246","unstructured":"Sun Y, Wu D, Xue Y et\u00a0al (2024a) Llm4vuln: A unified evaluation framework for decoupling and enhancing llms\u2019 vulnerability reasoning. Preprint at arXiv:2401.16185"},{"key":"361_CR247","doi-asserted-by":"publisher","unstructured":"Sun Y, Wu D, Xue Y et\u00a0al (2024b) Gptscan: Detecting logic vulnerabilities in smart contracts by combining GPT with program analysis. In: Proceedings of the 46th IEEE\/ACM International Conference on Software Engineering, ICSE 2024, Lisbon, Portugal, April 14-20, 2024. ACM, pp 166:1\u2013166:13, https:\/\/doi.org\/10.1145\/3597503.3639117","DOI":"10.1145\/3597503.3639117"},{"key":"361_CR248","doi-asserted-by":"publisher","unstructured":"Tabassi E (2023) Artificial intelligence risk management framework (AI rmf 1.0). https:\/\/doi.org\/10.6028\/NIST.AI.100-1, https:\/\/tsapps.nist.gov\/publication\/get_pdf.cfm?pub_id=936225","DOI":"10.6028\/NIST.AI.100-1"},{"key":"361_CR249","unstructured":"Tamberg K, Bahsi H (2024) Harnessing large language models for software vulnerability detection: A comprehensive benchmarking study. Preprint at arXiv:2405.15614"},{"key":"361_CR250","unstructured":"Tambon F, Dakhel AM, Nikanjam A et\u00a0al (2024) Bugs in large language models generated code: an empirical study. Preprint at arXiv:2403.08937"},{"key":"361_CR251","doi-asserted-by":"crossref","unstructured":"Tan H, Luo Q, Li J et\u00a0al (2024) Llm4decompile: Decompiling binary code with large language models. In: Al-Onaizan Y, Bansal M, Chen Y (eds) Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, EMNLP 2024, Miami, FL, USA, November 12-16, 2024. Association for Computational Linguistics, pp 3473\u20133487, https:\/\/aclanthology.org\/2024.emnlp-main.203","DOI":"10.18653\/v1\/2024.emnlp-main.203"},{"key":"361_CR252","unstructured":"Tang H, Hu K, Zhou JP et\u00a0al (2024) Code repair with llms gives an exploration-exploitation tradeoff. Preprint at arXiv:2405.17503"},{"key":"361_CR253","unstructured":"Tang X, Chen Z, Kim K et\u00a0al (2023) Just-in-time security patch detection \u2013 llm at the rescue for data augmentation. Preprint at arXiv:2312.01241"},{"key":"361_CR254","unstructured":"Tann W, Liu Y, Sim JH et\u00a0al (2023) Using large language models for cybersecurity capture-the-flag challenges and certification questions. Preprint at arXiv:2308.10443"},{"key":"361_CR255","unstructured":"Team G, Anil R, Borgeaud S et\u00a0al (2023) Gemini: A family of highly capable multimodal models. Preprint at arXiv:2312.11805"},{"key":"361_CR256","unstructured":"Templeton A, Conerly T, Marcus J et\u00a0al (2024) Scaling monosemanticity: extracting interpretable features from claude 3 sonnet. Transformer Circuits Thread"},{"key":"361_CR257","doi-asserted-by":"crossref","unstructured":"Thakur K, Qiu M, Gai K et\u00a0al (2015) An investigation on cyber security threats and security models. In: 2015 IEEE 2nd international conference on cyber security and cloud computing, IEEE, pp 307\u2013311","DOI":"10.1109\/CSCloud.2015.71"},{"key":"361_CR258","doi-asserted-by":"publisher","unstructured":"Tian R, Ye Y, Qin Y et\u00a0al (2024) Debugbench: Evaluating debugging capability of large language models. In: Ku L, Martins A, Srikumar V (eds) Findings of the Association for Computational Linguistics, ACL 2024, Bangkok, Thailand and virtual meeting, August 11-16, 2024. Association for Computational Linguistics, pp 4173\u20134198, https:\/\/doi.org\/10.18653\/V1\/2024.FINDINGS-ACL.247","DOI":"10.18653\/V1\/2024.FINDINGS-ACL.247"},{"key":"361_CR259","doi-asserted-by":"publisher","unstructured":"Tihanyi N, Bisztray T, Jain R et\u00a0al (2023) The formai dataset: Generative AI in software security through the lens of formal verification. In: Proceedings of the 19th International Conference on Predictive Models and Data Analytics in Software Engineering. Association for Computing Machinery, New York, NY, USA, PROMISE 2023, p 33-43, https:\/\/doi.org\/10.1145\/3617555.3617874","DOI":"10.1145\/3617555.3617874"},{"key":"361_CR260","unstructured":"Tihanyi N, Bisztray T, Ferrag MA et\u00a0al (2024a) Do neutral prompts produce insecure code? formai-v2 dataset: Labelling vulnerabilities in code generated by large language models. Preprint at arXiv:2404.18353"},{"key":"361_CR261","unstructured":"Tihanyi N, Ferrag MA, Jain R et\u00a0al (2024b) Cybermetric: A benchmark dataset for evaluating large language models knowledge in cybersecurity. Preprint at arXiv:2402.07688"},{"key":"361_CR262","unstructured":"Tol MC, Sunar B (2023) Zeroleak: Using llms for scalable and cost effective side-channel patching. Preprint at arXiv:2308.13062"},{"key":"361_CR263","doi-asserted-by":"publisher","unstructured":"Tony C, Mutas M, Ferreyra NED et\u00a0al (2023) Llmseceval: A dataset of natural language prompts for security evaluations. In: 20th IEEE\/ACM International Conference on Mining Software Repositories, MSR 2023, Melbourne, Australia, May 15-16, 2023. IEEE, pp 588\u2013592, https:\/\/doi.org\/10.1109\/MSR59073.2023.00084","DOI":"10.1109\/MSR59073.2023.00084"},{"key":"361_CR264","unstructured":"Touvron H, Lavril T, Izacard G et\u00a0al (2023a) Llama: Open and efficient foundation language models. Preprint at arXiv:2302.13971"},{"key":"361_CR265","unstructured":"Touvron H, Martin L, Stone K et\u00a0al (2023b) Llama 2: Open foundation and fine-tuned chat models. Preprint at arXiv:2307.09288"},{"key":"361_CR266","unstructured":"Tseng P, Yeh Z, Dai X et\u00a0al (2024a) Using llms to automate threat intelligence analysis workflows in security operation centers. Preprint at arXiv:2407.13093"},{"key":"361_CR267","unstructured":"Tseng P, Yeh Z, Dai X et\u00a0al (2024b) Using llms to automate threat intelligence analysis workflows in security operation centers. Preprint at arXiv:2407.13093"},{"key":"361_CR268","unstructured":"Ullah S, Han M, Pujar S et\u00a0al (2023) Can large language models identify and reason about security vulnerabilities? not yet. Preprint at arXiv:2312.12575"},{"key":"361_CR269","unstructured":"Usman Y, Upadhyay A, Gyawali P et\u00a0al (2024) Is generative ai the next tactical cyber weapon for threat actors? unforeseen implications of ai generated cyber attacks. Preprint at arXiv:2408.12806"},{"key":"361_CR270","unstructured":"Varshney T (2023) Introduction to llm agents. https:\/\/developer.nvidia.com\/blog\/introduction-to-llm-agents\/"},{"issue":"3","key":"361_CR271","first-page":"608","volume":"63","author":"J Vasa","year":"2023","unstructured":"Vasa J, Thakkar A (2023) Deep learning: differential privacy preservation in the era of big data. J Comput Inf Syst 63(3):608\u2013631","journal-title":"J Comput Inf Syst"},{"key":"361_CR272","unstructured":"Vasilatos C, Mahboobeh DJ, Lamri H et\u00a0al (2024) Llmpot: Automated llm-based industrial protocol and physical process emulation for ics honeypots. Preprint at arXiv:2405.05999"},{"key":"361_CR273","unstructured":"Vaswani A, Shazeer N, Parmar N et\u00a0al (2017) Attention is all you need. Adv Neural Inf Process Syst. 30"},{"key":"361_CR274","doi-asserted-by":"publisher","unstructured":"V\u00f6r\u00f6s T, Bergeron SP, Berlin K (2023) Web content filtering through knowledge distillation of large language models. In: IEEE International Conference on Web Intelligence and Intelligent Agent Technology, WI-IAT 2023, Venice, Italy, October 26-29, 2023. IEEE, pp 357\u2013361, https:\/\/doi.org\/10.1109\/WI-IAT59888.2023.00058","DOI":"10.1109\/WI-IAT59888.2023.00058"},{"key":"361_CR275","unstructured":"Wang B (2021) Mesh-Transformer-JAX: Model-Parallel Implementation of Transformer Language Model with JAX. https:\/\/github.com\/kingoflolz\/mesh-transformer-jax"},{"key":"361_CR276","unstructured":"Wang B, Xu C, Wang S et\u00a0al (2021) Adversarial GLUE: A multi-task benchmark for robustness evaluation of language models. In: Proceedings of the Neural Information Processing Systems Track on Datasets and Benchmarks 1, NeurIPS Datasets and Benchmarks 2021, December 2021, virtual"},{"key":"361_CR280","doi-asserted-by":"crossref","unstructured":"Wang H, Qu W, Katz G et\u00a0al (2022) Jtrans: Jump-aware transformer for binary code similarity detection. In: Proceedings of the 31st ACM SIGSOFT International Symposium on Software Testing and Analysis, pp 1\u201313","DOI":"10.1145\/3533767.3534367"},{"key":"361_CR279","doi-asserted-by":"crossref","unstructured":"Wang F (2023) Using large language models to mitigate ransomware threats. Preprints","DOI":"10.31219\/osf.io\/mzsnh"},{"key":"361_CR277","unstructured":"Wang B, Chen W, Pei H et\u00a0al (2023a) Decodingtrust: A comprehensive assessment of trustworthiness in gpt models. In: Thirty-seventh Conference on Neural Information Processing Systems Datasets and Benchmarks Track"},{"key":"361_CR282","unstructured":"Wang J, Huang Z, Liu H et\u00a0al (2023b) Defecthunter: A novel llm-driven boosted-conformer-based code vulnerability detection mechanism. Preprint at arXiv:2309.15324"},{"key":"361_CR285","unstructured":"Wang L, Song M, Rezapour R et\u00a0al (2023c) People\u2019s perceptions toward bias and related concepts in large language models: a systematic review. Preprint at arXiv:2309.14504"},{"key":"361_CR289","unstructured":"Wang X, Wei J, Schuurmans D et\u00a0al (2023d) Self-consistency improves chain of thought reasoning in language models. In: The Eleventh International Conference on Learning Representations, ICLR 2023, Kigali, Rwanda, May 1-5, 2023. OpenReview.net, https:\/\/openreview.net\/forum?id=1PL1NIMMrw"},{"key":"361_CR291","unstructured":"Wang Z, Xie W, Chen K et\u00a0al (2023e) Self-deception: Reverse penetrating the semantic firewall of large language models. Preprint at arXiv:2308.11521"},{"key":"361_CR292","doi-asserted-by":"crossref","unstructured":"Wang Z, Zhang L, Cao C et\u00a0al (2023f) The effectiveness of large language models (chatgpt and codebert) for security-oriented code analysis. Available at SSRN 4567887","DOI":"10.2139\/ssrn.4567887"},{"key":"361_CR286","unstructured":"Wang L, Wang J, Jung K et\u00a0al (2024e) From sands to mansions: Enabling automatic full-life-cycle cyberattack construction with llm. Preprint at arXiv:2407.16928"},{"key":"361_CR278","unstructured":"Wang B, Chen M, Lin Y et\u00a0al (2024a) An exploratory study on using large language models for mutation testing. Preprint at arXiv:2406.09843"},{"key":"361_CR281","doi-asserted-by":"crossref","unstructured":"Wang H, Gao Z, Zhang C et\u00a0al (2024b) Clap: Learning transferable binary code representations with natural language supervision. In: Proceedings of the 33rd ACM SIGSOFT International Symposium on Software Testing and Analysis, pp 503\u2013515","DOI":"10.1145\/3650212.3652145"},{"issue":"1","key":"361_CR283","first-page":"48","volume":"47","author":"J Wang","year":"2024","unstructured":"Wang J, Hu X, Hou W et al (2024c) On the robustness of chatgpt: an adversarial and out-of-distribution perspective. IEEE Data Eng Bull 47(1):48\u201362","journal-title":"IEEE Data Eng Bull"},{"key":"361_CR284","unstructured":"Wang J, Luo X, Cao L et\u00a0al (2024d) Is your ai-generated code really safe? evaluating large language models on secure code generation with codeseceval. Preprint at arXiv:2407.02395"},{"key":"361_CR287","doi-asserted-by":"publisher","unstructured":"Wang M, Zhang N, Xu Z et\u00a0al (2024f) Detoxifying large language models via knowledge editing. In: Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), ACL 2024, Bangkok, Thailand, August 11-16, 2024. Association for Computational Linguistics, pp 3093\u20133118, https:\/\/doi.org\/10.18653\/V1\/2024.ACL-LONG.171","DOI":"10.18653\/V1\/2024.ACL-LONG.171"},{"key":"361_CR288","unstructured":"Wang W, Liu E, Guo X et\u00a0al (2024g) Anvil: Anomaly-based vulnerability identification without labelled training data. Preprint at arXiv:2408.16028"},{"key":"361_CR290","unstructured":"Wang Y, Guo T, Huang Z et\u00a0al (2024h) Revisiting evolutionary program repair via code language model. Preprint at arXiv:2408.10486"},{"key":"361_CR293","doi-asserted-by":"publisher","unstructured":"Wei Y, Xia CS, Zhang L (2023) Copiloting the copilots: Fusing large language models with completion engines for automated program repair. In: Proceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering. Association for Computing Machinery, New York, NY, USA, ESEC\/FSE 2023, p 172-184, https:\/\/doi.org\/10.1145\/3611643.3616271","DOI":"10.1145\/3611643.3616271"},{"key":"361_CR294","doi-asserted-by":"publisher","unstructured":"Welbl J, Glaese A, Uesato J et\u00a0al (2021) Challenges in detoxifying language models. In: Findings of the Association for Computational Linguistics: EMNLP 2021, Virtual Event \/ Punta Cana, Dominican Republic, 16-20 November, 2021. Association for Computational Linguistics, pp 2447\u20132469, https:\/\/doi.org\/10.18653\/V1\/2021.FINDINGS-EMNLP.210","DOI":"10.18653\/V1\/2021.FINDINGS-EMNLP.210"},{"key":"361_CR295","unstructured":"Wong K, Amayuelas A, Pan L et\u00a0al (2024) Investigating the transferability of code repair for low-resource programming languages. Preprint at arXiv:2406.14867"},{"key":"361_CR299","doi-asserted-by":"publisher","unstructured":"Wu Y, Jiang N, Pham HV et\u00a0al (2023) How effective are neural networks for fixing security vulnerabilities. In: Proceedings of the 32nd ACM SIGSOFT International Symposium on Software Testing and Analysis. ACM, ISSTA \u201923, https:\/\/doi.org\/10.1145\/3597926.3598135","DOI":"10.1145\/3597926.3598135"},{"key":"361_CR296","unstructured":"Wu F, Wu S, Cao Y et\u00a0al (2024a) Wipi: A new web threat for llm-driven web agents. Preprint at arXiv:2402.16965"},{"key":"361_CR297","unstructured":"Wu F, Zhang N, Jha S et\u00a0al (2024b) A new era in llm security: Exploring security concerns in real-world llm-based systems. Preprint at arXiv:2402.18649"},{"key":"361_CR298","unstructured":"Wu T, Luo L, Li YF et\u00a0al (2024c) Continual learning for large language models: a survey. Preprint at arXiv:2402.01364"},{"key":"361_CR300","unstructured":"Wu Y, Si S, Zhang Y et\u00a0al (2024d) Evaluating the performance of chatgpt for spam email detection. Preprint at arXiv:2402.15537"},{"key":"361_CR301","unstructured":"Wu Z, Tang F, Zhao M et\u00a0al (2024e) Kgv: Integrating large language models with knowledge graphs for cyber threat intelligence credibility assessment. Preprint at arXiv:2408.08088"},{"key":"361_CR302","unstructured":"Xi Z, Chen W, Guo X et\u00a0al (2023) The rise and potential of large language model based agents: a survey. Preprint at arXiv:2309.07864"},{"key":"361_CR303","unstructured":"Xia CS, Wei Y, Zhang L (2022) Practical program repair in the era of large pre-trained language models. Preprint at arXiv:2210.14179"},{"key":"361_CR304","doi-asserted-by":"publisher","unstructured":"Xia CS, Paltenghi M, Tian JL et\u00a0al (2024) Fuzz4all: Universal fuzzing with large language models. In: Proceedings of the 46th IEEE\/ACM International Conference on Software Engineering, ICSE 2024, Lisbon, Portugal, April 14-20, 2024. ACM, pp 126:1\u2013126:13, https:\/\/doi.org\/10.1145\/3597503.3639121","DOI":"10.1145\/3597503.3639121"},{"key":"361_CR305","unstructured":"Xiang J, Xu X, Kong F et\u00a0al (2024) How far can we go with practical function-level program repair? Preprint at arXiv:2404.12833"},{"key":"361_CR306","unstructured":"Xu J, Fu Y, Tan SH et\u00a0al (2024a) Aligning llms for fl-free program repair. Preprint at arXiv:2404.08877"},{"key":"361_CR307","unstructured":"Xu J, Stokes JW, McDonald G et\u00a0al (2024b) Autoattacker: A large language model guided system to implement automatic cyber-attacks. Preprint at arXiv:2403.01038"},{"key":"361_CR308","doi-asserted-by":"crossref","unstructured":"Xu K, Zhang GL, Yin X et\u00a0al (2024c) Automated c\/c++ program repair for high-level synthesis via large language models. In: Proceedings of the 2024 ACM\/IEEE International Symposium on Machine Learning for CAD, pp 1\u20139","DOI":"10.1145\/3670474.3685953"},{"key":"361_CR309","unstructured":"Xu Z, Jain S, Kankanhalli M (2024d) Hallucination is inevitable: An innate limitation of large language models. Preprint at arXiv:2401.11817"},{"key":"361_CR310","unstructured":"Xu Z, Liu Y, Deng G et\u00a0al (2024e) Llm jailbreak attack versus defense techniques\u2014a comprehensive study. Preprint at arXiv:2402.13457"},{"key":"361_CR311","doi-asserted-by":"publisher","unstructured":"Yan J, Yadav V, Li S et\u00a0al (2024a) Backdooring instruction-tuned large language models with virtual prompt injection. In: Duh K, G\u00f3mez-Adorno H, Bethard S (eds) Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), NAACL 2024, Mexico City, Mexico, June 16-21, 2024. Association for Computational Linguistics, pp 6065\u20136086, https:\/\/doi.org\/10.18653\/V1\/2024.NAACL-LONG.337","DOI":"10.18653\/V1\/2024.NAACL-LONG.337"},{"issue":"1","key":"361_CR312","doi-asserted-by":"publisher","first-page":"90","DOI":"10.1111\/bjet.13370","volume":"55","author":"L Yan","year":"2024","unstructured":"Yan L, Sha L, Zhao L et al (2024b) Practical and ethical challenges of large language models in education: a systematic scoping review. Br J Educ Technol 55(1):90\u2013112","journal-title":"Br J Educ Technol"},{"key":"361_CR313","unstructured":"Yan P, Tan S, Wang M et\u00a0al (2023) Prompt engineering-assisted malware dynamic analysis using gpt-4. Preprint at arXiv:2312.08317"},{"key":"361_CR314","unstructured":"Yang A, Xiao B, Wang B et\u00a0al (2023) Baichuan 2: Open large-scale language models. Preprint at arXiv:2309.10305"},{"key":"361_CR315","doi-asserted-by":"crossref","unstructured":"Yang AZ, Le\u00a0Goues C, Martins R et\u00a0al (2024a) Large language models for test-free fault localization. In: Proceedings of the 46th IEEE\/ACM International Conference on Software Engineering, pp 1\u201312","DOI":"10.1145\/3597503.3623342"},{"key":"361_CR316","unstructured":"Yang AZH, Kolak S, Hellendoorn VJ et\u00a0al (2024b) Revisiting unnaturalness for automated program repair in the era of large language models. Preprint at arXiv:2404.15236"},{"key":"361_CR317","unstructured":"Yang B, Tian H, Ren J et\u00a0al (2024c) Multi-objective fine-tuning for enhanced program repair with llms. Preprint at arXiv:2404.12636"},{"key":"361_CR318","unstructured":"Yang K, Liu J, Wu J et\u00a0al (2024d) If llm is the wizard, then code is the wand: A survey on how code empowers large language models to serve as intelligent agents. Preprint at arXiv:2401.00812"},{"key":"361_CR319","doi-asserted-by":"crossref","unstructured":"Yang KC, Menczer F (2023) Anatomy of an ai-powered malicious social botnet. Preprint at arXiv:2307.16336","DOI":"10.51685\/jqd.2024.icwsm.7"},{"key":"361_CR320","doi-asserted-by":"publisher","DOI":"10.1145\/3676961","author":"X Yang","year":"2024","unstructured":"Yang X, Rajbahadur GK, Lin D et al (2024) Simclone: detecting tabular data clones using value similarity. ACM Trans Softw Eng Methodol. https:\/\/doi.org\/10.1145\/3676961","journal-title":"ACM Trans Softw Eng Methodol"},{"key":"361_CR321","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2024.112234","volume":"219","author":"Y Yang","year":"2025","unstructured":"Yang Y, Zhou X, Mao R et al (2025) Dlap: a deep learning augmented large language model prompting framework for software vulnerability detection. J Syst Softw 219:112234","journal-title":"J Syst Softw"},{"key":"361_CR322","doi-asserted-by":"crossref","unstructured":"Yao D, Zhang J, Harris IG et\u00a0al (2023a) Fuzzllm: A novel and universal fuzzing framework for proactively discovering jailbreak vulnerabilities in large language models. Preprint at arXiv:2309.05274","DOI":"10.1109\/ICASSP48485.2024.10448041"},{"key":"361_CR324","doi-asserted-by":"publisher","unstructured":"Yao Y, Wang P, Tian B et\u00a0al (2023b) Editing large language models: Problems, methods, and opportunities. In: Bouamor H, Pino J, Bali K (eds) Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, EMNLP 2023, Singapore, December 6-10, 2023. Association for Computational Linguistics, pp 10222\u201310240, https:\/\/doi.org\/10.18653\/V1\/2023.EMNLP-MAIN.632","DOI":"10.18653\/V1\/2023.EMNLP-MAIN.632"},{"key":"361_CR323","doi-asserted-by":"publisher","unstructured":"Yao H, Lou J, Qin Z (2024a) Poisonprompt: Backdoor attack on prompt-based large language models. In: IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2024, Seoul, Republic of Korea, April 14-19, 2024. IEEE, pp 7745\u20137749, https:\/\/doi.org\/10.1109\/ICASSP48485.2024.10446267","DOI":"10.1109\/ICASSP48485.2024.10446267"},{"key":"361_CR325","doi-asserted-by":"crossref","unstructured":"Yao Y, Duan J, Xu K et\u00a0al (2024b) A survey on large language model (llm) security and privacy: The good, the bad, and the ugly. High-Confidence Computing p 100211","DOI":"10.1016\/j.hcc.2024.100211"},{"key":"361_CR326","doi-asserted-by":"crossref","unstructured":"Ye Q, Axmed M, Pryzant R et\u00a0al (2023) Prompt engineering a prompt engineer. Preprint at arXiv:2311.05661","DOI":"10.18653\/v1\/2024.findings-acl.21"},{"key":"361_CR327","unstructured":"Yigit Y, Buchanan WJ, Tehrani MG et\u00a0al (2024) Review of generative AI methods in cybersecurity. Preprint at arXiv:2403.08701"},{"key":"361_CR328","doi-asserted-by":"crossref","unstructured":"Yin X, Ni C, Wang S et\u00a0al (2024) Thinkrepair: Self-directed automated program repair. In: Proceedings of the 33rd ACM SIGSOFT International Symposium on Software Testing and Analysis, pp 1274\u20131286","DOI":"10.1145\/3650212.3680359"},{"key":"361_CR329","unstructured":"Yu J, Lin X, Yu Z et\u00a0al (2023) Gptfuzzer: Red teaming large language models with auto-generated jailbreak prompts. Preprint at arXiv:2309.10253"},{"key":"361_CR330","unstructured":"Yu J, Liang P, Fu Y et\u00a0al (2024) Security code review by llms: a deep dive into responses. Preprint at arXiv:2401.16310"},{"key":"361_CR331","doi-asserted-by":"crossref","unstructured":"Yuan T, He Z, Dong L et\u00a0al (2024) R-judge: Benchmarking safety risk awareness for LLM agents. In: Al-Onaizan Y, Bansal M, Chen Y (eds) Findings of the Association for Computational Linguistics: EMNLP 2024, Miami, Florida, USA, November 12-16, 2024. Association for Computational Linguistics, pp 1467\u20131490, https:\/\/aclanthology.org\/2024.findings-emnlp.79","DOI":"10.18653\/v1\/2024.findings-emnlp.79"},{"key":"361_CR332","unstructured":"\u00c7a\u011fatay Y\u0131ld\u0131z, Ravichandran NK, Punia P et\u00a0al (2024) Investigating continual pretraining in large language models: Insights and implications. Preprint at arXiv:2402.17400"},{"key":"361_CR333","unstructured":"Zahan N, Burckhardt P, Lysenko M et\u00a0al (2024) Shifting the lens: Detecting malware in npm ecosystem with large language models. Preprint at arXiv:2403.12196"},{"key":"361_CR334","doi-asserted-by":"publisher","unstructured":"Zhan Q, Liang Z, Ying Z et\u00a0al (2024) Injecagent: Benchmarking indirect prompt injections in tool-integrated large language model agents. In: Ku L, Martins A, Srikumar V (eds) Findings of the Association for Computational Linguistics, ACL 2024, Bangkok, Thailand and virtual meeting, August 11-16, 2024. Association for Computational Linguistics, pp 10471\u201310506, https:\/\/doi.org\/10.18653\/V1\/2024.FINDINGS-ACL.624","DOI":"10.18653\/V1\/2024.FINDINGS-ACL.624"},{"issue":"5","key":"361_CR345","doi-asserted-by":"publisher","first-page":"726","DOI":"10.1109\/TETCI.2021.3100641","volume":"5","author":"Y Zhang","year":"2021","unstructured":"Zhang Y, Ti\u0148o P, Leonardis A et al (2021) A survey on neural network interpretability. IEEE Trans Emerg Topics Comput Intell 5(5):726\u2013742","journal-title":"IEEE Trans Emerg Topics Comput Intell"},{"key":"361_CR336","unstructured":"Zhang C, Bai M, Zheng Y et\u00a0al (2023a) Understanding large language model based fuzz driver generation. Preprint at arXiv:2307.12469"},{"key":"361_CR338","doi-asserted-by":"crossref","unstructured":"Zhang J, Wen H, Deng L et\u00a0al (2023b) Hackmentor: Fine-tuning large language models for cybersecurity. In: 2023 IEEE International Conference on Trust, Security and Privacy in Computing and Communications (TrustCom), IEEE","DOI":"10.1109\/TrustCom60117.2023.00076"},{"key":"361_CR341","unstructured":"Zhang S, Dong L, Li X et\u00a0al (2023c) Instruction tuning for large language models: a survey. Preprint at arXiv:2308.10792"},{"key":"361_CR342","doi-asserted-by":"crossref","unstructured":"Zhang T, Irsan IC, Thung F et\u00a0al (2023d) Cupid: Leveraging chatgpt for more accurate duplicate bug report detection. Preprint at arXiv:2308.10022","DOI":"10.1145\/3576042"},{"key":"361_CR346","unstructured":"Zhang Y, Li Y, Cui L et\u00a0al (2023e) Siren\u2019s song in the ai ocean: a survey on hallucination in large language models. Preprint at arXiv:2309.01219"},{"key":"361_CR347","unstructured":"Zhang Y, Song W, Ji Z et\u00a0al (2023f) How well does llm generate security tests? Preprint at arXiv:2310.00710"},{"key":"361_CR335","unstructured":"Zhang AK, Perry N, Dulepet R et\u00a0al (2024a) Cybench: A framework for evaluating cybersecurity capabilities and risks of language models. Preprint at arXiv:2408.08926"},{"key":"361_CR337","doi-asserted-by":"publisher","unstructured":"Zhang C, Liu H, Zeng J et\u00a0al (2024b) Prompt-enhanced software vulnerability detection using chatgpt. In: Proceedings of the 2024 IEEE\/ACM 46th International Conference on Software Engineering: Companion Proceedings, ICSE Companion 2024, Lisbon, Portugal, April 14-20, 2024. ACM, pp 276\u2013277, https:\/\/doi.org\/10.1145\/3639478.3643065","DOI":"10.1145\/3639478.3643065"},{"key":"361_CR339","unstructured":"Zhang N, Yao Y, Tian B et\u00a0al (2024c) A comprehensive study of knowledge editing for large language models. Preprint at arXiv:2401.01286"},{"key":"361_CR340","unstructured":"Zhang Q, Fang C, Xie Y et\u00a0al (2024d) A systematic literature review on large language models for automated program repair. Preprint at arXiv:2405.01466"},{"key":"361_CR343","doi-asserted-by":"crossref","unstructured":"Zhang T, Chen X, Qu C et\u00a0al (2024e) Leveraging ai predicted and expert revised annotations in interactive segmentation: Continual tuning or full training? Preprint at arXiv:2402.19423","DOI":"10.1109\/ISBI56570.2024.10635518"},{"key":"361_CR344","unstructured":"Zhang W, Guo H, Le A et\u00a0al (2024f) Lemur: Log parsing with entropy sampling and chain-of-thought merging. Preprint at arXiv:2402.18205"},{"key":"361_CR348","doi-asserted-by":"crossref","unstructured":"Zhang Y, Du T, Ma Y et\u00a0al (2024g) Attackg+: Boosting attack knowledge graph construction with large language models. Preprint at arXiv:2405.04753","DOI":"10.1016\/j.cose.2024.104220"},{"key":"361_CR349","doi-asserted-by":"publisher","unstructured":"Zhao J, Rong Y, Guo Y et\u00a0al (2023) Understanding programs by exploiting (fuzzing) test cases. In: Rogers A, Boyd-Graber JL, Okazaki N (eds) Findings of the Association for Computational Linguistics: ACL 2023, Toronto, Canada, July 9-14, 2023. Association for Computational Linguistics, pp 10667\u201310679, https:\/\/doi.org\/10.18653\/V1\/2023.FINDINGS-ACL.678","DOI":"10.18653\/V1\/2023.FINDINGS-ACL.678"},{"key":"361_CR350","doi-asserted-by":"crossref","unstructured":"Zhao J, Yang D, Zhang L et\u00a0al (2024a) Enhancing automated program repair with solution design. In: Proceedings of the 39th IEEE\/ACM International Conference on Automated Software Engineering, pp 1706\u20131718","DOI":"10.1145\/3691620.3695537"},{"key":"361_CR351","doi-asserted-by":"crossref","unstructured":"Zhao S, Jia M, Luu AT et\u00a0al (2024b) Universal vulnerabilities in large language models: Backdoor attacks for in-context learning. In: Al-Onaizan Y, Bansal M, Chen Y (eds) Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, EMNLP 2024, Miami, FL, USA, November 12-16, 2024. Association for Computational Linguistics, pp 11507\u201311522, https:\/\/aclanthology.org\/2024.emnlp-main.642","DOI":"10.18653\/v1\/2024.emnlp-main.642"},{"key":"361_CR352","unstructured":"Zhao X, Yang X, Pang T et\u00a0al (2024c) Weak-to-strong jailbreaking on large language models. Preprint at arXiv:2401.17256"},{"key":"361_CR353","doi-asserted-by":"publisher","unstructured":"Zhao Y, Huang Z, Ma Y et\u00a0al (2024d) Repair: Automated program repair with process-based feedback. In: Ku L, Martins A, Srikumar V (eds) Findings of the Association for Computational Linguistics, ACL 2024, Bangkok, Thailand and virtual meeting, August 11-16, 2024. Association for Computational Linguistics, pp 16415\u201316429, https:\/\/doi.org\/10.18653\/V1\/2024.FINDINGS-ACL.973","DOI":"10.18653\/V1\/2024.FINDINGS-ACL.973"},{"key":"361_CR354","unstructured":"Zhao Z, Ma D, Chen L et\u00a0al (2024e) Chemdfm: Dialogue foundation model for chemistry. Preprint at arXiv:2401.14818"},{"key":"361_CR355","unstructured":"Zhou G, Guo X, Liu Z et\u00a0al (2024a) Trafficformer: an efficient pre-trained model for traffic data"},{"key":"361_CR356","unstructured":"Zhou H, Liu F, Gu B et\u00a0al (2024b) A survey of large language models in medicine: Progress, application, and challenge. Preprint at arXiv:2311.05112"},{"key":"361_CR357","doi-asserted-by":"crossref","unstructured":"Zhou X, Cao S, Sun X et\u00a0al (2024c) Large language model for vulnerability detection and repair: Literature review and roadmap. Preprint at arXiv:2404.02525","DOI":"10.1145\/3708522"},{"key":"361_CR358","unstructured":"Zhou X, Tran DM, Le-Cong T et\u00a0al (2024d) Comparison of static application security testing tools and large language models for repo-level vulnerability detection. Preprint at arXiv:2407.16235"},{"key":"361_CR359","unstructured":"Zhu S, Zhang R, An B et\u00a0al (2024) Autodan: interpretable gradient-based adversarial attacks on large language models. In: First Conference on Language Modeling"},{"key":"361_CR360","unstructured":"Ziems N, Liu G, Flanagan J et\u00a0al (2023) Explaining tree model decisions in natural language for network intrusion detection. Preprint at arXiv:2310.19658"},{"key":"361_CR361","unstructured":"Zoph B, Raffel C, Schuurmans D et\u00a0al (2022) Emergent abilities of large language models. TMLR"},{"key":"361_CR362","unstructured":"Zou A, Wang Z, Carlini N et\u00a0al (2023) Universal and transferable adversarial attacks on aligned language models. Preprint at arXiv:2307.15043"}],"container-title":["Cybersecurity"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s42400-025-00361-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s42400-025-00361-w\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s42400-025-00361-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,2,5]],"date-time":"2025-02-05T10:28:01Z","timestamp":1738751281000},"score":1,"resource":{"primary":{"URL":"https:\/\/cybersecurity.springeropen.com\/articles\/10.1186\/s42400-025-00361-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,2,5]]},"references-count":362,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2025,12]]}},"alternative-id":["361"],"URL":"https:\/\/doi.org\/10.1186\/s42400-025-00361-w","relation":{},"ISSN":["2523-3246"],"issn-type":[{"value":"2523-3246","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,2,5]]},"assertion":[{"value":"29 November 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"8 January 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 February 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no Conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"55"}}