{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,28]],"date-time":"2026-05-28T11:06:05Z","timestamp":1779966365640,"version":"3.53.1"},"reference-count":51,"publisher":"Wiley","issue":"1","license":[{"start":{"date-parts":[[2026,5,28]],"date-time":"2026-05-28T00:00:00Z","timestamp":1779926400000},"content-version":"vor","delay-in-days":147,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2026,1,1]],"date-time":"2026-01-01T00:00:00Z","timestamp":1767225600000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/doi.wiley.com\/10.1002\/tdm_license_1.1"}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["International Journal of Intelligent Systems"],"published-print":{"date-parts":[[2026,1]]},"abstract":"<jats:p>Artificial intelligence (AI) has become an essential tool in modern cybersecurity, enabling faster and more accurate detection, prevention, and response to threats. Within this landscape, large language models (LLMs) have emerged as versatile systems capable of generating code, providing technical guidance, and automating complex tasks. However, LLMs also introduce new security challenges, as they can be manipulated through prompt engineering and jailbreaking to perform malicious actions, potentially lowering the barrier for cyberattacks. This article investigates the risks and opportunities of LLMs using penetration testing, both as tools for ethical hacking and as potential targets themselves. We present an automatic framework that mutates prompts to test for jailbreak vulnerabilities across multiple LLM models, including GPT\u20103.5 turbo, GPT\u20104.1, and GPT\u20105.0. Our experiments demonstrate how mutated prompts can generate concrete attack scenarios and reveal differences in how various models respond to malicious inputs. By analyzing the effectiveness and limitations of these techniques, this work contributes to a deeper understanding of LLM security, providing insights for both offensive and defensive applications in AI\u2010driven cybersecurity.<\/jats:p>","DOI":"10.1155\/int\/9698691","type":"journal-article","created":{"date-parts":[[2026,5,28]],"date-time":"2026-05-28T10:31:49Z","timestamp":1779964309000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Pentesting LLM Models With an Automated Framework"],"prefix":"10.1155","volume":"2026","author":[{"ORCID":"https:\/\/orcid.org\/0009-0008-8266-6266","authenticated-orcid":false,"given":"Juan Luis","family":"L\u00f3pez-Delgado","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2263-2178","authenticated-orcid":false,"given":"Juan Antonio","family":"L\u00f3pez-Ramos","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2026,5,28]]},"reference":[{"key":"e_1_2_11_1_2","doi-asserted-by":"publisher","DOI":"10.1186\/s40537-024-00957-y"},{"key":"e_1_2_11_2_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11227-023-05764-5"},{"key":"e_1_2_11_3_2","doi-asserted-by":"crossref","unstructured":"JamilM. CreutzburgR. andAydinM. N. MathewL. SubramanianK. G. andNagarA. K. Enhancing Critical Infrastructure Cybersecurity: Leveraging AI-Based Solutions for Threat Detection Proceedings of International Conference on Theoretical and Applied Computing 2025 Singapore Springer Nature Singapore 157\u2013169.","DOI":"10.1007\/978-981-97-6957-5_14"},{"key":"e_1_2_11_4_2","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1007\/978-3-031-87778-0_3","volume-title":"Advanced Information Networking and Applications","author":"Aseeri A. M.","year":"2025"},{"key":"e_1_2_11_5_2","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1007\/978-3-031-96522-7_10","volume-title":"Artificial Intelligence for Global Security","author":"Ganesh N. S. G.","year":"2025"},{"key":"e_1_2_11_6_2","doi-asserted-by":"publisher","DOI":"10.61841\/turcomat.v9i3.14670"},{"key":"e_1_2_11_7_2","doi-asserted-by":"crossref","unstructured":"Abdiyeva-AliyevaG.andHematyarM. HemanthD. J. YigitT. KoseU. andGuvencU. AI-Based Network Security Anomaly Prediction and Detection in Future Network 4th International Conference on Artificial Intelligence and Applied Mathematics in Engineering 2023 Cham Springer International Publishing 149\u2013159.","DOI":"10.1007\/978-3-031-31956-3_13"},{"key":"e_1_2_11_8_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10462-025-11108-x"},{"key":"e_1_2_11_9_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCE.2023.3329253"},{"key":"e_1_2_11_10_2","doi-asserted-by":"publisher","DOI":"10.7717\/peerj-cs.1741"},{"key":"e_1_2_11_11_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10207-025-00992-7"},{"key":"e_1_2_11_12_2","doi-asserted-by":"crossref","first-page":"38","DOI":"10.1007\/978-3-031-94855-8_3","volume-title":"Cybersecurity","author":"Gon\u00e7alves J.","year":"2025"},{"key":"e_1_2_11_13_2","doi-asserted-by":"publisher","DOI":"10.1007\/s42979-024-03608-4"},{"key":"e_1_2_11_14_2","first-page":"195","article-title":"Using NLP and AI to Enhance Software Documentation and Code Comprehension","volume":"3","author":"Ibrahim A.","year":"2025","journal-title":"Spectrum of Engineering Sciences"},{"key":"e_1_2_11_15_2","doi-asserted-by":"crossref","unstructured":"\u00c7etinO. BirinciB. Uysal\u00c7. andAriefB. Pra\u00e7aI. BernardiS. andIn\u00e1cioP. R. Exploring the Cybercrime Potential of LLMs: A Focus on Phishing and Malware Generation Cybersecurity 2025 Springer Nature Switzerland 98\u2013115.","DOI":"10.1007\/978-3-031-94855-8_7"},{"key":"e_1_2_11_16_2","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1007\/978-981-96-0573-6_14","volume-title":"Web Information Systems Engineering\u2014WISE 2024","author":"Yamin M. M.","year":"2025"},{"key":"e_1_2_11_17_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2024.124912"},{"key":"e_1_2_11_18_2","doi-asserted-by":"crossref","first-page":"165","DOI":"10.1007\/978-3-031-85240-4_14","volume-title":"Advances in Social Networks Analysis and Miningspringer","author":"Fenza G.","year":"2026"},{"key":"e_1_2_11_19_2","first-page":"22","volume-title":"To Protect the LLM Agent Against the Prompt Injection Attack with Polymorphic Prompt","author":"Wang Z.","year":"2025"},{"key":"e_1_2_11_20_2","doi-asserted-by":"publisher","DOI":"10.1145\/3724393"},{"key":"e_1_2_11_21_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2024.3504286"},{"key":"e_1_2_11_22_2","doi-asserted-by":"crossref","first-page":"295","DOI":"10.1007\/978-981-97-7232-2_20","volume-title":"Web and Big Data","author":"Xu X.","year":"2024"},{"key":"e_1_2_11_23_2","first-page":"338","volume-title":"DIS\u201924 Companion","author":"Valentim M.","year":"2024"},{"key":"e_1_2_11_24_2","doi-asserted-by":"publisher","DOI":"10.21037\/jmai-24-170"},{"key":"e_1_2_11_25_2","first-page":"2847","volume-title":"KDD\u201925. ACM","author":"Tu S.","year":"2025"},{"key":"e_1_2_11_26_2","volume-title":"Advances in Neural Information Processing Systems 30","author":"Vaswani A.","year":"2017"},{"key":"e_1_2_11_27_2","unstructured":"OpenAI GPT-3.5 Turbo 2023 https:\/\/platform.openai.com\/docs\/models\/gpt-3.5-turbo."},{"key":"e_1_2_11_28_2","volume-title":"Introducing GPT-4.1 in the API","author":"OpenAI","year":"2025"},{"key":"e_1_2_11_29_2","unstructured":"OpenAI Introducing GPT-5 2025 https:\/\/openai.com\/gpt-5\/."},{"key":"e_1_2_11_30_2","unstructured":"LlaMAA. I. M. 3.2: Compact Multilingual Large Language Models for Diverse Applications 2024 https:\/\/arxiv.org\/abs\/2310.12346."},{"key":"e_1_2_11_31_2","unstructured":"AlmazroueiE. AlobeidliH. AlshamsiA.et al. The Falcon Series of Open Language Models 2023 https:\/\/arxiv.org\/abs\/2311.16867."},{"key":"e_1_2_11_32_2","article-title":"Introduction to AI Chatbots","author":"Gupta A.","year":"2020","journal-title":"IJERT"},{"key":"e_1_2_11_33_2","volume-title":"Prompt Engineering","author":"Taulli T.","year":"2023"},{"key":"e_1_2_11_34_2","doi-asserted-by":"publisher","DOI":"10.1186\/s41239-025-00503-7"},{"key":"e_1_2_11_35_2","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-031-55642-5_4","volume-title":"ChatGPT Prompt Patterns for Improving Code Quality Refactoring, Requirements Elicitation, and Software Design","author":"White J.","year":"2024"},{"key":"e_1_2_11_36_2","first-page":"77","volume-title":"ChatGPT Prompts for Research and Analysis","author":"Hart-Davis G.","year":"2023"},{"key":"e_1_2_11_37_2","first-page":"11948","volume-title":"Jailbreaking LLM-Controlled Robots","author":"Robey A.","year":"2025"},{"key":"e_1_2_11_38_2","doi-asserted-by":"publisher","DOI":"10.1109\/TAI.2026.3665656"},{"key":"e_1_2_11_39_2","first-page":"23","volume-title":"Jailbreaking Black Box Large Language Models in Twenty Queries","author":"Chao P.","year":"2025"},{"key":"e_1_2_11_40_2","first-page":"4675","volume-title":"USENIX Association","author":"Yu Z.","year":"2024"},{"key":"e_1_2_11_41_2","unstructured":"ZilberA. Prompt Injection in the Wild 2022 https:\/\/www.kaggle.com\/datasets\/arielzilber\/prompt-injection-in-the-wild."},{"key":"e_1_2_11_42_2","volume-title":"ChatGPTJailbreak Reddit Prompt","author":"Reddit User U\/Username","year":"2023"},{"key":"e_1_2_11_43_2","unstructured":"OpenAI Introducing ChatGPT 2022 https:\/\/openai.com\/index\/chatgpt\/."},{"key":"e_1_2_11_44_2","unstructured":"Google Introducing Gemini 2023 https:\/\/gemini.google\/."},{"key":"e_1_2_11_45_2","unstructured":"DeepSeek DeepSeek: AI Chatbot 2025 https:\/\/www.deepseek.com\/en."},{"key":"e_1_2_11_46_2","unstructured":"DelgadoJ. L. L.andRamosJ. A. L. Source Code 2025 https:\/\/github.com\/juanluis-codes\/ai_jailbreaker_python."},{"key":"e_1_2_11_47_2","article-title":"Gemini 1.5: Unlocking Multimodal Understanding Across Millions of Tokens of Context","author":"Gemini Team","year":"2024","journal-title":"arXiv Preprint arXiv:2403.05530"},{"key":"e_1_2_11_48_2","unstructured":"OpenAI GPT-4 Technical Report arXiv Preprint arXiv:2303.08774 2023."},{"key":"e_1_2_11_49_2","unstructured":"DeepSeek-Ai DeepSeek-V3 Technical Report arXiv Preprint arXiv:2412.19437 2024."},{"key":"e_1_2_11_50_2","doi-asserted-by":"publisher","DOI":"10.1145\/3729235"},{"key":"e_1_2_11_51_2","first-page":"2205","volume-title":"USENIX Association","author":"Sandoval G.","year":"2023"}],"container-title":["International Journal of Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1155\/int\/9698691","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1155\/int\/9698691","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1155\/int\/9698691","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,28]],"date-time":"2026-05-28T10:32:02Z","timestamp":1779964322000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1155\/int\/9698691"}},"subtitle":[],"editor":[{"given":"Richard","family":"Murray","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2026,1]]},"references-count":51,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2026,1]]}},"alternative-id":["10.1155\/int\/9698691"],"URL":"https:\/\/doi.org\/10.1155\/int\/9698691","archive":["Portico"],"relation":{},"ISSN":["0884-8173","1098-111X"],"issn-type":[{"value":"0884-8173","type":"print"},{"value":"1098-111X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,1]]},"assertion":[{"value":"2025-08-22","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-04-10","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-05-28","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"9698691"}}