{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,7]],"date-time":"2026-11-07T02:22:04Z","timestamp":1794018124152,"version":"4.8.0"},"reference-count":43,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2025,11,12]],"date-time":"2025-11-12T00:00:00Z","timestamp":1762905600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004955","name":"FFG","doi-asserted-by":"publisher","award":["883977"],"award-info":[{"award-number":["883977"]}],"id":[{"id":"10.13039\/501100004955","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Future Internet"],"abstract":"<jats:p>The new availability of powerful Artificial Intelligence (AI) as an everyday copilot has instigated a new wave of attack techniques, especially in the area of Social Engineering (SE). The possibility of generating a multitude of different templates within seconds in order to carry out an SE-attack lowers the entry barrier for potential threat actors. Still, the question remains whether this can be done using openly available tools without specialized expert skill sets on the attacker side, and how these compare to each other. This paper conducts three experiments based on a blueprint from a real-world CFO fraud attack, which utilized two of the most used social engineering attacks, phishing and vishing, and investigates the success rate of these SE attacks based on utilizing different available LLMs. The third experiment centers around the training of an AI-powered chatbot to act as a social engineer and gather sensitive information from interacting users. As this work focuses on the offensive side of SE, all conducted experiments return promising results, proving not only the ability and effectiveness of AI technology to act unethically, but also the little to no implied restrictions. Based on a reflection on the findings and potential countermeasures available, this research provides a deeper understanding of the development and deployment of AI-enhanced SE attacks, further highlighting potential dangers, as well as mitigation methods against this \u201cupgraded\u201d type of threat.<\/jats:p>","DOI":"10.3390\/fi17110515","type":"journal-article","created":{"date-parts":[[2025,11,13]],"date-time":"2025-11-13T12:57:13Z","timestamp":1763038633000},"page":"515","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Social Engineering with AI"],"prefix":"10.3390","volume":"17","author":[{"given":"Alexandru-Raul","family":"Matecas","sequence":"first","affiliation":[{"name":"Department of Computer Science & Security, St. P\u00f6lten University of Applied Sciences, 3100 St. P\u00f6lten, Austria"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2847-2152","authenticated-orcid":false,"given":"Peter","family":"Kieseberg","sequence":"additional","affiliation":[{"name":"Department of Computer Science & Security, St. P\u00f6lten University of Applied Sciences, 3100 St. P\u00f6lten, Austria"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2280-9604","authenticated-orcid":false,"given":"Simon","family":"Tjoa","sequence":"additional","affiliation":[{"name":"Department of Computer Science & Security, St. P\u00f6lten University of Applied Sciences, 3100 St. P\u00f6lten, Austria"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2025,11,12]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Tang, Z., Yin, S.X., and Goh, D.H.L. (2023, January 23\u201328). Understanding major topics and attitudes toward deepfakes: An analysis of news articles. Proceedings of the International Conference on Human-Computer Interaction, Copenhagen, Denmark.","DOI":"10.1007\/978-3-031-48044-7_25"},{"key":"ref_2","unstructured":"Meghana, G.V.S., Afroz, S.S., Gurindapalli, R., Katari, S., and Swetha, K. (2024, January 3\u20134). A Survey paper on Understanding the Rise of AI-driven Cyber Crime and Strategies for Proactive Digital Defenders. Proceedings of the 2024 4th International Conference on Pervasive Computing and Social Networking (ICPCSN), Salem, India."},{"key":"ref_3","unstructured":"Hadnagy, C. (2010). Social Engineering: The Art of Human Hacking, John Wiley & Sons."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Gallagher, S., Gelman, B., Taoufiq, S., V\u00f6r\u00f6s, T., Lee, Y., Kyadige, A., and Bergeron, S. (2024). Phishing and social engineering in the age of llms. Large Language Models in Cybersecurity: Threats, Exposure and Mitigation, Springer Nature.","DOI":"10.1007\/978-3-031-54827-7_8"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"2159","DOI":"10.1007\/s00146-024-02072-1","article-title":"The potential effects of deepfakes on news media and entertainment","volume":"40","author":"Lundberg","year":"2025","journal-title":"AI Soc."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"104317","DOI":"10.1016\/j.cose.2025.104317","article-title":"Detection and prevention of spear phishing attacks: A comprehensive survey","volume":"151","author":"Birthriya","year":"2025","journal-title":"Comput. Secur."},{"key":"ref_7","first-page":"274","article-title":"Emerging Trends in Phishing: A Look at Smishing, Vishing, Quishing","volume":"1","author":"Musa","year":"2025","journal-title":"Int. J. Technol. Emerg. Res."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Alahmed, Y., Abadla, R., and Al Ansari, M.J. (2024, January 17\u201320). Exploring the potential implications of AI-generated content in social engineering attacks. Proceedings of the 2024 International Conference on Multimedia Computing, Networking and Applications (MCNA), Valencia, Spain.","DOI":"10.1109\/MCNA63144.2024.10703950"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"324","DOI":"10.1007\/s10462-024-10973-2","article-title":"Digital deception: Generative artificial intelligence in social engineering and phishing","volume":"57","author":"Schmitt","year":"2024","journal-title":"Artif. Intell. Rev."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1109\/MIC.2011.24","article-title":"Friend-in-the-middle attacks: Exploiting social networking sites for spam","volume":"15","author":"Huber","year":"2011","journal-title":"IEEE Internet Comput."},{"key":"ref_11","first-page":"18","article-title":"Phishing attacks in social engineering: A review","volume":"12","author":"Ahiable","year":"2022","journal-title":"System"},{"key":"ref_12","first-page":"6374","article-title":"A study on social engineering attacks: Phishing attack","volume":"7","author":"Alsuwat","year":"2020","journal-title":"Int. J. Recent Adv. Multidiscip. Res."},{"key":"ref_13","unstructured":"Osamor, J., Ashawa, M., Shahrabi, A., Phillip, A., and Iwend, C. (2025, January 28\u201329). The Evolution of Phishing and Future Directions: A Review. Proceedings of the International Conference on Cyber Warfare and Security, Williamsburg, VA, USA."},{"key":"ref_14","first-page":"15","article-title":"AI-Driven vishing attacks: A practical approach","volume":"77","author":"Toapanta","year":"2024","journal-title":"Eng. Proc."},{"key":"ref_15","unstructured":"Figueiredo, J., Carvalho, A., Castro, D., Gon\u00e7alves, D., and Santos, N. (2024). On the feasibility of fully ai-automated vishing attacks. arXiv."},{"key":"ref_16","unstructured":"Bj\u00f6rnhed, J. (2009). Using a Chatbot to Prevent Identity Fraud by Social Engineering. [Master\u2019s Thesis, University of Sk\u00f6vde]."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Ariza, M. (2023). Automated Social Engineering Attacks Using ChatBots on Professional Social Networks. [Master\u2019s Thesis, Federal University of Rio Grande do Sul].","DOI":"10.5753\/wgrs.2023.747"},{"key":"ref_18","unstructured":"Manyam, S. (2022). Artificial Intelligence\u2019s Impact on Social Engineering Attacks. [Master\u2019s Thesis, Governors State University]."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1109\/CSE.2009.205","article-title":"Towards automating social engineering using social networking sites","volume":"Volume 3","author":"Huber","year":"2009","journal-title":"Proceedings of the 2009 International Conference on Computational Science and Engineering"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"80218","DOI":"10.1109\/ACCESS.2023.3300381","article-title":"From chatgpt to threatgpt: Impact of generative ai in cybersecurity and privacy","volume":"11","author":"Gupta","year":"2023","journal-title":"IEEE Access"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Szmurlo, H., and Akhtar, Z. (2024). Digital sentinels and antagonists: The dual nature of chatbots in cybersecurity. Information, 15.","DOI":"10.3390\/info15080443"},{"key":"ref_22","first-page":"57","article-title":"AI\u2019s revolutionary role in cyber defense and social engineering","volume":"3","author":"Khan","year":"2024","journal-title":"Int. J. Multidiscip. Sci. Arts"},{"key":"ref_23","unstructured":"Usman, Y., Upadhyay, A., Gyawali, P., and Chataut, R. (2024). Is generative ai the next tactical cyber weapon for threat actors? unforeseen implications of ai generated cyber attacks. arXiv."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"77110","DOI":"10.1109\/ACCESS.2022.3191790","article-title":"Artificial intelligence crime: An overview of malicious use and abuse of AI","volume":"10","author":"Blauth","year":"2022","journal-title":"IEEE Access"},{"key":"ref_25","unstructured":"Firdhous, M.F.M., Elbreiki, W., Abdullahi, I., Sudantha, B., and Budiarto, R. (2023, January 6\u20138). Wormgpt: A large language model chatbot for criminals. Proceedings of the 2023 24th International Arab Conference on Information Technology (ACIT), Ajman, United Arab Emirates."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Falade, P.V. (2023). Decoding the threat landscape: Chatgpt, fraudgpt, and wormgpt in social engineering attacks. arXiv.","DOI":"10.32628\/CSEIT2390533"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"3701","DOI":"10.1109\/LRA.2018.2856272","article-title":"Trust and social engineering in human robot interaction: Will a robot make you disclose sensitive information, conform to its recommendations or gamble?","volume":"3","author":"Aroyo","year":"2018","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_28","unstructured":"Yu, J., Yu, Y., Wang, X., Lin, Y., Yang, M., Qiao, Y., and Wang, F.Y. (2024). The shadow of fraud: The emerging danger of ai-powered social engineering and its possible cure. arXiv."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Shibli, A., Pritom, M., and Gupta, M. (2024). AbuseGPT: Abuse of generative AI ChatBots to create smishing campaigns. arXiv.","DOI":"10.1109\/ISDFS60797.2024.10527300"},{"key":"ref_30","unstructured":"Heiding, F., Lermen, S., Kao, A., Schneier, B., and Vishwanath, A. (2025, January 13\u201319). Evaluating Large Language Models\u2019 Capability to Launch Fully Automated Spear Phishing Campaigns. Proceedings of the ICML 2025 Workshop on Reliable and Responsible Foundation Models, Vancouver, BC, Canada."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Begou, N., Vinoy, J., Duda, A., and Korczy\u0144ski, M. (2023, January 2\u20135). Exploring the dark side of ai: Advanced phishing attack design and deployment using chatgpt. Proceedings of the 2023 IEEE Conference on Communications and Network Security (CNS), Orlando, FL, USA.","DOI":"10.1109\/CNS59707.2023.10288940"},{"key":"ref_32","unstructured":"Gryka, P., Grado\u0144, K., Koz\u0142owski, M., Kuty\u0142a, M., and Janicki, A. (August, January 30). Detection of ai-generated emails-a case study. Proceedings of the 19th International Conference on Availability, Reliability and Security, Vienna, Austria."},{"key":"ref_33","unstructured":"Dana, D., Schrittwieser, S., and Kieseberg, P. (2024, January 10\u201314). Automated Social Engineering Tools-Overview and Comparison with Respect to Capabilities and Detectability. Proceedings of the Nineteenth International Multi-Conference on Computing in the Global Information Technology ICCGI 2024, Athens, Greece."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"502","DOI":"10.5430\/wjel.v14n2p502","article-title":"Evaluating AI-generated emails: A comparative efficiency analysis","volume":"14","author":"Jovic","year":"2024","journal-title":"World J. Engl. Lang."},{"key":"ref_35","unstructured":"Roy, S.S., Thota, P., Naragam, K.V., and Nilizadeh, S. (2023). From Chatbots to PhishBots?\u2013Preventing Phishing scams created using ChatGPT, Google Bard and Claude. arXiv."},{"key":"ref_36","unstructured":"Duan, Y., Tang, F., Wu, K., Guo, Z., Huang, S., Mei, Y., Wang, Y., Yang, Z., and Gong, S. (2025, October 28). Ranking of Large Language Model (llm) Regional Bias. Available online: https:\/\/www.researchgate.net\/profile\/Yucong-Duan\/publication\/378568230_Ranking_of_Large_Language_Model_LLM_Regional_Bias_\u2013DIKWP_Research_Group_International_Standard_Evaluation\/links\/65e07056e7670d36abe625bf\/Ranking-of-Large-Language-Model-LLM-Regional-Bias\u2013DIKWP-Research-Group-International-Standard-Evaluation.pdf."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Peskov, D., and Cheng, B. (2020, January 5\u201310). It takes two to lie: One to lie, and one to listen. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Virtual.","DOI":"10.18653\/v1\/2020.acl-main.353"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"383","DOI":"10.4467\/20801335PBW.24.030.20807","article-title":"Open source intelligence on the internet\u2013categorisation and evaluation of search tools","volume":"16","author":"Mider","year":"2024","journal-title":"Przegl\u0105d Bezpiecze\u0144stwa Wewn\u0119trznego"},{"key":"ref_39","unstructured":"Masud, M.S.B. (2025, October 28). Prompting Strategies versus Manual Techniques for OSINT Personal Profiling: A Comparative Analysis of AI-Enhanced Intelligence Gathering. Available online: https:\/\/www.researchgate.net\/publication\/394964952_Prompting_Strategies_versus_Manual_Techniques_for_OSINT_Personal_Profiling_A_Comparative_Analysis_of_AI-Enhanced_Intelligence_Gathering."},{"key":"ref_40","unstructured":"High-Level Expert Group on Artificial Intelligence (2019). Ethics Guidelines for Trustworthy AI."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"e319","DOI":"10.3346\/jkms.2023.38.e319","article-title":"GPTZero performance in identifying artificial intelligence-generated medical texts: A preliminary study","volume":"38","author":"Habibzadeh","year":"2023","journal-title":"J. Korean Med. Sci."},{"key":"ref_42","unstructured":"Brown, D.W., and Jensen, D. (2023, January 19\u201322). GPTZero vs. Text Tampering: The Battle That GPTZero Wins. Proceedings of the International Society for Technology, Education, and Science, Paper presented at the International Conference on Social and Education Sciences (IConSES), Las Vegas, NV, USA."},{"key":"ref_43","unstructured":"Fu, X., Li, S., Wang, Z., Liu, Y., Gupta, R.K., Berg-Kirkpatrick, T., and Fernandes, E. (2024). Imprompter: Tricking llm agents into improper tool use. arXiv."}],"container-title":["Future Internet"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-5903\/17\/11\/515\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,11,13]],"date-time":"2025-11-13T13:11:00Z","timestamp":1763039460000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-5903\/17\/11\/515"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,11,12]]},"references-count":43,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2025,11]]}},"alternative-id":["fi17110515"],"URL":"https:\/\/doi.org\/10.3390\/fi17110515","relation":{},"ISSN":["1999-5903"],"issn-type":[{"value":"1999-5903","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,11,12]]}}}