{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,21]],"date-time":"2026-04-21T22:52:01Z","timestamp":1776811921329,"version":"3.51.2"},"reference-count":27,"publisher":"European Society of Computational Methods in Sciences and Engineering","issue":"3","license":[{"start":{"date-parts":[[2024,12,21]],"date-time":"2024-12-21T00:00:00Z","timestamp":1734739200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Journal of Computational Methods in Sciences and Engineering"],"published-print":{"date-parts":[[2025,5]]},"abstract":"<jats:p>In the present environment, as cybersecurity attacks become more sophisticated and frequent, classic protection techniques, such as rule-based firewalls and signature-based detection systems, are no longer effective. Modern cyberattacks require innovative solutions that can change and react in real time. Deep reinforcement learning (DRL) is a subfield of artificial intelligence that efficiently solves complicated decision-making issues in numerous domains, such as cybersecurity. This research aims to improve cybersecurity by establishing deep reinforcement learning algorithms for automated threat detection and response in dynamic network environments. To address these problems, this study proposed a novel Improved Mayfly Optimized Deep Deterministic Policy Gradient (IMO-DDPG) to automate threat detection and improve cybersecurity response in dynamic network environments. Collect real-time network intrusion datasets accessible to the public to train the DRL model. The data was preprocessed using normalization, for feature extraction Principal Component Analysis (PCA). To improve performance in an increasingly developing environment, the study customizes DRL algorithms with an emphasis on continuous action spaces, adversarial training, and customized reward structures. The results indicate that the IMO-DDPG method outperforms accuracy (94.5%), recall (94.0%), precision (92.5%), and F1-score (93.5%) to compare existing algorithms. The remarkable success rate, highest average reward, and superior efficiency in interpretation significantly improve threat detection and response capabilities. The results show the suggested algorithms for automated detection and response, highlighting the right decision, can significantly enhance cybersecurity defences.<\/jats:p>","DOI":"10.1177\/14727978241309550","type":"journal-article","created":{"date-parts":[[2025,5,18]],"date-time":"2025-05-18T23:41:27Z","timestamp":1747611687000},"page":"2112-2125","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":0,"title":["Application of deep reinforcement learning algorithms for automatic threat detection and response in dynamic network environments to improve cybersecurity"],"prefix":"10.66113","volume":"25","author":[{"ORCID":"https:\/\/orcid.org\/0009-0005-1893-7234","authenticated-orcid":false,"given":"Ya","family":"Ma","sequence":"first","affiliation":[{"name":"Zunyi Cigarette Factory of China Tobacco Guizhou Industrial Co., Ltd"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chunqiang","family":"Li","sequence":"additional","affiliation":[{"name":"Zunyi Cigarette Factory of China Tobacco Guizhou Industrial Co., Ltd"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yongfeng","family":"Wang","sequence":"additional","affiliation":[{"name":"Zunyi Cigarette Factory of China Tobacco Guizhou Industrial Co., Ltd"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yu","family":"Wang","sequence":"additional","affiliation":[{"name":"Zunyi Cigarette Factory of China Tobacco Guizhou Industrial Co., Ltd"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"55691","published-online":{"date-parts":[[2024,12,21]]},"reference":[{"key":"e_1_3_3_2_2","doi-asserted-by":"publisher","DOI":"10.1109\/TDSC.2021.3107514"},{"key":"e_1_3_3_3_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2022.3204171"},{"issue":"2","key":"e_1_3_3_4_2","first-page":"589","article-title":"Deep reinforcement learning in the advanced cybersecurity threat detection and protection","volume":"25","author":"Sewak M","year":"2023","unstructured":"Sewak M, Sahay SK, Rathore H. Deep reinforcement learning in the advanced cybersecurity threat detection and protection. Inf Syst Front 2023; 25(2): 589\u2013611.","journal-title":"Inf Syst Front"},{"key":"e_1_3_3_5_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-021-21824-x"},{"key":"e_1_3_3_6_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.aei.2024.102685"},{"key":"e_1_3_3_7_2","doi-asserted-by":"publisher","DOI":"10.1109\/MWC.010.2100117"},{"key":"e_1_3_3_8_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10462-020-09942-2"},{"key":"e_1_3_3_9_2","doi-asserted-by":"publisher","DOI":"10.3390\/bdcc6040110"},{"key":"e_1_3_3_10_2","doi-asserted-by":"publisher","DOI":"10.3390\/risks11060101"},{"key":"e_1_3_3_11_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.inffus.2023.101804"},{"issue":"4","key":"e_1_3_3_12_2","first-page":"42","article-title":"Machine learning algorithms for cybersecurity: Detecting and preventing threats","volume":"15","author":"Shah V","year":"2021","unstructured":"Shah V. Machine learning algorithms for cybersecurity: Detecting and preventing threats. Rev Espa\u00f1ola Doc Cient\u00edfica 2021; 15(4): 42\u201366.","journal-title":"Rev Espa\u00f1ola Doc Cient\u00edfica"},{"key":"e_1_3_3_13_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijinfomgt.2021.102334"},{"key":"e_1_3_3_14_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.comcom.2021.11.014"},{"key":"e_1_3_3_15_2","doi-asserted-by":"publisher","DOI":"10.3390\/s21144939"},{"issue":"2","key":"e_1_3_3_16_2","first-page":"19","article-title":"Leveraging machine learning for enhanced threat detection and response in zero trust security frameworks: An Exploration of Real-Time Anomaly Identification and Adaptive Mitigation Strategies","volume":"1","author":"Gudala L","year":"2021","unstructured":"Gudala L, Shaik M, Venkataramanan S. Leveraging machine learning for enhanced threat detection and response in zero trust security frameworks: An Exploration of Real-Time Anomaly Identification and Adaptive Mitigation Strategies. J Artif Intell Res 2021; 1(2): 19\u201345.","journal-title":"J Artif Intell Res"},{"key":"e_1_3_3_17_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10922-021-09607-7"},{"key":"e_1_3_3_18_2","doi-asserted-by":"publisher","DOI":"10.3390\/electronics10141682"},{"key":"e_1_3_3_19_2","doi-asserted-by":"publisher","DOI":"10.3390\/sym15050988"},{"key":"e_1_3_3_20_2","doi-asserted-by":"publisher","DOI":"10.1145\/3616401"},{"key":"e_1_3_3_21_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.sysarc.2022.102722"},{"key":"e_1_3_3_22_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2023.3238664"},{"key":"e_1_3_3_23_2","doi-asserted-by":"publisher","DOI":"10.1145\/3545574"},{"key":"e_1_3_3_24_2","doi-asserted-by":"publisher","DOI":"10.3390\/electronics10030239"},{"key":"e_1_3_3_25_2","doi-asserted-by":"publisher","DOI":"10.1364\/JOCN.402884"},{"key":"e_1_3_3_26_2","first-page":"102878","article-title":"Cyberprotection in IoT environments: A dynamic rule-based solution to defend smart devices","volume":"60","author":"Nespoli P","year":"2021","unstructured":"Nespoli P, D\u00edaz-L\u00f3pez D, M\u00e1rmol FG. Cyberprotection in IoT environments: A dynamic rule-based solution to defend smart devices. J Inf Secur Appl 2021; 60: 102878.","journal-title":"J Inf Secur Appl"},{"key":"e_1_3_3_27_2","doi-asserted-by":"publisher","DOI":"10.58496\/BJN\/2024\/006"},{"key":"e_1_3_3_28_2","doi-asserted-by":"publisher","DOI":"10.33050\/ysdncf05"}],"container-title":["Journal of Computational Methods in Sciences and Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/14727978241309550","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/14727978241309550","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/14727978241309550","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,21]],"date-time":"2026-04-21T22:07:31Z","timestamp":1776809251000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/14727978241309550"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,12,21]]},"references-count":27,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2025,5]]}},"alternative-id":["10.1177\/14727978241309550"],"URL":"https:\/\/doi.org\/10.1177\/14727978241309550","relation":{},"ISSN":["1472-7978","1875-8983"],"issn-type":[{"value":"1472-7978","type":"print"},{"value":"1875-8983","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,12,21]]}}}