{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,2]],"date-time":"2026-06-02T22:28:25Z","timestamp":1780439305222,"version":"3.54.1"},"reference-count":19,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2019,8,14]],"date-time":"2019-08-14T00:00:00Z","timestamp":1565740800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100012166","name":"National Key Research and Development Program of China","doi-asserted-by":"publisher","award":["2017YFB0802900"],"award-info":[{"award-number":["2017YFB0802900"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Future Internet"],"abstract":"<jats:p>With the development of artificial intelligence, machine learning algorithms and deep learning algorithms are widely applied to attack detection models. Adversarial attacks against artificial intelligence models become inevitable problems when there is a lack of research on the cross-site scripting (XSS) attack detection model for defense against attacks. It is extremely important to design a method that can effectively improve the detection model against attack. In this paper, we present a method based on reinforcement learning (called RLXSS), which aims to optimize the XSS detection model to defend against adversarial attacks. First, the adversarial samples of the detection model are mined by the adversarial attack model based on reinforcement learning. Secondly, the detection model and the adversarial model are alternately trained. After each round, the newly-excavated adversarial samples are marked as a malicious sample and are used to retrain the detection model. Experimental results show that the proposed RLXSS model can successfully mine adversarial samples that escape black-box and white-box detection and retain aggressive features. What is more, by alternately training the detection model and the confrontation attack model, the escape rate of the detection model is continuously reduced, which indicates that the model can improve the ability of the detection model to defend against attacks.<\/jats:p>","DOI":"10.3390\/fi11080177","type":"journal-article","created":{"date-parts":[[2019,8,15]],"date-time":"2019-08-15T04:22:54Z","timestamp":1565842974000},"page":"177","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":38,"title":["RLXSS: Optimizing XSS Detection Model to Defend Against Adversarial Attacks Based on Reinforcement Learning"],"prefix":"10.3390","volume":"11","author":[{"given":"Yong","family":"Fang","sequence":"first","affiliation":[{"name":"College of Cybersecurity, Sichuan University, Chengdu 610065, Sichuan, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5871-946X","authenticated-orcid":false,"given":"Cheng","family":"Huang","sequence":"additional","affiliation":[{"name":"College of Cybersecurity, Sichuan University, Chengdu 610065, Sichuan, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yijia","family":"Xu","sequence":"additional","affiliation":[{"name":"College of Cybersecurity, Sichuan University, Chengdu 610065, Sichuan, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yang","family":"Li","sequence":"additional","affiliation":[{"name":"College of Electronics and Information Engineering, Sichuan University, Chengdu 610065, Sichuan, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2019,8,14]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Nirmal, K., Janet, B., and Kumar, R. (2018, January 11\u201312). Web Application Vulnerabilities-The Hacker\u2019s Treasure. Proceedings of the 2018 International Conference on Inventive Research in Computing Applications, Coimbatore, India.","DOI":"10.1109\/ICIRCA.2018.8597221"},{"key":"ref_2","first-page":"139","article-title":"A survey on detection and prevention of cross-site scripting attack","volume":"9","author":"Nithya","year":"2015","journal-title":"IJNSA"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1016\/j.jnca.2018.06.004","article-title":"A survey of detection methods for XSS attacks","volume":"118","author":"Sarmah","year":"2018","journal-title":"J. Netw. Comput. Appl."},{"key":"ref_4","unstructured":"Goodfellow, I., Pouget-Abadie, J., and Mirza, M. (2014). Generative adversarial nets. Advances in Neural Information Processing Systems, The MIT Press."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Su, J., Vargas, D.V., and Sakurai, K. (2019). One pixel attack for fooling deep neural networks. IEEE T. Evolut. Comput.","DOI":"10.1109\/TEVC.2019.2890858"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Rosenberg, I., Shabtai, A., and Rokach, L. (2018, January 10\u201312). Generic black-box end-to-end attack against state of the art API call based malware classifiers. Proceedings of the 21st International Symposium on Research in Attacks, Intrusions and Defenses, Heraklion, Greece.","DOI":"10.1007\/978-3-030-00470-5_23"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Wu, C., Shi, J., and Yang, Y. (2018, January 2\u20134). Enhancing Machine Learning Based Malware Detection Model by Reinforcement Learning. Proceedings of the 8th International Conference on Communication and Network Security, Qingdao, China.","DOI":"10.1145\/3290480.3290494"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Vishnu, B.A., and Jevitha, K.P. (2014, January 10\u201311). Prediction of cross-site scripting attack using machine learning algorithms. Proceedings of the 2014 International Conference on Interdisciplinary Advances in Applied Computing, Amritapuri, India.","DOI":"10.1145\/2660859.2660969"},{"key":"ref_9","first-page":"1014","article-title":"XSSClassifier: An Efficient XSS Attack Detection Approach Based on Machine Learning Classifier on SNSs","volume":"13","author":"Rathore","year":"2017","journal-title":"JIPS"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Fang, Y., Li, Y., and Liu, L. (2018, January 12\u201314). Deepxss: Cross site scripting detection based on deep learning. Proceedings of the 2018 International Conference on Computing and Artificial Intelligence, Chengdu, China.","DOI":"10.1145\/3194452.3194469"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Mohammadi, M., Chu, B., and Lipford, H.R. (2017, January 25\u201329). Detecting cross-site scripting vulnerabilities through automated unit testing. Proceedings of the 2017 IEEE International Conference on Software Quality, Reliability and Security, Prague, Czech Republic.","DOI":"10.1109\/QRS.2017.46"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Duchene, F., Rawat, S., and Richier, J.L. (2014, January 3\u20135). KameleonFuzz: evolutionary fuzzing for black-box XSS detection. Proceedings of the 4th ACM conference on Data and application security and privacy, San Antonio, TX, USA.","DOI":"10.1145\/2557547.2557550"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Guo, X., Jin, S., and Zhang, Y. (2015, January 17\u201319). XSS vulnerability detection using optimized attack vector repertory. Proceedings of the 2015 International Conference on Cyber-Enabled Distributed Computing and Knowledge Discovery, Xi\u2019an, China.","DOI":"10.1109\/CyberC.2015.50"},{"key":"ref_14","unstructured":"Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., and Riedmiller, M. (2013). Playing atari with deep reinforcement learning. arXiv."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Van Hasselt, H., Guez, A., and Silver, D. (2016, January 12\u201317). Deep reinforcement learning with double q-learning. Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence, Phoenix, AZ, USA.","DOI":"10.1609\/aaai.v30i1.10295"},{"key":"ref_16","unstructured":"Matthias Plappert (2019, May 10). keras-rl. Available online: https:\/\/github.com\/keras-rl\/keras-rl."},{"key":"ref_17","unstructured":"Brockman, G., Cheung, V., Pettersson, L., Schneider, J., Schulman, J., Tang, J., and Zaremba, W. (2016). Openai gym. arXiv."},{"key":"ref_18","unstructured":"Safedog (2019, May 10). Website Safedog. Available online: http:\/\/free.safedog.cn\/website_safedog.html."},{"key":"ref_19","unstructured":"Chaitin (2019, May 10). XSSChop. Available online: https:\/\/xsschop.chaitin.cn\/demo\/."}],"container-title":["Future Internet"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-5903\/11\/8\/177\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:11:03Z","timestamp":1760188263000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-5903\/11\/8\/177"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,8,14]]},"references-count":19,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2019,8]]}},"alternative-id":["fi11080177"],"URL":"https:\/\/doi.org\/10.3390\/fi11080177","relation":{},"ISSN":["1999-5903"],"issn-type":[{"value":"1999-5903","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,8,14]]}}}