{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,23]],"date-time":"2026-07-23T15:04:06Z","timestamp":1784819046055,"version":"3.55.0"},"reference-count":45,"publisher":"Association for Computing Machinery (ACM)","issue":"5","license":[{"start":{"date-parts":[[2026,7,23]],"date-time":"2026-07-23T00:00:00Z","timestamp":1784764800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/legalcode"}],"funder":[{"name":"National Key Research and Development Program of China","award":["2024YFC3307900"],"award-info":[{"award-number":["2024YFC3307900"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["62376103, 62302184, 62436003, 62206102, 62476107"],"award-info":[{"award-number":["62376103, 62302184, 62436003, 62206102, 62476107"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Major Science and Technology Project of Hubei Province","award":["2024BAA008"],"award-info":[{"award-number":["2024BAA008"]}]},{"name":"Hubei Science and Technology Talent Service Project","award":["2024DJC078"],"award-info":[{"award-number":["2024DJC078"]}]},{"name":"Ant Group through CCF-Ant Research Fund"},{"name":"HPC Platform of Huazhong University of Science and Technology"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Intell. Syst. Technol."],"published-print":{"date-parts":[[2026,10,31]]},"abstract":"<jats:p>Natural language video localization (NLVL) is an important task in the vision-language understanding area, which calls for an in-depth understanding of not only computer vision and natural language side alone, but more importantly, the interplay between both sides. Adversarial attack has been well-recognized as a critical security issue of deep neural network models, which requires prudent investigation. Despite its extensive yet separated studies in video and language, two kinds of unimodal tasks, current understanding of the adversarial attack in NLVL tasks including both the vision and language modality is less developed. This article therefore aims to comprehensively investigate the adversarial attacks of NLVL models by examining three different facets of adversarial attack methods. To achieve the attack goal, we propose a new adversarial attack paradigm called synonymous sentences-aware adversarial attack on NLVL (SNEAK), which captures the cross-modality interplay between the vision and language sides. To further enhance the stealthiness of SNEAK, we propose a frame importance-guided pruning with SNEAK attack (PSA) mechanism to reduce the amount of perturbed frames. Extensive experiments on five NLVL models and two datasets demonstrate the effectiveness and stealthiness of the proposed attack methods.<\/jats:p>","DOI":"10.1145\/3815168","type":"journal-article","created":{"date-parts":[[2026,5,9]],"date-time":"2026-05-09T15:38:21Z","timestamp":1778341101000},"page":"1-26","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["SNEAK: Synonymous Sentences-Aware Adversarial Attack on Natural Language Video Localization"],"prefix":"10.1145","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0009-0001-0950-0197","authenticated-orcid":false,"given":"Wen","family":"Shi","sequence":"first","affiliation":[{"name":"Huazhong University of Science and Technology, Wuhan, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0983-387X","authenticated-orcid":false,"given":"Wenchao","family":"Xu","sequence":"additional","affiliation":[{"name":"The Hong Kong University of Science and Technology, Hongkong, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7591-5315","authenticated-orcid":false,"given":"Haozhao","family":"Wang","sequence":"additional","affiliation":[{"name":"Huazhong University of Science and Technology, Wuhan, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9431-5342","authenticated-orcid":false,"given":"Xingshuo","family":"Han","sequence":"additional","affiliation":[{"name":"Nanjing University of Aeronautics and Astronautics, Nanjing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8629-4622","authenticated-orcid":false,"given":"Pan","family":"Zhou","sequence":"additional","affiliation":[{"name":"Huazhong University of Science and Technology, Wuhan, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7791-5511","authenticated-orcid":false,"given":"Ruixuan","family":"Li","sequence":"additional","affiliation":[{"name":"Huazhong University of Science and Technology, Wuhan, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2026,7,23]]},"reference":[{"key":"e_1_3_1_2_2","doi-asserted-by":"publisher","DOI":"10.1109\/SP.2017.49"},{"key":"e_1_3_1_3_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.502"},{"key":"e_1_3_1_4_2","unstructured":"Nandish Chattopadhyay Amira Guesmi Muhammad Abdullah Hanif Bassem Ouni and Muhammad Shafique. 2023. ODDR: Outlier detection & dimension reduction based defense against adversarial patches. arXiv:2311.12084. Retrieved from https:\/\/arxiv.org\/abs\/2311.12084v2"},{"key":"e_1_3_1_5_2","doi-asserted-by":"crossref","first-page":"2587","DOI":"10.18653\/v1\/P18-1241","volume-title":"Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Vol. 1: Long Papers)","author":"Chen Hongge","year":"2018","unstructured":"Hongge Chen, Huan Zhang, Pin-Yu Chen, Jinfeng Yi, and Cho-Jui Hsieh. 2018. Attacking visual language grounding with adversarial examples: A case study on neural image captioning. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Vol. 1: Long Papers). Association for Computational Linguistics, 2587\u20132597."},{"key":"e_1_3_1_6_2","first-page":"10551","volume-title":"Proceedings of the 34th AAAI Conference on Artificial Intelligence (AAAI \u201920), the 32nd Innovative Applications of Artificial Intelligence Conference (IAAI \u201920), the 10th AAAI Symposium on Educational Advances in Artificial Intelligence (EAAI \u201920)","author":"Chen Long","year":"2020","unstructured":"Long Chen, Chujie Lu, Siliang Tang, Jun Xiao, Dong Zhang, Chilie Tan, and Xiaolin Li. 2020. Rethinking the bottom-up framework for query-based video localization. In Proceedings of the 34th AAAI Conference on Artificial Intelligence (AAAI \u201920), the 32nd Innovative Applications of Artificial Intelligence Conference (IAAI \u201920), the 10th AAAI Symposium on Educational Advances in Artificial Intelligence (EAAI \u201920). AAAI Press, 10551\u201310558."},{"key":"e_1_3_1_7_2","first-page":"2667","volume-title":"Proceedings of 29th USENIX Security Symposium (USENIX Security \u201920)","author":"Chen Yuxuan","year":"2020","unstructured":"Yuxuan Chen, Xuejing Yuan, Jiangshan Zhang, Yue Zhao, Shengzhi Zhang, Kai Chen, and XiaoFeng Wang. 2020. Devil\u2019s whisper: A general approach for physical adversarial attacks against commercial black-box speech recognition devices. In Proceedings of 29th USENIX Security Symposium (USENIX Security \u201920), 2667\u20132684."},{"key":"e_1_3_1_8_2","doi-asserted-by":"crossref","first-page":"243","DOI":"10.1109\/SPW53761.2021.00040","volume-title":"Proceedings of 2021 IEEE Security and Privacy Workshops (SPW)","author":"DiPalma Christopher","year":"2021","unstructured":"Christopher DiPalma, Ningfei Wang, Takami Sato, and Qi Alfred Chen. 2021. Demo: Security of camera-based perception for autonomous driving under adversarial attack. In Proceedings of 2021 IEEE Security and Privacy Workshops (SPW), 243\u2013243."},{"key":"e_1_3_1_9_2","first-page":"5277","volume-title":"Proceedings of IEEE International Conference on Computer Vision (ICCV \u201917)","author":"Gao Jiyang","year":"2017","unstructured":"Jiyang Gao, Chen Sun, Zhenheng Yang, and Ram Nevatia. 2017. TALL: Temporal activity localization via language query. In Proceedings of IEEE International Conference on Computer Vision (ICCV \u201917). IEEE Computer Society, 5277\u20135285."},{"key":"e_1_3_1_10_2","volume-title":"Proceedings of 3rd International Conference on Learning Representations (ICLR \u201915)","author":"Goodfellow Ian J.","year":"2015","unstructured":"Ian J. Goodfellow, Jonathon Shlens, and Christian Szegedy. 2015. Explaining and harnessing adversarial examples. In Proceedings of 3rd International Conference on Learning Representations (ICLR \u201915). Yoshua Bengio and Yann LeCun (Eds.)."},{"key":"e_1_3_1_11_2","doi-asserted-by":"publisher","DOI":"10.1109\/INFOCOM42981.2021.9488798"},{"key":"e_1_3_1_12_2","doi-asserted-by":"publisher","DOI":"10.1145\/3323873.3325019"},{"key":"e_1_3_1_13_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v34i05.6311"},{"key":"e_1_3_1_14_2","doi-asserted-by":"publisher","DOI":"10.1145\/3394486.3403084"},{"key":"e_1_3_1_15_2","unstructured":"Shasha Li Abhishek Aich Shitong Zhu M. Salman Asif Chengyu Song Amit K. Roy-Chowdhury and Srikanth V. Krishnamurthy. 2021. Adversarial attacks on black box video classifiers: Leveraging the power of geometric transformations. arXiv:2110.01823. Retrieved from https:\/\/arxiv.org\/abs\/2110.01823"},{"key":"e_1_3_1_16_2","unstructured":"Xiang Li and Shihao Ji. 2021. Generative dynamic patch attack. arXiv:2111.04266. Retrieved from https:\/\/arxiv.org\/abs\/2111.04266"},{"key":"e_1_3_1_17_2","doi-asserted-by":"publisher","DOI":"10.1145\/3209978.3210003"},{"key":"e_1_3_1_18_2","volume-title":"Proceedings of 6th International Conference on Learning Representations (ICLR \u201918), Conference Track Proceedings","author":"Madry Aleksander","year":"2018","unstructured":"Aleksander Madry, Aleksandar Makelov, Ludwig Schmidt, Dimitris Tsipras, and Adrian Vladu. 2018. Towards deep learning models resistant to adversarial attacks. In Proceedings of 6th International Conference on Learning Representations (ICLR \u201918), Conference Track Proceedings. OpenReview.net. Retrieved from https:\/\/openreview.net\/forum?id=rJzIBfZAb"},{"key":"e_1_3_1_19_2","doi-asserted-by":"publisher","DOI":"10.1145\/219717.219748"},{"key":"e_1_3_1_20_2","first-page":"9087","volume-title":"Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR \u201919)","author":"Modas Apostolos","year":"2019","unstructured":"Apostolos Modas, Seyed-Mohsen Moosavi-Dezfooli, and Pascal Frossard. 2019. SparseFool: A few pixels make a big difference. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR \u201919), 9087\u20139096."},{"key":"e_1_3_1_21_2","unstructured":"Ronghui Mu Wenjie Ruan Leandro Soriano Marcolino and Qiang Ni. 2021. Sparse adversarial video attacks with spatial transformations. arXiv:2111.05468. Retrieved from https:\/\/arxiv.org\/abs\/2111.05468"},{"key":"e_1_3_1_22_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.acl-long.377"},{"key":"e_1_3_1_23_2","first-page":"144","volume-title":"Proceedings of European Conference on Computer Vision","author":"Rohrbach Marcus","year":"2012","unstructured":"Marcus Rohrbach, Michaela Regneri, Mykhaylo Andriluka, Sikandar Amin, Manfred Pinkal, and Bernt Schiele. 2012. Script data for attribute-based recognition of composite activities. In Proceedings of European Conference on Computer Vision, 144\u2013157."},{"key":"e_1_3_1_24_2","first-page":"510","volume-title":"Proceedings of European Conference on Computer Vision","author":"Sigurdsson Gunnar A.","year":"2016","unstructured":"Gunnar A. Sigurdsson, G\u00fcl Varol, Xiaolong Wang, Ali Farhadi, Ivan Laptev, and Abhinav Gupta. 2016. Hollywood in homes: Crowdsourcing data collection for activity understanding. In Proceedings of European Conference on Computer Vision, 510\u2013526."},{"key":"e_1_3_1_25_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2021.3085907"},{"key":"e_1_3_1_26_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.510"},{"key":"e_1_3_1_27_2","doi-asserted-by":"crossref","first-page":"8973","DOI":"10.1609\/aaai.v33i01.33018973","article-title":"Sparse adversarial perturbations for videos","volume":"33","author":"Wei Xingxing","year":"2019","unstructured":"Xingxing Wei, Jun Zhu, Sha Yuan, and Hang Su. 2019. Sparse adversarial perturbations for videos. Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 33, 8973\u20138980.","journal-title":"Proceedings of the AAAI Conference on Artificial Intelligence"},{"key":"e_1_3_1_28_2","doi-asserted-by":"publisher","DOI":"10.24963\/IJCAI.2018\/143"},{"key":"e_1_3_1_29_2","doi-asserted-by":"crossref","first-page":"2986","DOI":"10.1609\/aaai.v35i4.16406","article-title":"Boundary proposal network for two-stage natural language video localization","volume":"35","author":"Xiao Shaoning","year":"2021","unstructured":"Shaoning Xiao, Long Chen, Songyang Zhang, Wei Ji, Jian Shao, Lu Ye, and Jun Xiao. 2021. Boundary proposal network for two-stage natural language video localization. Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 35, 2986\u20132994.","journal-title":"Proceedings of the AAAI Conference on Artificial Intelligence"},{"key":"e_1_3_1_30_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00059"},{"key":"e_1_3_1_31_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIFS.2019.2929409"},{"key":"e_1_3_1_32_2","doi-asserted-by":"publisher","DOI":"10.1109\/TDSC.2020.3005909"},{"key":"e_1_3_1_33_2","first-page":"9062","volume-title":"Proceedings of the 33rd AAAI Conference on Artificial Intelligence (AAAI \u201919), the 31st Innovative Applications of Artificial Intelligence Conference (IAAI \u201919), the 9th AAAI Symposium on Educational Advances in Artificial Intelligence (EAAI \u201919)","author":"Xu Huijuan","year":"2019","unstructured":"Huijuan Xu, Kun He, Bryan A. Plummer, Leonid Sigal, Stan Sclaroff, and Kate Saenko. 2019. Multilevel language and vision integration for text-to-clip retrieval. In Proceedings of the 33rd AAAI Conference on Artificial Intelligence (AAAI \u201919), the 31st Innovative Applications of Artificial Intelligence Conference (IAAI \u201919), the 9th AAAI Symposium on Educational Advances in Artificial Intelligence (EAAI \u201919). AAAI Press, 9062\u20139069."},{"key":"e_1_3_1_34_2","first-page":"4951","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"Xu Xiaojun","year":"2018","unstructured":"Xiaojun Xu, Xinyun Chen, Chang Liu, Anna Rohrbach, Trevor Darrell, and Dawn Song. 2018. Fooling vision and language models despite localization and attention mechanism. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 4951\u20134961."},{"key":"e_1_3_1_35_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2021.3058614"},{"key":"e_1_3_1_36_2","volume-title":"Proceedings of Network and Distributed Systems Security Symposium (NDSS)","author":"Yu Honggang","year":"2020","unstructured":"Honggang Yu, Kaichen Yang, Teng Zhang, Yun-Yun Tsai, Tsung-Yi Ho, and Yier Jin. 2020. CloudLeak: Large-scale deep learning models stealing through adversarial examples. In Proceedings of Network and Distributed Systems Security Symposium (NDSS)."},{"key":"e_1_3_1_37_2","first-page":"9159","volume-title":"Proceedings of the 33rd AAAI Conference on Artificial Intelligence (AAAI \u201919), the 31st Innovative Applications of Artificial Intelligence Conference (IAAI \u201919), the 9th AAAI Symposium on Educational Advances in Artificial Intelligence (EAAI \u201919)","author":"Yuan Yitian","year":"2019","unstructured":"Yitian Yuan, Tao Mei, and Wenwu Zhu. 2019. To find where you talk: Temporal sentence localization in video with attention based location regression. In Proceedings of the 33rd AAAI Conference on Artificial Intelligence (AAAI \u201919), the 31st Innovative Applications of Artificial Intelligence Conference (IAAI \u201919), the 9th AAAI Symposium on Educational Advances in Artificial Intelligence (EAAI \u201919). AAAI Press, 9159\u20139166."},{"key":"e_1_3_1_38_2","first-page":"1247","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR \u201919)","author":"Zhang Da","year":"2019","unstructured":"Da Zhang, Xiyang Dai, Xin Wang, Yuan-Fang Wang, and Larry S. Davis. 2019. MAN: Moment alignment network for natural language moment retrieval via iterative graph adjustment. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR \u201919). Computer Vision Foundation\/IEEE, 1247\u20131257."},{"key":"e_1_3_1_39_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.acl-main.585"},{"key":"e_1_3_1_40_2","first-page":"12870","volume-title":"Proceedings of the 34th AAAI Conference on Artificial Intelligence (AAAI \u201920), the 32nd Innovative Applications of Artificial Intelligence Conference (IAAI \u201920), the 10th AAAI Symposium on Educational Advances in Artificial Intelligence (EAAI \u201920)","author":"Zhang Songyang","year":"2020","unstructured":"Songyang Zhang, Houwen Peng, Jianlong Fu, and Jiebo Luo. 2020. Learning 2D temporal adjacent networks for moment localization with natural language. In Proceedings of the 34th AAAI Conference on Artificial Intelligence (AAAI \u201920), the 32nd Innovative Applications of Artificial Intelligence Conference (IAAI \u201920), the 10th AAAI Symposium on Educational Advances in Artificial Intelligence (EAAI \u201920). AAAI Press, 12870\u201312877."},{"key":"e_1_3_1_41_2","unstructured":"Yichi Zhang Zijian Zhu Xiao Yang and Jun Zhu. 2021. Adversarial semantic contour for object detection. arXiv:2109.15009. Retrieved from https:\/\/arxiv.org\/abs\/2109.15009"},{"key":"e_1_3_1_42_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2020.3023339"},{"key":"e_1_3_1_43_2","volume-title":"Proceedings of 6th International Conference on Learning Representations (ICLR \u201918)","author":"Zhao Zhengli","year":"2018","unstructured":"Zhengli Zhao, Dheeru Dua, and Sameer Singh. 2018. Generating natural adversarial examples. In Proceedings of 6th International Conference on Learning Representations (ICLR \u201918). OpenReview.net. Retrieved from https:\/\/openreview.net\/forum?id=H1BLjgZCb"},{"key":"e_1_3_1_44_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.01511"},{"key":"e_1_3_1_45_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2022.3179314"},{"key":"e_1_3_1_46_2","doi-asserted-by":"publisher","DOI":"10.1145\/3219819.3220078"}],"container-title":["ACM Transactions on Intelligent Systems and Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3815168","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,7,23]],"date-time":"2026-07-23T14:31:10Z","timestamp":1784817070000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3815168"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,7,23]]},"references-count":45,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2026,10,31]]}},"alternative-id":["10.1145\/3815168"],"URL":"https:\/\/doi.org\/10.1145\/3815168","relation":{},"ISSN":["2157-6904","2157-6912"],"issn-type":[{"value":"2157-6904","type":"print"},{"value":"2157-6912","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,7,23]]},"assertion":[{"value":"2024-11-24","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-04-23","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-07-23","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}