{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,7]],"date-time":"2026-11-07T07:21:51Z","timestamp":1794036111656,"version":"4.8.0"},"reference-count":322,"publisher":"Association for Computing Machinery (ACM)","issue":"2","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Comput. Surv."],"published-print":{"date-parts":[[2026,1,31]]},"abstract":"<jats:p>With the advent of Large Vision-Language Models (LVLMs), new attack vectors, such as cognitive bias, prompt injection, and jailbreaking, have emerged. Understanding these attacks promotes system robustness improvement and neural networks demystification. However, existing surveys often target attack taxonomy and lack in-depth analysis like (1) unified insights into adversariality, transferability, and generalization; (2) detailed evaluations framework; (3) motivation-driven attack categorizations; and (4) an integrated perspective on both traditional and LVLM attacks. This article addresses these gaps by offering a thorough summary of traditional and LVLM adversarial attacks, emphasizing their connections and distinctions, and providing actionable insights for future research.<\/jats:p>","DOI":"10.1145\/3743126","type":"journal-article","created":{"date-parts":[[2025,6,6]],"date-time":"2025-06-06T07:15:06Z","timestamp":1749194106000},"page":"1-42","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":24,"title":["Adversarial Attacks of Vision Tasks in the Past 10 Years: A Survey"],"prefix":"10.1145","volume":"58","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5934-5837","authenticated-orcid":false,"given":"Chiyu","family":"Zhang","sequence":"first","affiliation":[{"name":"Nanjing University of Aeronautics and Astronautics","place":["Nanjing, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6240-6688","authenticated-orcid":false,"given":"Lu","family":"Zhou","sequence":"additional","affiliation":[{"name":"Nanjing University of Aeronautics and Astronautics","place":["Nanjing, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7928-7336","authenticated-orcid":false,"given":"Xiaogang","family":"Xu","sequence":"additional","affiliation":[{"name":"The Chinese University of Hong Kong","place":["Hong Kong, Hong Kong"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-8125-1586","authenticated-orcid":false,"given":"Jiafei","family":"Wu","sequence":"additional","affiliation":[{"name":"The University of Hong Kong","place":["Hong Kong, Hong Kong"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8578-2635","authenticated-orcid":false,"given":"Zhe","family":"Liu","sequence":"additional","affiliation":[{"name":"Zhejiang Lab","place":["Hangzhou, China"]},{"name":"Nanjing University of Aeronautics and Astronautics","place":["Hangzhou, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2025,9,9]]},"reference":[{"key":"e_1_3_4_2_2","unstructured":"NIPS 2017 Defense Competition (Rank 3). 2017. NIPS-r3. Retrieved from https:\/\/github.com\/anlthms\/nips-2017\/tree\/master\/mmd"},{"key":"e_1_3_4_3_2","doi-asserted-by":"crossref","unstructured":"Abubakar Abid Maheen Farooqi and James Zou. 2021. Large language models associate Muslims with violence. Nature Machine Intelligence 3 6 (2021) 461\u2013463.","DOI":"10.1038\/s42256-021-00359-2"},{"key":"e_1_3_4_4_2","unstructured":"Shashank Agnihotri Steffen Jung and Margret Keuper. 2024. CosPGD: An efficient white-box adversarial attack for pixel-wise prediction tasks. In ICML."},{"key":"e_1_3_4_5_2","doi-asserted-by":"crossref","unstructured":"Harsh Agrawal Karan Desai Yufei Wang Xinlei Chen Rishabh Jain Mark Johnson Dhruv Batra Devi Parikh Stefan Lee and Peter Anderson. 2019. Nocaps: Novel object captioning at scale. In ICCV.","DOI":"10.1109\/ICCV.2019.00904"},{"key":"e_1_3_4_6_2","doi-asserted-by":"crossref","unstructured":"Nasir Ahmed T. Natarajan and Kamisetty R. Rao. 1974. Discrete cosine transfom. IEEE Trans. Comput. 100 1 (1974) 90\u201393.","DOI":"10.1109\/T-C.1974.223784"},{"key":"e_1_3_4_7_2","unstructured":"Inflection AI. 2023. Our policy on frontier safety. Retrieved from https:\/\/inflection.ai\/frontier-safety"},{"key":"e_1_3_4_8_2","unstructured":"Meta AI. 2024. Llama 2 - acceptable use policy. Retrieved from https:\/\/ai.meta.com\/llama\/use-policy\/"},{"key":"e_1_3_4_9_2","unstructured":"Zhipu AI. 2023. Chatglm. Retrieved from https:\/\/chatglm.cn\/main\/detail"},{"key":"e_1_3_4_10_2","doi-asserted-by":"crossref","unstructured":"Naveed Akhtar and Ajmal Mian. 2018. Threat of adversarial attacks on deep learning in computer vision: A survey. IEEE Access 6 (2018) 14410\u201314430.","DOI":"10.1109\/ACCESS.2018.2807385"},{"key":"e_1_3_4_11_2","doi-asserted-by":"crossref","unstructured":"Naveed Akhtar Ajmal Mian Navid Kardan and Mubarak Shah. 2021. Advances in adversarial attacks and defenses in computer vision: A survey. IEEE Access 9 (2021) 155161\u2013155196.","DOI":"10.1109\/ACCESS.2021.3127960"},{"key":"e_1_3_4_12_2","unstructured":"Anthropic. 2024. Claude usage policies. Retrieved from https:\/\/www.anthropic.com\/legal\/aup"},{"key":"e_1_3_4_13_2","volume-title":"Proceedings of the ICML","author":"Athalye Anish","year":"2018","unstructured":"Anish Athalye, Logan Engstrom, Andrew Ilyas, and Kevin Kwok. 2018. Synthesizing robust adversarial examples. In Proceedings of the ICML."},{"key":"e_1_3_4_14_2","doi-asserted-by":"crossref","unstructured":"Bakary Badjie Jos\u00e9 Cec\u00edlio and Antonio Casimiro. 2024. Adversarial attacks and countermeasures on image classification-based deep learning models in autonomous driving systems: A systematic review. Comput. Surveys 57 1 (2024) 1\u201352.","DOI":"10.1145\/3691625"},{"key":"e_1_3_4_15_2","unstructured":"Eugene Bagdasaryan Tsung-Yin Hsieh Ben Nassi and Vitaly Shmatikov. 2023. (Ab) using Images and Sounds for Indirect Instruction Injection in Multi-Modal LLMs. arXiv:2307.10490."},{"key":"e_1_3_4_16_2","doi-asserted-by":"crossref","unstructured":"Alireza Bahramali Milad Nasr Amir Houmansadr Dennis Goeckel and Don Towsley. 2021. Robust adversarial attacks against DNN-based wireless communication systems. In ACM SIGSAC.","DOI":"10.1145\/3460120.3484777"},{"key":"e_1_3_4_17_2","unstructured":"Jinze Bai Shuai Bai Yunfei Chu Zeyu Cui Kai Dang Xiaodong Deng et\u00a0al. 2023. Qwen technical report. arXiv:2309.16609."},{"key":"e_1_3_4_18_2","unstructured":"Yuntao Bai Andy Jones Kamal Ndousse Amanda Askell Anna Chen Nova DasSarma Dawn Drain Stanislav Fort Deep Ganguli Tom Henighan et\u00a0al. 2022. Training a helpful and harmless assistant with reinforcement learning from human feedback. arXiv:2204.05862."},{"key":"e_1_3_4_19_2","unstructured":"Luke Bailey Euan Ong Stuart Russell and Scott Emmons. 2023. Image hijacks: Adversarial images can control generative models at runtime. arXiv:2309.00236."},{"key":"e_1_3_4_20_2","doi-asserted-by":"crossref","unstructured":"Shumeet Baluja and Ian Fischer. 2017. Adversarial transformation networks: Learning to generate adversarial examples. arXiv:1703.09387.","DOI":"10.1609\/aaai.v32i1.11672"},{"key":"e_1_3_4_21_2","unstructured":"Fan Bao Shen Nie Kaiwen Xue Chongxuan Li Shi Pu Yaole Wang Gang Yue Yue Cao Hang Su and Jun Zhu. 2023. One transformer fits all distributions in multi-modal diffusion at scale. In ICML."},{"key":"e_1_3_4_22_2","doi-asserted-by":"crossref","unstructured":"Battista Biggio Igino Corona Davide Maiorca Blaine Nelson Nedim \u0160rndi\u0107 Pavel Laskov Giorgio Giacinto and Fabio Roli. 2013. Evasion attacks against machine learning at test time. In ECML PKDD.","DOI":"10.1007\/978-3-642-40994-3_25"},{"key":"e_1_3_4_23_2","unstructured":"Avrim Blum Omar Montasser Greg Shakhnarovich and Hongyang Zhang. 2022. Boosting barely robust learners: A new perspective on adversarial robustness. In NIPS."},{"key":"e_1_3_4_24_2","doi-asserted-by":"crossref","unstructured":"Lisa Bode Dominic Lees and Dan Golding. 2021. The digital face and deepfakes on screen. Convergence 27 4 (2021) 849\u2013854.","DOI":"10.1177\/13548565211034044"},{"key":"e_1_3_4_25_2","unstructured":"Wieland Brendel Jonas Rauber and Matthias Bethge. 2017. Decision-based adversarial attacks: Reliable attacks against black-box machine learning models. arXiv:1712.04248."},{"key":"e_1_3_4_26_2","unstructured":"Tom B. Brown Nicholas Carlini Chiyuan Zhang Catherine Olsson Paul Christiano and Ian Goodfellow. 2018. Unrestricted adversarial examples. arXiv:1809.08352."},{"key":"e_1_3_4_27_2","unstructured":"Tom B. Brown Dandelion Man\u00e9 Aurko Roy Mart\u00edn Abadi and Justin Gilmer. 2017. Adversarial patch. arXiv:1712.09665."},{"key":"e_1_3_4_28_2","unstructured":"Nicholas Carlini Milad Nasr Christopher A. Choquette-Choo Matthew Jagielski Irena Gao Pang Wei W. Koh Daphne Ippolito Florian Tramer and Ludwig Schmidt. 2024. Are aligned neural networks adversarially aligned? In NIPS."},{"key":"e_1_3_4_29_2","doi-asserted-by":"crossref","unstructured":"Nicholas Carlini and David Wagner. 2017. Towards evaluating the robustness of neural networks. In S&P.","DOI":"10.1109\/SP.2017.49"},{"key":"e_1_3_4_30_2","doi-asserted-by":"crossref","unstructured":"Tommaso Caselli Valerio Basile Jelena Mitrovi\u0107 and Michael Granitzer. 2020. Hatebert: Retraining bert for abusive language detection in english. arXiv:2010.12472.","DOI":"10.18653\/v1\/2021.woah-1.3"},{"key":"e_1_3_4_31_2","unstructured":"Patrick Chao Alexander Robey Edgar Dobriban Hamed Hassani George J. Pappas and Eric Wong. 2023. Jailbreaking black box large language models in twenty queries. arXiv:2310.08419."},{"key":"e_1_3_4_32_2","doi-asserted-by":"crossref","unstructured":"Huanran Chen Shitong Shao Ziyi Wang Zirui Shang Jin Chen Xiaofeng Ji and Xinxiao Wu. 2022. Bootstrap generalization ability from loss landscape perspective. In ECCV.","DOI":"10.1007\/978-3-031-25075-0_34"},{"key":"e_1_3_4_33_2","unstructured":"Huanran Chen Yichi Zhang Yinpeng Dong Xiao Yang Hang Su and Jun Zhu. 2023. Rethinking model ensemble in transfer-based adversarial attacks. arXiv:2303.09105."},{"key":"e_1_3_4_34_2","unstructured":"Pin-Yu Chen Huan Zhang Yash Sharma Jinfeng Yi and Cho-Jui Hsieh. 2017. Zoo: Zeroth order optimization based black-box attacks to deep neural networks without training substitute models. In AISec."},{"key":"e_1_3_4_35_2","unstructured":"Shuo Chen Zhen Han Bailan He Zifeng Ding Wenqian Yu Philip Torr Volker Tresp and Jindong Gu. 2024. Red teaming GPT-4V: Are GPT-4V safe against uni\/multi-modal jailbreak attacks? arXiv:2404.03411."},{"key":"e_1_3_4_36_2","unstructured":"Shang-Tse Chen Cory Cornelius Jason Martin and Duen Horng Chau. 2019. Shapeshifter: Robust physical adversarial attack on faster r-cnn object detector. In ECML PKDD."},{"key":"e_1_3_4_37_2","doi-asserted-by":"crossref","unstructured":"Xinquan Chen Xitong Gao Juanjuan Zhao Kejiang Ye and Cheng-Zhong Xu. 2023. Advdiffuser: Natural adversarial example synthesis with diffusion models. In ICCV.","DOI":"10.1109\/ICCV51070.2023.00421"},{"key":"e_1_3_4_38_2","doi-asserted-by":"crossref","unstructured":"Yangyi Chen Karan Sikka Michael Cogswell Heng Ji and Ajay Divakaran. 2024. Dress: Instructing large vision-language models to align and interact with humans via natural language feedback. In CVPR.","DOI":"10.1109\/CVPR52733.2024.01350"},{"key":"e_1_3_4_39_2","unstructured":"Yang Chen Ethan Mendes Sauvik Das Wei Xu and Alan Ritter. 2023. Can language models be instructed to protect personal information? arXiv:2310.02224."},{"key":"e_1_3_4_40_2","unstructured":"Shuyu Cheng Yinpeng Dong Tianyu Pang Hang Su and Jun Zhu. 2019. Improving black-box adversarial attacks with a transfer-based prior. In NIPS."},{"key":"e_1_3_4_41_2","unstructured":"Wei-Lin Chiang Zhuohan Li Zi Lin Ying Sheng Zhanghao Wu Hao Zhang Lianmin Zheng Siyuan Zhuang Yonghao Zhuang Joseph E. Gonzalez et\u00a0al. 2023. Vicuna: An open-source chatbot impressing gpt-4 with 90%* chatgpt quality. https:\/\/lmsys.org\/blog\/2023-03-30-vicuna\/"},{"key":"e_1_3_4_42_2","unstructured":"Paul F. Christiano Jan Leike Tom Brown Miljan Martic Shane Legg and Dario Amodei. 2017. Deep reinforcement learning from human preferences. In NIPS."},{"key":"e_1_3_4_43_2","doi-asserted-by":"crossref","unstructured":"Tat-Seng Chua Jinhui Tang Richang Hong Haojie Li Zhiping Luo and Yantao Zheng. 2009. Nus-wide: a real-world web image database from national university of singapore. In ACM CIVR.","DOI":"10.1145\/1646396.1646452"},{"key":"e_1_3_4_44_2","unstructured":"Moustapha Cisse Yossi Adi Natalia Neverova and Joseph Keshet. 2017. Houdini: Fooling deep structured prediction models. arXiv:1707.05373."},{"key":"e_1_3_4_45_2","doi-asserted-by":"crossref","unstructured":"Joseph Clements and Yingjie Lao. 2022. In pursuit of preserving the fidelity of adversarial images. In ICASSP.","DOI":"10.1109\/ICASSP43922.2022.9747529"},{"key":"e_1_3_4_46_2","unstructured":"Alibaba Cloud. 2023. Retrieved from Qwen. https:\/\/tongyi.aliyun.com\/qianwen\/"},{"key":"e_1_3_4_47_2","volume-title":"AISTATS","author":"Coates Adam","year":"2011","unstructured":"Adam Coates, Andrew Ng, and Honglak Lee. 2011. An analysis of single-layer networks in unsupervised feature learning. In AISTATS."},{"key":"e_1_3_4_48_2","volume-title":"ICML","author":"Cohen Jeremy","year":"2019","unstructured":"Jeremy Cohen, Elan Rosenfeld, and Zico Kolter. 2019. Certified adversarial robustness via randomized smoothing. In ICML."},{"key":"e_1_3_4_49_2","doi-asserted-by":"crossref","unstructured":"Marius Cordts Mohamed Omran Sebastian Ramos Timo Rehfeld Markus Enzweiler Rodrigo Benenson Uwe Franke Stefan Roth and Bernt Schiele. 2016. The cityscapes dataset for semantic urban scene understanding. In CVPR.","DOI":"10.1109\/CVPR.2016.350"},{"key":"e_1_3_4_50_2","doi-asserted-by":"crossref","unstructured":"Joana C. Costa Tiago Roxo Hugo Proen\u00e7a and Pedro R. M. In\u00e1cio. 2024. How deep learning sees the world: A survey on adversarial attacks & defenses. IEEE Access.","DOI":"10.1109\/ACCESS.2024.3395118"},{"key":"e_1_3_4_51_2","unstructured":"Francesco Croce and Matthias Hein. 2020. Reliable evaluation of adversarial robustness with an ensemble of diverse parameter-free attacks. In ICML."},{"key":"e_1_3_4_52_2","unstructured":"Francesco Croce and Matthias Hein. 2020. Minimally distorted adversarial examples with a fast adaptive boundary attack. In ICML."},{"key":"e_1_3_4_53_2","unstructured":"Xuanming Cui Alejandro Aparcedo Young Kyun Jang and Ser-Nam Lim. 2024. On the robustness of large multimodal models against image adversarial attacks. In CVPR."},{"key":"e_1_3_4_54_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2005.177"},{"key":"e_1_3_4_55_2","doi-asserted-by":"crossref","unstructured":"Gelei Deng Yi Liu Yuekang Li Kailong Wang Ying Zhang Zefeng Li Haoyu Wang Tianwei Zhang and Yang Liu. 2023. Jailbreaker: Automated jailbreak across multiple large language model chatbots. arXiv:2307.08715.","DOI":"10.14722\/ndss.2024.24188"},{"key":"e_1_3_4_56_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"e_1_3_4_57_2","unstructured":"Yue Deng Wenxuan Zhang Sinno Jialin Pan and Lidong Bing. 2023. Multilingual jailbreak challenges in large language models. arXiv:2310.06474."},{"key":"e_1_3_4_58_2","doi-asserted-by":"crossref","unstructured":"Lucas Dixon John Li Jeffrey Sorensen Nithum Thain and Lucy Vasserman. 2018. Measuring and mitigating unintended bias in text classification. In AIES.","DOI":"10.1145\/3278721.3278729"},{"key":"e_1_3_4_59_2","doi-asserted-by":"crossref","unstructured":"Junhao Dong Yuan Wang Jianhuang Lai and Xiaohua Xie. 2023. Restricted black-box adversarial attack against deepfake face swapping. TIFS 18 (2023) 2596\u20132608.","DOI":"10.1109\/TIFS.2023.3266702"},{"key":"e_1_3_4_60_2","unstructured":"Yinpeng Dong Huanran Chen Jiawei Chen Zhengwei Fang Xiao Yang Yichi Zhang Yu Tian Hang Su and Jun Zhu. 2023. How robust is google\u2019s bard to adversarial image attacks? arXiv:2309.11751."},{"key":"e_1_3_4_61_2","doi-asserted-by":"crossref","unstructured":"Yinpeng Dong Shuyu Cheng Tianyu Pang Hang Su and Jun Zhu. 2021. Query-efficient black-box adversarial attacks guided by a transfer-based prior. TPAMI 44 12 (2021) 9536\u20139548.","DOI":"10.1109\/TPAMI.2021.3126733"},{"key":"e_1_3_4_62_2","doi-asserted-by":"crossref","unstructured":"Yinpeng Dong Fangzhou Liao Tianyu Pang Hang Su Jun Zhu Xiaolin Hu and Jianguo Li. 2018. Boosting adversarial attacks with momentum. In CVPR.","DOI":"10.1109\/CVPR.2018.00957"},{"key":"e_1_3_4_63_2","doi-asserted-by":"crossref","unstructured":"Yinpeng Dong Tianyu Pang Hang Su and Jun Zhu. 2019. Evading defenses to transferable adversarial examples by translation-invariant attacks. In CVPR.","DOI":"10.1109\/CVPR.2019.00444"},{"key":"e_1_3_4_64_2","unstructured":"Yinpeng Dong Hang Su Jun Zhu and Fan Bao. 2017. Towards interpretable deep neural networks by leveraging adversarial examples. arXiv:1708.05493."},{"key":"e_1_3_4_65_2","unstructured":"Alexey Dosovitskiy. 2020. An image is worth 16x16 words: Transformers for image recognition at scale. arXiv:2010.11929."},{"key":"e_1_3_4_66_2","unstructured":"Zhengxiao Du Yujie Qian Xiao Liu Ming Ding Jiezhong Qiu Zhilin Yang and Jie Tang. 2021. Glm: General language model pretraining with autoregressive blank infilling. arXiv:2103.10360."},{"key":"e_1_3_4_67_2","doi-asserted-by":"crossref","unstructured":"Mark Everingham Luc Van Gool Christopher K. I. Williams John Winn and Andrew Zisserman. 2010. The pascal visual object classes (voc) challenge. IJCV 88 (2010) 303\u2013338.","DOI":"10.1007\/s11263-009-0275-4"},{"key":"e_1_3_4_68_2","doi-asserted-by":"crossref","unstructured":"Kevin Eykholt Ivan Evtimov Earlence Fernandes Bo Li Amir Rahmati Chaowei Xiao Atul Prakash Tadayoshi Kohno and Dawn Song. 2018. Robust physical-world attacks on deep learning visual classification. In CVPR.","DOI":"10.1109\/CVPR.2018.00175"},{"key":"e_1_3_4_69_2","doi-asserted-by":"crossref","unstructured":"Alhussein Fawzi Seyed-Mohsen Moosavi-Dezfooli and Pascal Frossard. 2017. The robustness of deep networks: A geometrical perspective. IEEE Signal Processing Magazine 34 6 (2017) 50\u201362.","DOI":"10.1109\/MSP.2017.2740965"},{"key":"e_1_3_4_70_2","unstructured":"Alhussein Fawzi Seyed-Mohsen Moosavi-Dezfooli and Pascal Frossard. 2016. Robustness of classifiers: from adversarial to random noise. In NIPS."},{"key":"e_1_3_4_71_2","unstructured":"Pierre Foret Ariel Kleiner Hossein Mobahi and Behnam Neyshabur. 2020. Sharpness-aware minimization for efficiently improving generalization. arXiv:2010.01412."},{"key":"e_1_3_4_72_2","doi-asserted-by":"crossref","unstructured":"Matt Fredrikson Somesh Jha and Thomas Ristenpart. 2015. Model inversion attacks that exploit confidence information and basic countermeasures. In ACM SIGSAC.","DOI":"10.1145\/2810103.2813677"},{"key":"e_1_3_4_73_2","unstructured":"Xiaohan Fu Zihan Wang Shuheng Li Rajesh K. Gupta Niloofar Mireshghallah Taylor Berg-Kirkpatrick and Earlence Fernandes. 2023. Misusing tools in large language models with visual adversarial examples. arXiv:2310.03185."},{"key":"e_1_3_4_74_2","doi-asserted-by":"crossref","unstructured":"Kai Greshake Sahar Abdelnabi Shailesh Mishra Christoph Endres Thorsten Holz and Mario Fritz. 2023. Not what you\u2019ve signed up for: Compromising real-world llm-integrated applications with indirect prompt injection. In AISec.","DOI":"10.1145\/3605764.3623985"},{"key":"e_1_3_4_75_2","unstructured":"Deep Ganguli Liane Lovitt Jackson Kernion Amanda Askell Yuntao Bai Saurav Kadavath Ben Mann Ethan Perez Nicholas Schiefer Kamal Ndousse et\u00a0al. 2022. Red teaming language models to reduce harms: Methods scaling behaviors and lessons learned. arXiv:2209.07858."},{"key":"e_1_3_4_76_2","unstructured":"Kuofeng Gao Yang Bai Jiawang Bai Yong Yang and Shu-Tao Xia. 2024. Adversarial robustness for visual grounding of multimodal large language models. arXiv:2405.09981."},{"key":"e_1_3_4_77_2","unstructured":"Kuofeng Gao Yang Bai Jindong Gu Shu-Tao Xia Philip Torr Zhifeng Li and Wei Liu. 2024. Inducing high energy-latency of large vision-language models with verbose images. arXiv:2401.11170."},{"key":"e_1_3_4_78_2","unstructured":"Lianli Gao Qilong Zhang Jingkuan Song and Heng Tao Shen. 2020. Patch-wise++ perturbation for adversarial targeted attacks. arXiv:2012.15503."},{"key":"e_1_3_4_79_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-58604-1_19"},{"key":"e_1_3_4_80_2","unstructured":"Yinghua Gao Dongxian Wu Jingfeng Zhang Guanhao Gan Shu-Tao Xia Gang Niu and Masashi Sugiyama. 2023. On the effectiveness of adversarial training against backdoor attacks. TNNLS."},{"key":"e_1_3_4_81_2","unstructured":"GeekPwn. 2018. GeekPwn CAAD 2018. Retrieved from https:\/\/en.caad.geekpwn.org\/"},{"key":"e_1_3_4_82_2","doi-asserted-by":"crossref","unstructured":"Samuel Gehman Suchin Gururangan Maarten Sap Yejin Choi and Noah A Smith. 2020. Realtoxicityprompts: Evaluating neural toxic degeneration in language models. arXiv:2009.11462.","DOI":"10.18653\/v1\/2020.findings-emnlp.301"},{"key":"e_1_3_4_83_2","doi-asserted-by":"crossref","unstructured":"Ross Girshick Jeff Donahue Trevor Darrell and Jitendra Malik. 2014. Rich feature hierarchies for accurate object detection and semantic segmentation. In CVPR.","DOI":"10.1109\/CVPR.2014.81"},{"key":"e_1_3_4_84_2","volume-title":"NIPS","author":"Goldwasser Shafi","year":"2020","unstructured":"Shafi Goldwasser, Adam Tauman Kalai, et\u00a0al. 2020. Beyond perturbations: Learning guarantees with arbitrary adversarial test examples. In NIPS."},{"key":"e_1_3_4_85_2","unstructured":"George Gondim-Ribeiro Pedro Tabacof and Eduardo Valle. 2018. Adversarial attacks on variational autoencoders. arXiv:1806.04646."},{"key":"e_1_3_4_86_2","unstructured":"Yichen Gong Delong Ran Jinyuan Liu Conglei Wang Tianshuo Cong Anyu Wang Sisi Duan and Xiaoyun Wang. 2023. Figstep: Jailbreaking large vision-language models via typographic visual prompts. arXiv:2311.05608."},{"key":"e_1_3_4_87_2","doi-asserted-by":"crossref","unstructured":"Ian Goodfellow Jean Pouget-Abadie Mehdi Mirza Bing Xu DavidWarde-Farley Sherjil Ozair Aaron Courville and Yoshua Bengio. 2020. Generative adversarial networks. Commun. ACM 63 11 (2020) 139\u2013144.","DOI":"10.1145\/3422622"},{"key":"e_1_3_4_88_2","unstructured":"Ian J Goodfellow Jonathon Shlens and Christian Szegedy. 2014. Explaining and harnessing adversarial examples. arXiv:1412.6572."},{"key":"e_1_3_4_89_2","unstructured":"Google. 2024. Gemini usage policies. Retrieved from https:\/\/ai.google.dev\/gemini-api\/docs\/safety-settings"},{"key":"e_1_3_4_90_2","unstructured":"Yunhao Gou Kai Chen Zhili Liu Lanqing Hong Hang Xu Zhenguo Li Dit-Yan Yeung James T. Kwok and Yu Zhang. 2024. Eyes closed safety on: Protecting multimodal llms via image-to-text transformation. arXiv:2403.09572."},{"key":"e_1_3_4_91_2","unstructured":"Sven Gowal Jonathan Uesato Chongli Qin Po-Sen Huang Timothy Mann and Pushmeet Kohli. 2019. An alternative surrogate loss for pgd-based adversarial testing. arXiv:1910.09338."},{"key":"e_1_3_4_92_2","doi-asserted-by":"crossref","unstructured":"Yash Goyal Tejas Khot Douglas Summers-Stay Dhruv Batra and Devi Parikh. 2017. Making the v in vqa matter: Elevating the role of image understanding in visual question answering. In CVPR.","DOI":"10.1109\/CVPR.2017.670"},{"key":"e_1_3_4_93_2","unstructured":"Jindong Gu Hengshuang Zhao Volker Tresp and Philip H. S. Torr. 2022. Segpgd: An effective and efficient adversarial attack for evaluating and boosting segmentation robustness. In ECCV."},{"key":"e_1_3_4_94_2","unstructured":"Xiangming Gu Xiaosen Zheng Tianyu Pang Chao Du Qian Liu YeWang Jing Jiang and Min Lin. 2024. Agent smith: A single image can jailbreak one million multimodal llm agents exponentially fast. arXiv:2402.08567."},{"key":"e_1_3_4_95_2","unstructured":"Chuan Guo Jared S. Frank and Kilian Q. Weinberger. 2018. Low frequency adversarial perturbation. arXiv:1809.08758."},{"key":"e_1_3_4_96_2","unstructured":"Chuan Guo Mayank Rana Moustapha Cisse and Laurens Van Der Maaten. 2017. Countering adversarial images using input transformations. arXiv:1711.00117."},{"key":"e_1_3_4_97_2","unstructured":"Jiaxian Guo Junnan Li Dongxu Li Anthony Meng Huat Tiong Boyang Li Dacheng Tao and Steven Hoi. 2023. From images to textual prompts: Zero-shot visual question answering with frozen large language models. In CVPR."},{"key":"e_1_3_4_98_2","article-title":"Efficient generation of targeted and transferable adversarial examples for vision-language models via diffusion","author":"Guo Qi","year":"2024","unstructured":"Qi Guo et\u00a0al. 2024. Efficient generation of targeted and transferable adversarial examples for vision-language models via diffusion. TIFS.","journal-title":"TIFS"},{"key":"e_1_3_4_99_2","unstructured":"Muhammad Zaid Hameed and Andras Gyorgy. 2021. Perceptually constrained adversarial attacks. arXiv:2102.07140."},{"key":"e_1_3_4_100_2","doi-asserted-by":"crossref","unstructured":"Yaru Hao Li Dong Furu Wei and Ke Xu. 2019. Visualizing and understanding the effectiveness of BERT. arXiv:1908.05620.","DOI":"10.18653\/v1\/D19-1424"},{"key":"e_1_3_4_101_2","doi-asserted-by":"crossref","unstructured":"Jack Hessel Ari Holtzman Maxwell Forbes Ronan Le Bras and Yejin Choi. 2021. Clipscore: A reference-free evaluation metric for image captioning. arXiv:2104.08718.","DOI":"10.18653\/v1\/2021.emnlp-main.595"},{"key":"e_1_3_4_102_2","unstructured":"Martin Heusel Hubert Ramsauer Thomas Unterthiner Bernhard Nessler and Sepp Hochreiter. 2017. Gans trained by a two time-scale update rule converge to a local nash equilibrium. In NIPS."},{"key":"e_1_3_4_103_2","unstructured":"Robert H\u00f6nig Javier Rando Nicholas Carlini and Florian Tram\u00e8r. 2024. Adversarial perturbations cannot reliably protect artists from generative AI. arXiv:2406.12027."},{"key":"e_1_3_4_104_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46493-0_39"},{"key":"e_1_3_4_105_2","unstructured":"Gary B. Huang Marwan Mattar Tamara Berg and Eric Learned-Miller. 2008. Labeled faces in the wild: A database forstudying face recognition in unconstrained environments. In ECCV Workshop."},{"key":"e_1_3_4_106_2","doi-asserted-by":"crossref","unstructured":"Hao Huang Ziyan Chen Huanran Chen Yongtao Wang and Kevin Zhang. 2023. T-sea: Transfer-based self-ensemble attack on object detection. In CVPR.","DOI":"10.1109\/CVPR52729.2023.01965"},{"key":"e_1_3_4_107_2","doi-asserted-by":"crossref","unstructured":"Qian Huang Isay Katsman Horace He Zeqi Gu Serge Belongie and Ser-Nam Lim. 2019. Enhancing adversarial example transferability with an intermediate level attack. In ICCV.","DOI":"10.1109\/ICCV.2019.00483"},{"key":"e_1_3_4_108_2","unstructured":"Sandy Huang Nicolas Papernot Ian Goodfellow Yan Duan and Pieter Abbeel. 2017. Adversarial attacks on neural network policies. arXiv:1702.02284."},{"key":"e_1_3_4_109_2","unstructured":"W. Ronny Huang Jonas Geiping Liam Fowl Gavin Taylor and Tom Goldstein. 2020. Metapoison: Practical general-purpose clean-label data poisoning. In NIPS."},{"key":"e_1_3_4_110_2","unstructured":"Yangsibo Huang Samyak Gupta Mengzhou Xia Kai Li and Danqi Chen. 2023. Catastrophic jailbreak of open-source llms via exploiting generation. arXiv:2310.06987."},{"key":"e_1_3_4_111_2","doi-asserted-by":"crossref","unstructured":"Yao Huang Yinpeng Dong Shouwei Ruan Xiao Yang Hang Su and Xingxing Wei. 2024. Towards transferable targeted 3D adversarial attack in the physical world. In CVPR.","DOI":"10.1109\/CVPR52733.2024.02314"},{"key":"e_1_3_4_112_2","volume-title":"ICML","author":"Ilyas Andrew","year":"2018","unstructured":"Andrew Ilyas, Logan Engstrom, Anish Athalye, and Jessy Lin. 2018. Black-box adversarial attacks with limited queries and information. In ICML."},{"key":"e_1_3_4_113_2","unstructured":"Hakan Inan Kartikeya Upasani Jianfeng Chi Rashi Rungta Krithika Iyer Yuning Mao Michael Tontchev Qing Hu Brian Fuller Davide Testuggine et\u00a0al. 2023. Llama guard: Llm-based input-output safeguard for human-ai conversations. arXiv:2312.06674."},{"key":"e_1_3_4_114_2","unstructured":"Jiaming Ji Mickel Liu Josef Dai Xuehai Pan Chi Zhang Ce Bian Boyuan Chen Ruiyang Sun Yizhou Wang and Yaodong Yang. 2024. Beavertails: Towards improved safety alignment of llm via a human-preference dataset. In NIPS."},{"key":"e_1_3_4_115_2","unstructured":"Yuheng Ji Yue Liu Zhicheng Zhang Zhao Zhang Yuting Zhao Gang Zhou Xingwei Zhang Xinwang Liu and Xiaolong Zheng. 2024. AdvLoRA: Adversarial low-rank adaptation of vision-language models. arXiv:2404.13425."},{"key":"e_1_3_4_116_2","unstructured":"Xiaojun Jia Xingxing Wei Xiaochun Cao and Hassan Foroosh. 2019. Comdefend: An efficient image compression model to defend adversarial examples. In CVPR."},{"key":"e_1_3_4_117_2","unstructured":"Xiaojun Jia Xingxing Wei Xiaochun Cao and Xiaoguang Han. 2020. Adv-watermark: A novel watermark perturbation for adversarial examples. In ACM MM."},{"key":"e_1_3_4_118_2","unstructured":"Google Jigsaw. 2017. Perspective API. Retrieved from https:\/\/www.perspectiveapi.com\/"},{"key":"e_1_3_4_119_2","unstructured":"Haibo Jin Leyang Hu Xinuo Li Peiyan Zhang Chonghan Chen Jun Zhuang and Haohan Wang. 2024. Jailbreakzoo: Survey landscapes and horizons in jailbreaking large language and vision-language models. arXiv:2407.01599."},{"key":"e_1_3_4_120_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46475-6_43"},{"key":"e_1_3_4_121_2","unstructured":"Matt Jordan Naren Manoj Surbhi Goel and Alexandros G Dimakis. 2019. Quantifying perceptual distortion of adversarial examples. arXiv:1902.08265."},{"key":"e_1_3_4_122_2","unstructured":"Harini Kannan Alexey Kurakin and Ian Goodfellow. 2018. Adversarial logit pairing. arXiv:1803.06373."},{"key":"e_1_3_4_123_2","volume-title":"AAAI Workshop","author":"Karli Berat Tuna","year":"2022","unstructured":"Berat Tuna Karli, Deniz Sen, and Alptekin Temizel. 2022. Improving perceptual quality of adversarial images using perceptual distance minimization and normalized variance weighting. In AAAI Workshop."},{"key":"e_1_3_4_124_2","volume-title":"ICML","author":"Kim Wonjae","year":"2021","unstructured":"Wonjae Kim, Bokyung Son, and Ildoo Kim. 2021. Vilt: Vision-and-language transformer without convolution or region supervision. In ICML."},{"key":"e_1_3_4_125_2","unstructured":"Diederik P. Kingma. 2013. Auto-encoding variational bayes. arXiv:1312.6114."},{"key":"e_1_3_4_126_2","unstructured":"Diederik P. Kingma. 2014. Adam: A method for stochastic optimization. arXiv:1312.6114."},{"key":"e_1_3_4_127_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICPR48806.2021.9412236"},{"key":"e_1_3_4_128_2","doi-asserted-by":"publisher","DOI":"10.1109\/SPW.2018.00014"},{"key":"e_1_3_4_129_2","unstructured":"Alex Krizhevsky Geoffrey Hinton et\u00a0al. 2009. Learning multiple layers of features from tiny images. Toronto ON Canada."},{"key":"e_1_3_4_130_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2009.5459250"},{"key":"e_1_3_4_131_2","unstructured":"Martin Kuo Jianyi Zhang Aolin Ding Qinsi Wang Louis DiValentin Yujia Bao Wei Wei Hai Li and Yiran Chen. 2025. H-cot: Hijacking the chain-of-thought safety reasoning mechanism to jailbreak large reasoning models including openai o1\/o3 deepseek-r1 and gemini 2.0 flash thinking. arXiv:2502.12893."},{"key":"e_1_3_4_132_2","unstructured":"Alexey Kurakin Ian Goodfellow and Samy Bengio. 2016. Adversarial machine learning at scale. arXiv:1611.01236."},{"key":"e_1_3_4_133_2","doi-asserted-by":"publisher","DOI":"10.1201\/9781351251389-8"},{"key":"e_1_3_4_134_2","unstructured":"Cassidy Laidlaw Sahil Singla and Soheil Feizi. 2020. Perceptual adversarial robustness: Defense against unseen threat models. arXiv:2006.12655."},{"key":"e_1_3_4_135_2","unstructured":"Cassidy Laidlaw and Soheil Feizi. 2019. Functional Adversarial Attacks. Curran Associates Inc."},{"key":"e_1_3_4_136_2","doi-asserted-by":"crossref","unstructured":"Xiangyuan Lan Mang Ye Rui Shao Bineng Zhong Pong C. Yuen and Huiyu Zhou. 2019. Learning modality-consistency feature templates: A robust RGB-infrared tracking system. IEEE Transactions on Industrial Electronics 66 12 (2019) 9887\u20139897.","DOI":"10.1109\/TIE.2019.2898618"},{"key":"e_1_3_4_137_2","unstructured":"Anders Boesen Lindbo Larsen S\u00f8ren Kaae S\u00f8nderby Hugo Larochelle and Ole Winther. 2016. Autoencoding beyond pixels using a learned similarity metric. In ICML."},{"key":"e_1_3_4_138_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2013.6639343"},{"key":"e_1_3_4_139_2","doi-asserted-by":"publisher","DOI":"10.1109\/5.726791"},{"key":"e_1_3_4_140_2","volume-title":"SIGKDD","year":"2022","unstructured":"Alyssa Lees, Vinh Q Tran, Yi Tay, Jeffrey Sorensen, Jai Gupta, Donald Metzler, and Lucy Vasserman. 2022. A new generation of perspective api: Efficient multilingual character-level transformers. In SIGKDD."},{"key":"e_1_3_4_141_2","doi-asserted-by":"crossref","unstructured":"Chao Li Wen Yao Handing Wang Tingsong Jiang and Xiaoya Zhang. 2023. Bayesian evolutionary optimization for crafting high-quality adversarial examples with limited query budget. Applied Soft Computing 142 (2023) 110370.","DOI":"10.1016\/j.asoc.2023.110370"},{"key":"e_1_3_4_142_2","unstructured":"Chao Li Tingsong Jiang Handing Wang Wen Yao and Donghua Wang. 2024. Optimizing latent variables in integrating transfer and query based attack framework. TPAMI."},{"key":"e_1_3_4_143_2","unstructured":"Chao Li Handing Wang Jun Zhang Wen Yao and Tingsong Jiang. 2022. An approximated gradient sign method using differential evolution for black-box adversarial attack. TEC."},{"key":"e_1_3_4_144_2","volume-title":"NIPS","author":"Li Hao","year":"2018","unstructured":"Hao Li, Zheng Xu, Gavin Taylor, Christoph Studer, and Tom Goldstein. 2018. Visualizing the loss landscape of neural nets. In NIPS."},{"key":"e_1_3_4_145_2","volume-title":"NIPS","year":"2021","unstructured":"Junnan Li, Ramprasaath Selvaraju, Akhilesh Gotmare, Shafiq Joty, Caiming Xiong, and Steven Chu Hong Hoi. 2021. Align before fuse: Vision and language representation learning with momentum distillation. In NIPS."},{"key":"e_1_3_4_146_2","volume-title":"ICML","year":"2022","unstructured":"Junnan Li, Dongxu Li, Caiming Xiong, and Steven Hoi. 2022. Blip: Bootstrapping language-image pre-training for unified vision-language understanding and generation. In ICML."},{"key":"e_1_3_4_147_2","volume-title":"ICML","year":"2019","unstructured":"Juncheng Li, Frank Schmidt, and Zico Kolter. 2019. Adversarial camera stickers: A physical camera-based attack on deep learning systems. In ICML."},{"key":"e_1_3_4_148_2","doi-asserted-by":"crossref","unstructured":"Lijun Li Bowen Dong Ruohui Wang Xuhao Hu Wangmeng Zuo Dahua Lin Yu Qiao and Jing Shao. 2024. Salad-bench: A hierarchical and comprehensive safety benchmark for large language models. arXiv:2402.05044.","DOI":"10.18653\/v1\/2024.findings-acl.235"},{"key":"e_1_3_4_149_2","volume-title":"CVPR","year":"2024","unstructured":"Lin Li, Haoyan Guan, Jianing Qiu, and Michael Spratling. 2024. One prompt word is enough to boost adversarial robustness for pre-trained vision-language models. In CVPR."},{"key":"e_1_3_4_150_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00072"},{"key":"e_1_3_4_151_2","unstructured":"Mukai Li Lei Li Yuwei Yin Masood Ahmed Zhenguang Liu and Qi Liu. 2024. Red teaming visual language models. arXiv:2401.12915."},{"key":"e_1_3_4_152_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-58517-4_15"},{"key":"e_1_3_4_153_2","volume-title":"ECCV","year":"2020","unstructured":"Yingwei Li, Song Bai, Cihang Xie, Zhenyu Liao, Xiaohui Shen, and Alan Yuille. 2020. Regional homogeneity: Towards learning transferable universal adversarial perturbations against defenses. In ECCV."},{"key":"e_1_3_4_154_2","article-title":"Images are achilles\u2019 heel of alignment: Exploiting visual vulnerabilities for jailbreaking multimodal large language models","author":"Li Y","year":"2024","unstructured":"Y Li et\u00a0al. 2024. Images are achilles\u2019 heel of alignment: Exploiting visual vulnerabilities for jailbreaking multimodal large language models. In ECCV.","journal-title":"ECCV"},{"key":"e_1_3_4_155_2","unstructured":"Zhaoyi Li Xiaohan Zhao Dong-Dong Wu Jiacheng Cui and Zhiqiang Shen. 2025. A frustratingly simple yet highly effective attack baseline: Over 90% success rate against the strong black-box models of GPT-4.5\/4o\/o1. arXiv:2503.10635."},{"key":"e_1_3_4_156_2","volume-title":"CVPR","year":"2018","unstructured":"Fangzhou Liao, Ming Liang, Yinpeng Dong, Tianyu Pang, Xiaolin Hu, and Jun Zhu. 2018. Defense against adversarial attacks using high-level representation guided denoiser. In CVPR."},{"key":"e_1_3_4_157_2","volume-title":"Text Summarization Branches Out","author":"Lin Chin-Yew","year":"2004","unstructured":"Chin-Yew Lin. 2004. Rouge: A package for automatic evaluation of summaries. In Text Summarization Branches Out."},{"key":"e_1_3_4_158_2","unstructured":"Jiadong Lin Chuanbiao Song Kun He Liwei Wang and John E. Hopcroft. 2020. Nesterov accelerated gradient and scale invariance for adversarial attacks. In ICLR."},{"key":"e_1_3_4_159_2","unstructured":"Yen-Chen Lin Zhang-Wei Hong Yuan-Hong Liao Meng-Li Shih Ming-Yu Liu and Min Sun. 2017. Tactics of adversarial attack on deep reinforcement learning agents. arXiv:1703.06748."},{"key":"e_1_3_4_160_2","doi-asserted-by":"crossref","unstructured":"Zi Lin Zihan Wang Yongqi Tong Yangkun Wang Yuxin Guo Yujia Wang and Jingbo Shang. 2023. Toxicchat: Unveiling hidden challenges of toxicity detection in real-world user-ai conversation. arXiv:2310.17389.","DOI":"10.18653\/v1\/2023.findings-emnlp.311"},{"key":"e_1_3_4_161_2","volume-title":"ECCV","year":"2020","unstructured":"Aishan Liu, Jiakai Wang, Xianglong Liu, Bowen Cao, Chongzhi Zhang, and Hang Yu. 2020. Bias-based universal adversarial patch attack for automatic check-out. In ECCV."},{"key":"e_1_3_4_162_2","unstructured":"Daizong Liu Mingyu Yang Xiaoye Qu Pan Zhou Wei Hu and Yu Cheng. 2024. A survey of attacks on large vision-language models: Resources advances and future trends. arXiv:2407.07403."},{"key":"e_1_3_4_163_2","volume-title":"SaTML","year":"2023","unstructured":"Fangcheng Liu, Chao Zhang, and Hongyang Zhang. 2023. Towards transferable unrestricted adversarial examples with minimum changes. In SaTML."},{"key":"e_1_3_4_164_2","unstructured":"X. Liu Y. Zhu J. Gu Y. Lan C. Yang and Y. Qiao. 2023. Mm-safetybench: A benchmark for safety evaluation of multimodal large language models. arXiv:2311.17600. Retrieved from https:\/\/arxiv.org\/abs\/arXiv:2311.17600"},{"key":"e_1_3_4_165_2","unstructured":"Yanpei Liu Xinyun Chen Chang Liu and Dawn Song. 2016. Delving into transferable adversarial examples and black-box attacks. arXiv:1611.02770."},{"key":"e_1_3_4_166_2","doi-asserted-by":"crossref","unstructured":"Ye Liu Yaya Cheng Lianli Gao Xianglong Liu Qilong Zhang and Jingkuan Song. 2022. Practical evaluation of adversarial robustness via adaptive auto attack. In CVPR.","DOI":"10.1109\/CVPR52688.2022.01468"},{"key":"e_1_3_4_167_2","doi-asserted-by":"crossref","unstructured":"Yi Liu Gelei Deng Zhengzi Xu Yuekang Li Yaowen Zheng Ying Zhang Lida Zhao Tianwei Zhang Kailong Wang and Yang Liu. 2023. Jailbreaking chatgpt via prompt engineering: An empirical study. arXiv:2305.13860.","DOI":"10.1145\/3663530.3665021"},{"key":"e_1_3_4_168_2","volume-title":"ICCV","year":"2021","unstructured":"Ze Liu, Yutong Lin, Yue Cao, Han Hu, Yixuan Wei, Zheng Zhang, Stephen Lin, and Baining Guo. 2021. Swin transformer: Hierarchical vision transformer using shifted windows. In ICCV."},{"key":"e_1_3_4_169_2","volume-title":"CVPR","year":"2019","unstructured":"Zihao Liu, Qi Liu, Tao Liu, Nuo Xu, Xue Lin, Yanzhi Wang, and Wujie Wen. 2019. Feature distillation: Dnn-oriented jpeg compression against adversarial examples. In CVPR."},{"key":"e_1_3_4_170_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.425"},{"key":"e_1_3_4_171_2","volume-title":"ECCV","year":"2022","unstructured":"Yuyang Long, Qilong Zhang, Boheng Zeng, Lianli Gao, Xianglong Liu, Jian Zhang, and Jingkuan Song. 2022. Frequency domain model augmentation for adversarial attack. In ECCV."},{"key":"e_1_3_4_172_2","unstructured":"Dong Lu Tianyu Pang Chao Du Qian Liu Xianjun Yang and Min Lin. 2024. Test-time backdoor attacks on multimodal large language models. arXiv:2402.08577."},{"key":"e_1_3_4_173_2","unstructured":"Haochen Luo Jindong Gu Fengyuan Liu and Philip Torr. 2024. An image is worth 1000 lies: Adversarial transferability across prompts on vision-language models. arXiv:2403.09766."},{"key":"e_1_3_4_174_2","unstructured":"Weidi Luo Siyuan Ma Xiaogeng Liu Xiaoyu Guo and Chaowei Xiao. 2024. Jailbreakv-28k: A benchmark for assessing the robustness of multimodal large language models against jailbreak attacks. arXiv:2404.03027."},{"key":"e_1_3_4_175_2","unstructured":"Siyuan Ma Weidi Luo Yu Wang Xiaogeng Liu Muhao Chen Bo Li and Chaowei Xiao. 2024. Visual-roleplay: Universal jailbreak attack on multimodal large language models via role-playing image character. arXiv:2405.20773."},{"key":"e_1_3_4_176_2","unstructured":"Aleksander Madry. 2017. Towards deep learning models resistant to adversarial attacks. arXiv:1706.06083."},{"key":"e_1_3_4_177_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v35i10.17075"},{"key":"e_1_3_4_178_2","volume-title":"CVPR","year":"2019","unstructured":"Kenneth Marino, Mohammad Rastegari, Ali Farhadi, and Roozbeh Mottaghi. 2019. Ok-vqa: A visual question answering benchmark requiring external knowledge. In CVPR."},{"key":"e_1_3_4_179_2","unstructured":"Mantas Mazeika Long Phan Xuwang Yin Andy Zou Zifan Wang Norman Mu Elham Sakhaee Nathaniel Li Steven Basart Bo Li et\u00a0al. 2024. Harmbench: A standardized evaluation framework for automated red teaming and robust refusal. arXiv:2402.04249."},{"key":"e_1_3_4_180_2","volume-title":"NIPS Competition Track","year":"2023","unstructured":"Zou A. Mu N. Phan L. Wang Z. Yu C. Khoja A. Jiang F. O\u2019Gara A. Sakhaee E. Xiang Z. Rajabi A. Hendrycks D. Poovendran R. Li B. Mazeika, M. and D. Forsyth. 2023. Tdc 2023 (llm edition): The trojan detection challenge. In NIPS Competition Track."},{"key":"e_1_3_4_181_2","doi-asserted-by":"crossref","unstructured":"Andreas Mogelmose Mohan Manubhai Trivedi and Thomas B. Moeslund. 2012. Vision-based traffic sign detection and analysis for intelligent driver assistance systems: Perspectives and survey. TITS 13 4 (2012) 1484\u20131497.","DOI":"10.1109\/TITS.2012.2209421"},{"key":"e_1_3_4_182_2","volume-title":"CVPR","year":"2016","unstructured":"Seyed-Mohsen Moosavi-Dezfooli, Alhussein Fawzi, and Pascal Frossard. 2016. Deepfool: A simple and accurate method to fool deep neural networks. In CVPR."},{"key":"e_1_3_4_183_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.17"},{"key":"e_1_3_4_184_2","doi-asserted-by":"crossref","unstructured":"Nina Narodytska and Shiva Prasad Kasiviswanathan. 2016. Simple black-box adversarial perturbations for deep networks. arXiv:1612.06299.","DOI":"10.1109\/CVPRW.2017.172"},{"key":"e_1_3_4_185_2","volume-title":"CVPR","year":"2020","unstructured":"Muzammal Naseer, Salman Khan, Munawar Hayat, Fahad Shahbaz Khan, and Fatih Porikli. 2020. A self-supervised approach for adversarial robustness. In CVPR."},{"key":"e_1_3_4_186_2","unstructured":"Milad Nasr Nicholas Carlini Jonathan Hayase Matthew Jagielski A. Feder Cooper Daphne Ippolito Christopher A. Choquette-Choo Eric Wallace Florian Tram\u00e8r and Katherine Lee. 2023. Scalable extraction of training data from (production) language models. arXiv:2311.17035."},{"key":"e_1_3_4_187_2","volume-title":"NIPS Workshop","year":"2011","unstructured":"Yuval Netzer, Tao Wang, Adam Coates, Alessandro Bissacco, Baolin Wu, Andrew Y. Ng, et\u00a0al. 2011. Reading digits in natural images with unsupervised feature learning. In NIPS Workshop."},{"key":"e_1_3_4_188_2","volume-title":"CVPR","year":"2015","unstructured":"Anh Nguyen, Jason Yosinski, and Jeff Clune. 2015. Deep neural networks are easily fooled: High confidence predictions for unrecognizable images. In CVPR."},{"key":"e_1_3_4_189_2","unstructured":"Weili Nie Brandon Guo Yujia Huang Chaowei Xiao Arash Vahdat and Anima Anandkumar. 2022. Diffusion models for adversarial purification. arXiv:2205.07460."},{"key":"e_1_3_4_190_2","unstructured":"NIPS. 2017. Competition track. Retrieved from https:\/\/nips.cc\/Conferences\/2017\/CompetitionTrack"},{"key":"e_1_3_4_191_2","unstructured":"NIPS 2017 Adversarial Attack and Defense Competition. 2017. ImageNet-Compatible. https:\/\/www.kaggle.com\/datasets\/google-brain\/nips-2017-adversarial-learning-development-set\/data"},{"key":"e_1_3_4_192_2","unstructured":"Zhenxing Niu Haodong Ren Xinbo Gao Gang Hua and Rong Jin. 2024. Jailbreaking attack against multimodal large language model. arXiv:2402.02309. Retrieved from https:\/\/arxiv.org\/abs\/arXiv:2402.02309"},{"key":"e_1_3_4_193_2","unstructured":"OpenAI. 2022. Moderation API. Retrieved from https:\/\/platform.openai.com\/docs\/guides\/moderation\/overview"},{"key":"e_1_3_4_194_2","unstructured":"OpenAI. 2023. GPT-4o API. Retrieved from https:\/\/platform.openai.com\/docs\/models\/gpt-4o"},{"key":"e_1_3_4_195_2","unstructured":"OpenAI. 2023. Using GPT-4 for content moderation. Retrieved from https:\/\/openai.com\/index\/using-gpt-4-for-content-moderation\/"},{"key":"e_1_3_4_196_2","unstructured":"OpenAI. 2024. OpenAI usage policies. Retrieved from https:\/\/openai.com\/policies\/usage-policies"},{"key":"e_1_3_4_197_2","unstructured":"Long Ouyang Jeffrey Wu Xu Jiang Diogo Almeida Carroll Wainwright Pamela Mishkin Chong Zhang Sandhini Agarwal Katarina Slama Alex Ray et\u00a0al. 2022. Training language models to follow instructions with human feedback. In NIPS."},{"key":"e_1_3_4_198_2","unstructured":"Nicolas Papernot Patrick McDaniel Arunesh Sinha and Michael Wellman. 2016. Towards the science of security and privacy in machine learning. arXiv:1611.03814."},{"key":"e_1_3_4_199_2","unstructured":"Nicolas Papernot Patrick McDaniel and Ian Goodfellow. 2016. Transferability in machine learning: From phenomena to black-box attacks using adversarial samples. arXiv:1605.07277."},{"key":"e_1_3_4_200_2","volume-title":"ACM ASIACCS","year":"2017","unstructured":"Nicolas Papernot, Patrick McDaniel, Ian Goodfellow, Somesh Jha, Z. Berkay Celik, and Ananthram Swami. 2017. Practical black-box attacks against machine learning. In ACM ASIACCS."},{"key":"e_1_3_4_201_2","volume-title":"EuroS&P","year":"2016","unstructured":"Nicolas Papernot, Patrick McDaniel, Somesh Jha, Matt Fredrikson, Z. Berkay Celik, and Ananthram Swami. 2016. The limitations of deep learning in adversarial settings. In EuroS&P."},{"key":"e_1_3_4_202_2","volume-title":"ACL","year":"2002","unstructured":"Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. Bleu: A method for automatic evaluation of machine translation. In ACL."},{"key":"e_1_3_4_203_2","doi-asserted-by":"publisher","DOI":"10.1109\/EuroSPW.2019.00037"},{"key":"e_1_3_4_204_2","doi-asserted-by":"publisher","DOI":"10.1145\/3132747.3132785"},{"key":"e_1_3_4_205_2","article-title":"Modality-specific cross-modal similarity measurement with recurrent attention network","author":"Peng Yuxin","year":"2018","unstructured":"Yuxin Peng, Jinwei Qi, and Yuxin Yuan. 2018. Modality-specific cross-modal similarity measurement with recurrent attention network. TIP 27, 11(2018), 5585\u20135599.","journal-title":"TIP"},{"key":"e_1_3_4_206_2","unstructured":"F\u00e1bio Perez and Ian Ribeiro. 2022. Ignore previous prompt: Attack techniques for language models. arXiv:2211.09527."},{"key":"e_1_3_4_207_2","unstructured":"Mansi Phute Alec Helbling Matthew Hull ShengYun Peng Sebastian Szyller Cory Cornelius and Duen Horng Chau. 2023. Llm self defense: By self examination llms know they are being tricked. arXiv:2308.07308."},{"key":"e_1_3_4_208_2","volume-title":"NIPS","year":"2021","unstructured":"Maura Pintor, Fabio Roli, Wieland Brendel, and Battista Biggio. 2021. Fast minimum-norm adversarial attacks through adaptive norm constraints. In NIPS."},{"key":"e_1_3_4_209_2","volume-title":"ICCV","year":"2015","unstructured":"Bryan A. Plummer, Liwei Wang, Chris M. Cervantes, Juan C. Caicedo, Julia Hockenmaier, and Svetlana Lazebnik. 2015. Flickr30k entities: Collecting region-to-phrase correspondences for richer image-to-sentence models. In ICCV."},{"key":"e_1_3_4_210_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00465"},{"key":"e_1_3_4_211_2","unstructured":"Xiangyu Qi Yi Zeng Tinghao Xie Pin-Yu Chen Ruoxi Jia Prateek Mittal and Peter Henderson. 2023. Fine-tuning aligned language models compromises safety even when users do not intend to!arXiv:2310.03693."},{"key":"e_1_3_4_212_2","volume-title":"AAAI","year":"2024","unstructured":"Xiangyu Qi, Kaixuan Huang, Ashwinee Panda, Peter Henderson, Mengdi Wang, and Prateek Mittal. 2024. Visual adversarial examples jailbreak aligned large language models. In AAAI."},{"key":"e_1_3_4_213_2","volume-title":"NIPS","year":"2022","unstructured":"Zeyu Qin, Yanbo Fan, Yi Liu, Li Shen, Yong Zhang, Jue Wang, and Baoyuan Wu. 2022. Boosting the transferability of adversarial attacks with reverse adversarial perturbation. In NIPS."},{"key":"e_1_3_4_214_2","unstructured":"Maan Qraitem Nazia Tasnim Kate Saenko and Bryan A. Plummer. 2024. Vision-llms can fool themselves with self-generated typographic attacks. arXiv:2402.00626."},{"key":"e_1_3_4_215_2","volume-title":"ICML","year":"2021","unstructured":"Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et\u00a0al. 2021. Learning transferable visual models from natural language supervision. In ICML."},{"key":"e_1_3_4_216_2","volume-title":"NAACL-HLT Workshop","year":"2010","unstructured":"Cyrus Rashtchian, Peter Young, Micah Hodosh, and Julia Hockenmaier. 2010. Collecting image annotations using amazon\u2019s mechanical turk. In NAACL-HLT Workshop."},{"key":"e_1_3_4_217_2","volume-title":"ACM MM","year":"2010","unstructured":"Nikhil Rasiwasia, Jose Costa Pereira, Emanuele Coviello, Gabriel Doyle, Gert R. G. Lanckriet, Roger Levy, and Nuno Vasconcelos. 2010. A new approach to cross-modal multimedia retrieval. In ACM MM."},{"key":"e_1_3_4_218_2","volume-title":"CVPR","year":"2022","unstructured":"Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Bj\u00f6rn Ommer. 2022. High-resolution image synthesis with latent diffusion models. In CVPR."},{"key":"e_1_3_4_219_2","doi-asserted-by":"crossref","unstructured":"Jo Bo Rosen. 1960. The gradient projection method for nonlinear programming. Part I. Linear constraints. Journal of the Society for Industrial and Applied Mathematics 8 1 (1960) 181\u2013217.","DOI":"10.1137\/0108011"},{"key":"e_1_3_4_220_2","doi-asserted-by":"crossref","unstructured":"Paul R\u00f6ttger Hannah Rose Kirk Bertie Vidgen Giuseppe Attanasio Federico Bianchi and Dirk Hovy. 2023. Xstest: A test suite for identifying exaggerated safety behaviours in large language models. arXiv:2308.01263.","DOI":"10.18653\/v1\/2024.naacl-long.301"},{"key":"e_1_3_4_221_2","doi-asserted-by":"crossref","unstructured":"Leonid I. Rudin Stanley Osher and Emad Fatemi. 1992. Nonlinear total variation based noise removal algorithms. Physica D: Nonlinear Phenomena 60 1\u20134 (1992) 259\u2013268.","DOI":"10.1016\/0167-2789(92)90242-F"},{"key":"e_1_3_4_222_2","doi-asserted-by":"crossref","unstructured":"Olga Russakovsky Jia Deng Hao Su Jonathan Krause Sanjeev Satheesh Sean Ma Zhiheng Huang Andrej Karpathy Aditya Khosla Michael Bernstein et\u00a0al. 2015. Imagenet large scale visual recognition challenge. IJCV 115 (2015) 211\u2013252.","DOI":"10.1007\/s11263-015-0816-y"},{"key":"e_1_3_4_223_2","volume-title":"NIPS","year":"2019","unstructured":"Hadi Salman, Jerry Li, Ilya Razenshteyn, Pengchuan Zhang, Huan Zhang, Sebastien Bubeck, and Greg Yang. 2019. Provably robust deep learning via adversarially trained smoothed classifiers. In NIPS."},{"key":"e_1_3_4_224_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCVW60793.2023.00395"},{"key":"e_1_3_4_225_2","volume-title":"CVPR","year":"2017","unstructured":"Ramprasaath R Selvaraju, Michael Cogswell, Abhishek Das, Ramakrishna Vedantam, Devi Parikh, and Dhruv Batra. 2017. Grad-cam: Visual explanations from deep networks via gradient-based localization. In CVPR."},{"key":"e_1_3_4_226_2","unstructured":"SessionGloomy. 2023. New jailbreak! Proudly unveiling the tried and tested DAN 5.0. https:\/\/www.reddit.com\/r\/ChatGPT\/comments\/10tevu1\/new_jailbreak_proudly_unveiling_the_tried_and\/"},{"key":"e_1_3_4_227_2","unstructured":"Ali Shafahi W. Ronny Huang Mahyar Najibi Octavian Suciu Christoph Studer Tudor Dumitras and Tom Goldstein. 2018. Poison frogs! targeted clean-label poisoning attacks on neural networks. In NIPS."},{"key":"e_1_3_4_228_2","unstructured":"Adi Shamir Odelia Melamed and Oriel BenShmuel. 2021. The dimpled manifold model of adversarial examples in machine learning. arXiv:2106.10151."},{"key":"e_1_3_4_229_2","article-title":"Semantically adversarial learnable filters","author":"Shamsabadi Ali Shahin","year":"2021","unstructured":"Ali Shahin Shamsabadi, Changjae Oh, and Andrea Cavallaro. 2021. Semantically adversarial learnable filters. TIP 30 (2021), 8075\u20138087.","journal-title":"TIP"},{"key":"e_1_3_4_230_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00123"},{"key":"e_1_3_4_231_2","unstructured":"Shawn Shan Jenna Cryan Emily Wenger Haitao Zheng Rana Hanocka and Ben Y. Zhao. 2023. Glaze: Protecting artists from style mimicry by Text-to-Image models. In USENIX Security."},{"key":"e_1_3_4_232_2","unstructured":"Wenqi Shao Yutao Hu Peng Gao Meng Lei Kaipeng Zhang Fanqing Meng Peng Xu Siyuan Huang Hongsheng Li Yu Qiao et\u00a0al. 2023. Tiny lvlm-ehub: Early multimodal experiments with bard. arXiv:2308.03729."},{"key":"e_1_3_4_233_2","doi-asserted-by":"crossref","unstructured":"Mahmood Sharif Sruti Bhagavatula Lujo Bauer and Michael K Reiter. 2016. Accessorize to a crime: Real and stealthy attacks on state-of-the-art face recognition. In CCS.","DOI":"10.1145\/2976749.2978392"},{"key":"e_1_3_4_234_2","doi-asserted-by":"crossref","unstructured":"Mahmood Sharif Sruti Bhagavatula Lujo Bauer and Michael K. Reiter. 2019. A general framework for adversarial examples with objectives. TOPS 22 3 (2019) 1\u201330.","DOI":"10.1145\/3317611"},{"key":"e_1_3_4_235_2","doi-asserted-by":"crossref","unstructured":"Yash Sharma Gavin Weiguang Ding and Marcus Brubaker. 2019. On the effectiveness of low frequency perturbations. arXiv:1903.00073.","DOI":"10.24963\/ijcai.2019\/470"},{"key":"e_1_3_4_236_2","unstructured":"Yash Sharma Tien-Dung Le and Moustafa Alzantot. 2018. Caad 2018: Generating transferable adversarial examples. arXiv:1810.01268."},{"key":"e_1_3_4_237_2","unstructured":"Erfan Shayegani Yue Dong and Nael Abu-Ghazaleh. 2023. Jailbreak in pieces: Compositional adversarial attacks on multi-modal language models. In ICLR."},{"key":"e_1_3_4_238_2","doi-asserted-by":"crossref","unstructured":"Xinyue Shen Zeyuan Chen Michael Backes Yun Shen and Yang Zhang. 2024. \u201cDo anything now\u201d: Characterizing and evaluating in-the-wild jailbreak prompts on large language models. In CCS.","DOI":"10.1145\/3658644.3670388"},{"key":"e_1_3_4_239_2","doi-asserted-by":"publisher","DOI":"10.1109\/SP.2017.41"},{"key":"e_1_3_4_240_2","unstructured":"Sid. 2023. ChatGPT gives you free Windows 10 Pro keys! Retrieved from https:\/\/x.com\/immasiddtweets\/status\/1669721470006857729"},{"key":"e_1_3_4_241_2","unstructured":"Karen Simonyan. 2013. Deep inside convolutional networks: Visualising image classification models and saliency maps. arXiv:1312.6034."},{"key":"e_1_3_4_242_2","unstructured":"Karen Simonyan and Andrew Zisserman. 2014. Very deep convolutional networks for large-scale image recognition. arXiv:1409.1556."},{"key":"e_1_3_4_243_2","unstructured":"Dawn Song Kevin Eykholt Ivan Evtimov Earlence Fernandes Bo Li Amir Rahmati Florian Tramer Atul Prakash and Tadayoshi Kohno. 2018. Physical adversarial examples for object detectors. In WOOT."},{"key":"e_1_3_4_244_2","doi-asserted-by":"crossref","unstructured":"Johannes Stallkamp Marc Schlipsing Jan Salmen and Christian Igel. 2012. Man vs. computer: Benchmarking machine learning algorithms for traffic sign recognition. Neural Networks 32 (2012) 323\u2013332","DOI":"10.1016\/j.neunet.2012.02.016"},{"key":"e_1_3_4_245_2","article-title":"One pixel attack for fooling deep neural networks","author":"Su Jiawei","year":"2019","unstructured":"Jiawei Su, Danilo Vasconcellos Vargas, and Kouichi Sakurai. 2019. One pixel attack for fooling deep neural networks. TEC 23, 5 (2019), 828\u2013841.","journal-title":"TEC"},{"key":"e_1_3_4_246_2","unstructured":"Hao Sun Zhexin Zhang Jiawen Deng Jiale Cheng and Minlie Huang. 2023. Safety assessment of chinese large language models. arXiv:2304.10436."},{"key":"e_1_3_4_247_2","unstructured":"Christian Szegedy Wojciech Zaremba Ilya Sutskever Joan Bruna Dumitru Erhan Ian Goodfellow and Rob Fergus. 2014. Intriguing properties of neural networks. In ICLR."},{"key":"e_1_3_4_248_2","unstructured":"Pedro Tabacof Julia Tavares and Eduardo Valle. 2016. Adversarial images for variational autoencoders. arXiv:1612.00155."},{"key":"e_1_3_4_249_2","doi-asserted-by":"publisher","DOI":"10.1109\/IJCNN.2016.7727230"},{"key":"e_1_3_4_250_2","unstructured":"Zhen Tan Chengshuai Zhao Raha Moraffah Yifan Li Yu Kong Tianlong Chen and Huan Liu. 2024. The Wolf Within: Covert Injection of Malice into MLLM Societies via an MLLM Operative. arXiv:2402.14859."},{"key":"e_1_3_4_251_2","unstructured":"Thomas Tanay and Lewis Griffin. 2016. A boundary tilting persepective on the phenomenon of adversarial examples. arXiv:1608.07690."},{"key":"e_1_3_4_252_2","doi-asserted-by":"crossref","unstructured":"Simen Thys Wiebe Van Ranst and Toon Goedem\u00e9. 2019. Fooling automated surveillance cameras: Adversarial patches to attack person detection. In CVPRW.","DOI":"10.1109\/CVPRW.2019.00012"},{"key":"e_1_3_4_253_2","unstructured":"Florian Tram\u00e8r Alexey Kurakin Nicolas Papernot Ian Goodfellow Dan Boneh and Patrick McDaniel. 2017. Ensemble adversarial training: Attacks and defenses. arXiv:1705.07204."},{"key":"e_1_3_4_254_2","unstructured":"Florian Tram\u00e8r Nicolas Papernot Ian Goodfellow Dan Boneh and Patrick McDaniel. 2017. The space of transferable adversarial examples. arXiv:1704.03453."},{"key":"e_1_3_4_255_2","unstructured":"Florian Tram\u00e8r Fan Zhang Ari Juels Michael K. Reiter and Thomas Ristenpart. 2016. Stealing machine learning models via prediction APIs. In USENIX Security."},{"key":"e_1_3_4_256_2","doi-asserted-by":"crossref","unstructured":"Kuo-Chun Tseng Wei-Chieh Lai Wei-Chun Huang Yao-Chung Chang and Sherali Zeadally. 2024. AI threats: Adversarial examples with a quantum-inspired algorithm. IEEE Consumer Electronics Magazine.","DOI":"10.1109\/MCE.2024.3424513"},{"key":"e_1_3_4_257_2","unstructured":"Haoqin Tu Chenhang Cui Zijun Wang Yiyang Zhou Bingchen Zhao Junlin Han Wangchunshu Zhou Huaxiu Yao and Cihang Xie. 2023. How many unicorns are in this image? a safety evaluation benchmark for vision llms. arXiv:2311.16101."},{"key":"e_1_3_4_258_2","unstructured":"UnitaryAI. 2020. Detoxify. Retrieved from https:\/\/github.com\/unitaryai\/detoxify"},{"key":"e_1_3_4_259_2","doi-asserted-by":"crossref","unstructured":"Jon Vadillo Roberto Santana and Jose A. Lozano. 2025. Adversarial attacks in explainable machine learning: A survey of threats against models and humans. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery 15 1 (2025) e1567.","DOI":"10.1002\/widm.1567"},{"key":"e_1_3_4_260_2","doi-asserted-by":"crossref","unstructured":"Ramakrishna Vedantam C. Lawrence Zitnick and Devi Parikh. 2015. Cider: Consensus-based image description evaluation. In CVPR.","DOI":"10.1109\/CVPR.2015.7299087"},{"key":"e_1_3_4_261_2","doi-asserted-by":"crossref","unstructured":"Yu Wang Xiaogeng Liu Yu Li Muhao Chen and Chaowei Xiao. 2024. Adashield: Safeguarding multimodal large language models from structurebased attack via adaptive shield prompting. In ECCV.","DOI":"10.1007\/978-3-031-72661-3_5"},{"key":"e_1_3_4_262_2","unstructured":"Walkerspider. 2023. DAN is my new friend. Retrieved from https:\/\/old.reddit.com\/r\/ChatGPT\/comments\/zlcyr9\/dan_is_my_new_friend\/"},{"key":"e_1_3_4_263_2","doi-asserted-by":"crossref","unstructured":"Haodi Wang Kai Dong Zhilei Zhu Haotong Qin Aishan Liu Xiaolin Fang Jiakai Wang and Xianglong Liu. 2024. Transferable multimodal attack on vision-language pre-training models. In S&P.","DOI":"10.1109\/SP54263.2024.00102"},{"key":"e_1_3_4_264_2","doi-asserted-by":"crossref","unstructured":"Haohan Wang Xindi Wu Zeyi Huang and Eric P. Xing. 2020. High-frequency component helps explain the generalization of convolutional neural networks. In CVPR.","DOI":"10.1109\/CVPR42600.2020.00871"},{"key":"e_1_3_4_265_2","doi-asserted-by":"crossref","unstructured":"Ruofan Wang Xingjun Ma Hanxu Zhou Chuanjun Ji Guangnan Ye and Yu-Gang Jiang. 2024. White-box multimodal jailbreaks against large vision-language models. arXiv:2405.17894.","DOI":"10.1145\/3664647.3681092"},{"key":"e_1_3_4_266_2","doi-asserted-by":"crossref","unstructured":"Siyuan Wang Zhuohan Long Zhihao Fan and Zhongyu Wei. 2024. From LLMs to MLLMs: Exploring the landscape of multimodal jailbreaking. arXiv:2406.14859.","DOI":"10.18653\/v1\/2024.emnlp-main.973"},{"key":"e_1_3_4_267_2","unstructured":"Xunguang Wang Zhenlan Ji Pingchuan Ma Zongjie Li and Shuai Wang. 2023. InstructTA: Instruction-Tuned Targeted Attack for Large Vision-Language Models. arXiv:2312.01886."},{"key":"e_1_3_4_268_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR46437.2021.00196"},{"key":"e_1_3_4_269_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.01585"},{"key":"e_1_3_4_270_2","doi-asserted-by":"crossref","unstructured":"Yajie Wang Shangbo Wu Wenyi Jiang Shengang Hao Yu-an Tan and Quanxin Zhang. 2021. Demiguise attack: Crafting invisible semantic adversarial perturbations with perceptual similarity. arXiv:2107.01396.","DOI":"10.24963\/ijcai.2021\/430"},{"key":"e_1_3_4_271_2","unstructured":"Zefeng Wang Zhen Han Shuo Chen Fan Xue Zifeng Ding Xun Xiao Volker Tresp Philip Torr and Jindong Gu. 2024. Stop reasoning! when multimodal llms with chain-of-thought reasoning meets adversarial images. arXiv:2402.14899."},{"key":"e_1_3_4_272_2","doi-asserted-by":"crossref","unstructured":"Zhou Wang Alan C. Bovik Hamid R. Sheikh and Eero P. Simoncelli. 2004. Image quality assessment: From error visibility to structural similarity. TIP 13 4 (2004) 600\u2013612.","DOI":"10.1109\/TIP.2003.819861"},{"key":"e_1_3_4_273_2","doi-asserted-by":"crossref","unstructured":"Zhibo Wang Hengchang Guo Zhifei Zhang Wenxin Liu Zhan Qin and Kui Ren. 2021. Feature importance-aware transferable adversarial attacks. In ICCV.","DOI":"10.1109\/ICCV48922.2021.00754"},{"key":"e_1_3_4_274_2","unstructured":"Zifan Wang Yilin Yang Ankit Shrivastava Varun Rawal and Zihao Ding. 2020. Towards frequency-based explanation for robust cnn. arXiv:2005.03141."},{"key":"e_1_3_4_275_2","volume-title":"NIPS","author":"Wei Alexander","year":"2024","unstructured":"Alexander Wei, Nika Haghtalab, and Jacob Steinhardt. 2024. Jailbroken: How does llm safety training fail?. In NIPS."},{"key":"e_1_3_4_276_2","doi-asserted-by":"crossref","unstructured":"Hui Wei Hao Tang Xuemei Jia Zhixiang Wang Hanxun Yu Zhubo Li Shin\u2019ichi Satoh Luc Van Gool and Zheng Wang. 2024. Physical adversarial attack meets computer vision: A decade survey. TPAMI.","DOI":"10.1109\/TPAMI.2024.3430860"},{"key":"e_1_3_4_277_2","unstructured":"Jason Wei Xuezhi Wang Dale Schuurmans Maarten Bosma Fei Xia Ed Chi Quoc V. Le Denny Zhou et\u00a0al. 2022. Chain-of-thought prompting elicits reasoning in large language models. In NIPS."},{"key":"e_1_3_4_278_2","unstructured":"Shaokui Wei Mingda Zhang Hongyuan Zha and Baoyuan Wu. 2023. Shared adversarial unlearning: Backdoor mitigation by unlearning shared adversarial examples. In NIPS."},{"key":"e_1_3_4_279_2","doi-asserted-by":"crossref","unstructured":"Johannes Welbl Amelia Glaese Jonathan Uesato Sumanth Dathathri John Mellor Lisa Anne Hendricks Kirsty Anderson Pushmeet Kohli Ben Coppin and Po-Sen Huang. 2021. Challenges in detoxifying language models. arXiv:2109.07445.","DOI":"10.18653\/v1\/2021.findings-emnlp.210"},{"key":"e_1_3_4_280_2","volume-title":"NIPS","author":"Weng Cheng-Hsin","year":"2020","unstructured":"Cheng-Hsin Weng, Yan-Ting Lee, and Shan-Hung Brandon Wu. 2020. On the trade-off between adversarial and backdoor robustness. In NIPS."},{"key":"e_1_3_4_281_2","unstructured":"Chen Henry Wu Jing Yu Koh Ruslan Salakhutdinov Daniel Fried and Aditi Raghunathan. 2024. Adversarial Attacks on Multimodal Agents. arXiv:2406.12814."},{"key":"e_1_3_4_282_2","volume-title":"ICML","author":"Wu Kaiwen","year":"2020","unstructured":"Kaiwen Wu, Allen Wang, and Yaoliang Yu. 2020. Stronger and faster wasserstein adversarial attacks. In ICML."},{"key":"e_1_3_4_283_2","unstructured":"Lei Wu Zhanxing Zhu et\u00a0al. 2017. Towards understanding generalization of deep learning: Perspective of loss landscapes. arXiv:1706.10239."},{"key":"e_1_3_4_284_2","doi-asserted-by":"crossref","unstructured":"Chaowei Xiao Bo Li Jun-Yan Zhu Warren He Mingyan Liu and Dawn Song. 2018. Generating adversarial examples with adversarial networks. arXiv:1801.02610.","DOI":"10.24963\/ijcai.2018\/543"},{"key":"e_1_3_4_285_2","unstructured":"Cihang Xie JianyuWang Zhishuai Zhang Zhou Ren and Alan Yuille. 2017. Mitigating adversarial effects through randomization. arXiv:1711.01991."},{"key":"e_1_3_4_286_2","unstructured":"Cihang Xie Jianyu Wang Zhishuai Zhang Yuyin Zhou Lingxi Xie and Alan Yuille. 2017. Adversarial examples for semantic segmentation and object detection. In ICCV."},{"key":"e_1_3_4_287_2","unstructured":"Cihang Xie Yuxin Wu Laurens van der Maaten Alan L. Yuille and Kaiming He. 2019. Feature denoising for improving adversarial robustness. In CVPR."},{"key":"e_1_3_4_288_2","unstructured":"Cihang Xie Zhishuai Zhang Yuyin Zhou Song Bai Jianyu Wang Zhou Ren and Alan L. Yuille. 2019. Improving transferability of adversarial examples with input diversity. In CVPR."},{"key":"e_1_3_4_289_2","doi-asserted-by":"crossref","unstructured":"Yifeng Xiong Jiadong Lin Min Zhang John E. Hopcroft and Kun He. 2022. Stochastic variance reduced ensemble adversarial attack for boosting the adversarial transferability. In CVPR.","DOI":"10.1109\/CVPR52688.2022.01456"},{"key":"e_1_3_4_290_2","doi-asserted-by":"crossref","unstructured":"Nan Xu Fei Wang Ben Zhou Bang Zheng Li Chaowei Xiao and Muhao Chen. 2023. Cognitive overload: Jailbreaking large language models with overloaded logical thinking. arXiv:2311.09827.","DOI":"10.18653\/v1\/2024.findings-naacl.224"},{"key":"e_1_3_4_291_2","unstructured":"Peng Xu Wenqi Shao Kaipeng Zhang Peng Gao Shuo Liu Meng Lei Fanqing Meng Siyuan Huang Yu Qiao and Ping Luo. 2023. Lvlm-ehub: A comprehensive evaluation benchmark for large vision-language models. arXiv:2306.09265."},{"key":"e_1_3_4_292_2","doi-asserted-by":"crossref","unstructured":"W. Xu. 2017. Feature squeezing: Detecting adversarial exa mples in deep neural networks. arXiv:1704.01155.","DOI":"10.14722\/ndss.2018.23198"},{"key":"e_1_3_4_293_2","unstructured":"Chiu Wai Yan Tsz-Him Cheung and Dit-Yan Yeung. 2022. Ila-da: Improving transferability of intermediate level attack with data augmentation. In ICLR."},{"key":"e_1_3_4_294_2","doi-asserted-by":"crossref","unstructured":"Jinyu Yang Jiali Duan Son Tran Yi Xu Sampath Chanda Liqun Chen Belinda Zeng Trishul Chilimbi and Junzhou Huang. 2022. Vision-language pre-training with triple contrastive learning. In CVPR.","DOI":"10.1109\/CVPR52688.2022.01522"},{"key":"e_1_3_4_295_2","unstructured":"Yuanwei Wu Xiang Li Yixin Liu Pan Zhou and Lichao Sun. 2023. Jailbreaking gpt-4v via self-adversarial attacks with system prompts. arXiv:2311.09127."},{"key":"e_1_3_4_296_2","unstructured":"Dong Yin Raphael Gontijo Lopes Jon Shlens Ekin Dogus Cubuk and Justin Gilmer. 2019. A fourier perspective on model robustness in computer vision. In NIPS."},{"key":"e_1_3_4_297_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v39i9.33030"},{"key":"e_1_3_4_298_2","unstructured":"Minghao Yin Yongbing Zhang Xiu Li and Shiqi Wang. 2018. When deep fool meets deep prior: Adversarial attack on super-resolution network. In ACM MM."},{"key":"e_1_3_4_299_2","doi-asserted-by":"crossref","unstructured":"Zonghao Ying Aishan Liu Tianyuan Zhang Zhengmin Yu Siyuan Liang Xianglong Liu and Dacheng Tao. 2024. Jailbreak vision language models via Bi-modal adversarial prompt. arXiv:2406.04031.","DOI":"10.1109\/TIFS.2025.3583249"},{"key":"e_1_3_4_300_2","unstructured":"Zonghao Ying Aishan Liu Xianglong Liu and Dacheng Tao. 2024. Unveiling the Safety of GPT-4o: An Empirical Study using Jailbreak Attacks. arXiv:2406.06302."},{"key":"e_1_3_4_301_2","unstructured":"Fisher Yu Ari Seff Yinda Zhang Shuran Song Thomas Funkhouser and Jianxiong Xiao. 2015. Lsun: Construction of a large-scale image dataset using deep learning with humans in the loop. arXiv:1506.03365."},{"key":"e_1_3_4_302_2","unstructured":"Jiahao Yu Xingwei Lin and Xinyu Xing. 2023. Gptfuzzer: Red teaming large language models with auto-generated jailbreak prompts. arXiv:2309.10253."},{"key":"e_1_3_4_303_2","doi-asserted-by":"crossref","unstructured":"Tianyu Yu Yuan Yao Haoye Zhang Taiwen He Yifeng Han Ganqu Cui Jinyi Hu Zhiyuan Liu Hai-Tao Zheng Maosong Sun et\u00a0al. 2024. Rlhf-v: Towards trustworthy mllms via behavior alignment from fine-grained correctional human feedback. In CVPR.","DOI":"10.1109\/CVPR52733.2024.01310"},{"key":"e_1_3_4_304_2","doi-asserted-by":"crossref","unstructured":"Xiaoyong Yuan Pan He Qile Zhu and Xiaolin Li. 2019. Adversarial examples: Attacks and defenses for deep learning. TNNLS 30 9 (2019) 2805\u20132824.","DOI":"10.1109\/TNNLS.2018.2886017"},{"key":"e_1_3_4_305_2","doi-asserted-by":"crossref","unstructured":"Hao Zhang Wenqi Shao Hong Liu Yongqiang Ma Ping Luo Yu Qiao and Kaipeng Zhang. 2024. Avibench: Towards evaluating the robustness of large vision-language model on adversarial visual-instructions. arXiv:2403.09346.","DOI":"10.1109\/TIFS.2024.3520306"},{"key":"e_1_3_4_306_2","doi-asserted-by":"crossref","unstructured":"Sergey Zagoruyko. 2016. Wide residual networks. arXiv:1605.07146.","DOI":"10.5244\/C.30.87"},{"key":"e_1_3_4_307_2","doi-asserted-by":"crossref","unstructured":"Hanwei Zhang Yannis Avrithis Teddy Furon and Laurent Amsaleg. 2020. Walking on the edge: Fast low-distortion adversarial examples. TIFS 16 (2020) 701\u2013713.","DOI":"10.1109\/TIFS.2020.3021899"},{"key":"e_1_3_4_308_2","doi-asserted-by":"crossref","unstructured":"Jiaming Zhang Xingjun Ma XinWang Lingyu Qiu JiaqiWang Yu-Gang Jiang and Jitao Sang. 2023. Adversarial prompt tuning for vision-language models. arXiv:2311.11261.","DOI":"10.1007\/978-3-031-72995-9_4"},{"key":"e_1_3_4_309_2","volume-title":"CVPR","year":"2022","unstructured":"Jianping Zhang, Weibin Wu, Jen-tse Huang, Yizhan Huang,Wen xuan Wang, Yuxin Su, and Michael R. Lyu. 2022. Improving adversarial transferability via neuron attribution-based attacks. In CVPR."},{"key":"e_1_3_4_310_2","volume-title":"CVPR","year":"2018","unstructured":"Richard Zhang, Phillip Isola, Alexei A. Efros, Eli Shechtman, and Oliver Wang. 2018. The unreasonable effectiveness of deep features as a perceptual metric. In CVPR."},{"key":"e_1_3_4_311_2","unstructured":"Xiaoyu Zhang Cen Zhang Tianlin Li Yihao Huang Xiaojun Jia Xiaofei Xie Yang Liu and Chao Shen. 2023. A mutation-based method for multi-modal jailbreaking attack detection. arXiv:2312.10766."},{"key":"e_1_3_4_312_2","doi-asserted-by":"crossref","unstructured":"Yongting Zhang Lu Chen Guodong Zheng Yifeng Gao Rui Zheng Jinlan Fu Zhenfei Yin Senjie Jin Yu Qiao Xuanjing Huang et\u00a0al. 2024. SPA-VL: A comprehensive safety preference alignment dataset for vision language model. arXiv:2406.12030.","DOI":"10.1109\/CVPR52734.2025.01850"},{"key":"e_1_3_4_313_2","doi-asserted-by":"crossref","unstructured":"Jieyu Zhao Tianlu Wang Mark Yatskar Vicente Ordonez and Kai-Wei Chang. 2017. Men also like shopping: Reducing gender bias amplification using corpus-level constraints. arXiv:1707.09457.","DOI":"10.18653\/v1\/D17-1323"},{"key":"e_1_3_4_314_2","unstructured":"Yunqing Zhao Tianyu Pang Chao Du Xiao Yang Chongxuan Li Ngai-Man Man Cheung and Min Lin. 2024. On evaluating adversarial robustness of large vision-language models. In NIPS."},{"key":"e_1_3_4_315_2","doi-asserted-by":"crossref","unstructured":"Zhengyu Zhao Zhuoran Liu and Martha Larson. 2020. Towards large yet imperceptible adversarial image perturbations with perceptual color distance. In CVPR.","DOI":"10.1109\/CVPR42600.2020.00112"},{"key":"e_1_3_4_316_2","doi-asserted-by":"crossref","unstructured":"Haonan Zheng Wen Jiang Xinyang Deng and Wenrui Li. 2024. Sample-agnostic adversarial perturbation for vision-language pre-training models. arXiv:2408.02980.","DOI":"10.1145\/3664647.3686835"},{"key":"e_1_3_4_317_2","article-title":"Robust physical-world attacks on face recognition","author":"Zheng Xin","year":"2023","unstructured":"Xin Zheng, Yanbo Fan, Baoyuan Wu, Yong Zhang, Jue Wang, and Shirui Pan. 2023. Robust physical-world attacks on face recognition. PR 133 (2023), 109009.","journal-title":"PR"},{"key":"e_1_3_4_318_2","doi-asserted-by":"crossref","unstructured":"Wen Zhou Xin Hou Yongjun Chen Mengyun Tang Xiangqi Huang Xiang Gan and Yong Yang. 2018. Transferable adversarial perturbations. In ECCV.","DOI":"10.1007\/978-3-030-01264-9_28"},{"key":"e_1_3_4_319_2","volume-title":"Challenges in Automated Debiasing for Toxic Language Detection","author":"Zhou Xuhui","year":"2020","unstructured":"Xuhui Zhou. 2020. Challenges in Automated Debiasing for Toxic Language Detection. University of Washington."},{"key":"e_1_3_4_320_2","doi-asserted-by":"crossref","unstructured":"Ziqi Zhou Shengshan Hu Minghui Li Hangtao Zhang Yechao Zhang and Hai Jin. 2023. Advclip: Downstream-agnostic adversarial examples in multimodal contrastive learning. In ACM MM.","DOI":"10.1145\/3581783.3612454"},{"key":"e_1_3_4_321_2","doi-asserted-by":"crossref","unstructured":"Ziqi Zhou Shengshan Hu Ruizhi Zhao Qian Wang Leo Yu Zhang Junhui Hou and Hai Jin. 2023. Downstream-agnostic adversarial examples. In ICCV.","DOI":"10.1109\/ICCV51070.2023.00401"},{"key":"e_1_3_4_322_2","unstructured":"Yongshuo Zong Ondrej Bohdal Tingyang Yu Yongxin Yang and Timothy Hospedales. 2024. Safety fine-tuning at (almost) no cost: A baseline for vision large language models. arXiv:2402.02207."},{"key":"e_1_3_4_323_2","unstructured":"Andy Zou Zifan Wang Nicholas Carlini Milad Nasr J Zico Kolter and Matt Fredrikson. 2023. Universal and transferable adversarial attacks on aligned language models. arXiv:2307.15043."}],"container-title":["ACM Computing Surveys"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3743126","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,9,9]],"date-time":"2025-09-09T14:33:19Z","timestamp":1757428399000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3743126"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,9,9]]},"references-count":322,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2026,1,31]]}},"alternative-id":["10.1145\/3743126"],"URL":"https:\/\/doi.org\/10.1145\/3743126","relation":{},"ISSN":["0360-0300","1557-7341"],"issn-type":[{"value":"0360-0300","type":"print"},{"value":"1557-7341","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,9,9]]},"assertion":[{"value":"2024-11-10","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-05-28","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-09-09","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}