{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,8]],"date-time":"2026-04-08T16:56:13Z","timestamp":1775667373292,"version":"3.50.1"},"reference-count":154,"publisher":"Association for Computing Machinery (ACM)","issue":"8","license":[{"start":{"date-parts":[[2025,3,23]],"date-time":"2025-03-23T00:00:00Z","timestamp":1742688000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Comput. Surv."],"published-print":{"date-parts":[[2025,8,31]]},"abstract":"<jats:p>Deep neural networks (DNNs) deployed in real-world applications can encounter out-of-distribution (OOD) data and adversarial examples. These represent distinct forms of distributional shifts that can significantly impact DNNs\u2019 reliability and robustness. Traditionally, research has addressed OOD detection and adversarial robustness as separate challenges. This survey focuses on the intersection of these two areas, examining how the research community has investigated them together. Consequently, we identify two key research directions: robust OOD detection and unified robustness. Robust OOD detection aims to differentiate between in-distribution (ID) data and OOD data, even when they are adversarially manipulated to deceive the OOD detector. Unified robustness seeks a single approach to make DNNs robust against both adversarial attacks and OOD inputs. Accordingly, first, we establish a taxonomy based on the concept of distributional shifts. This framework clarifies how robust OOD detection and unified robustness relate to other research areas addressing distributional shifts, such as OOD detection, open set recognition, and anomaly detection. Subsequently, we review existing work on robust OOD detection and unified robustness. Finally, we highlight the limitations of the existing work and propose promising research directions that explore adversarial and OOD inputs within a unified framework.<\/jats:p>","DOI":"10.1145\/3719292","type":"journal-article","created":{"date-parts":[[2025,2,22]],"date-time":"2025-02-22T10:16:31Z","timestamp":1740219391000},"page":"1-40","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":17,"title":["Out-of-Distribution Data: An Acquaintance of Adversarial Examples - A Survey"],"prefix":"10.1145","volume":"57","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7081-2958","authenticated-orcid":false,"given":"Naveen","family":"Karunanayake","sequence":"first","affiliation":[{"name":"School of Computer Science, The University of Sydney, Sydney, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1288-7935","authenticated-orcid":false,"given":"Ravin","family":"Gunawardena","sequence":"additional","affiliation":[{"name":"Computer Science and Engineering, University of New South Wales, Sydney, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5485-5595","authenticated-orcid":false,"given":"Suranga","family":"Seneviratne","sequence":"additional","affiliation":[{"name":"School of Computer Science, The University of Sydney, Sydney, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8102-2572","authenticated-orcid":false,"given":"Sanjay","family":"Chawla","sequence":"additional","affiliation":[{"name":"Qatar Computing Research Institute, Doha, Qatar and Hamad Bin Khalifa University, Doha, Qatar"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2025,3,23]]},"reference":[{"key":"e_1_3_3_2_2","unstructured":"[n. d.]. Blueprint for an AI Bill of Rights | The White House. Retrieved from https:\/\/bidenwhitehouse.archives.gov\/ostp\/ai-bill-of-rights\/. Last accessed: 2025-03-03."},{"key":"e_1_3_3_3_2","unstructured":"[n. d.]. Home \u2014 artificialintelligenceact.eu. Retrieved February 19 2025 from https:\/\/artificialintelligenceact.eu\/"},{"key":"e_1_3_3_4_2","unstructured":"Nilesh A. Ahuja Ibrahima Ndiour Trushant Kalyanpur and Omesh Tickoo. 2019. Probabilistic modeling of deep features for out-of-distribution and adversarial detection. arXiv:1909.11786. Retrieved from https:\/\/arxiv.org\/abs\/1909.11786"},{"key":"e_1_3_3_5_2","doi-asserted-by":"crossref","unstructured":"Ahmed Aldahdooh Wassim Hamidouche Sid Ahmed Fezza and Olivier D\u00e9forges. 2022. Adversarial example detection for DNN models: A review and experimental comparison. Artificial Intelligence Review 55 6 (2022) 4403\u20134462.","DOI":"10.1007\/s10462-021-10125-w"},{"key":"e_1_3_3_6_2","doi-asserted-by":"crossref","unstructured":"Kshitiz Aryal Maanak Gupta Mahmoud Abdelsalam Pradip Kunwar and Bhavani Thuraisingham. 2024. A survey on adversarial attacks for malware analysis. IEEE Access (2024).","DOI":"10.1109\/ACCESS.2024.3519524"},{"key":"e_1_3_3_7_2","first-page":"228","volume-title":"Proceedings of the European Conference on Computer Vision","author":"Augustin Maximilian","year":"2020","unstructured":"Maximilian Augustin, Alexander Meinke, and Matthias Hein. 2020. Adversarial robustness on in-and out-distribution improves explainability. In Proceedings of the European Conference on Computer Vision. Springer, 228\u2013245."},{"key":"e_1_3_3_8_2","first-page":"4887","article-title":"Your out-of-distribution detection method is not robust!","author":"Azizmalayeri Mohammad","year":"2022","unstructured":"Mohammad Azizmalayeri, Arshia Soltani Moakhar, Arman Zarei, Reihaneh Zohrabi, Mohammad Taghi Manzuri, and Mohammad Hossein Rohban2022. Your out-of-distribution detection method is not robust! Proceedings of the 36th International Conference on Neural Information Processing Systems. 4887\u20134901.","journal-title":"Proceedings of the 36th International Conference on Neural Information Processing Systems"},{"key":"e_1_3_3_9_2","first-page":"1","volume-title":"Proceedings of the 2023 28th International Computer Conference, Computer Society of Iran (CSICC)","author":"Azizmalayeri Mohammad","year":"2023","unstructured":"Mohammad Azizmalayeri, Arman Zarei, Alireza Isavand, Mohammad Taghi Manzuri, and Mohammad Hossein Rohban. 2023. A data-centric approach for improving adversarial training through the lens of out-of-distribution detection. In Proceedings of the 2023 28th International Computer Conference, Computer Society of Iran (CSICC). IEEE, 1\u20136."},{"key":"e_1_3_3_10_2","doi-asserted-by":"crossref","first-page":"151","DOI":"10.1007\/s10994-009-5152-4","article-title":"A theory of learning from different domains","volume":"79","author":"Vaughan Shai Ben-David, John Blitzer, Koby Crammer, Alex Kulesza, Fernando Pereira, and Jennifer Wortman","year":"2010","unstructured":"Shai Ben-David, John Blitzer, Koby Crammer, Alex Kulesza, Fernando Pereira, and Jennifer Wortman Vaughan. 2010. A theory of learning from different domains. Machine Learning 79, 1\u20132 (2010), 151\u2013175.","journal-title":"Machine Learning"},{"key":"e_1_3_3_11_2","article-title":"Make sure you\u2019re unsure: A framework for verifying probabilistic specifications","author":"Berrada Leonard","year":"2021","unstructured":"Leonard Berrada, Sumanth Dathathri, Krishnamurthy Dvijotham, Robert Stanforth, Rudy Bunel, Jonathan Uesato, Sven Gowal, and M. Pawan Kumar2021. Make sure you\u2019re unsure: A framework for verifying probabilistic specifications. In Proceedings of the International Conference on Neural Information Processing Systems.","journal-title":"Proceedings of the International Conference on Neural Information Processing Systems"},{"key":"e_1_3_3_12_2","doi-asserted-by":"crossref","first-page":"833","DOI":"10.1145\/2382196.2382284","volume-title":"Proceedings of the 2012 ACM Conference on Computer and Communications Security (CCS\u201912)","author":"Bilge Leyla","year":"2012","unstructured":"Leyla Bilge and Tudor Dumitra\u015f. 2012. Before we knew it: An empirical study of zero-day attacks in the real world. In Proceedings of the 2012 ACM Conference on Computer and Communications Security (CCS\u201912). 833\u2013844."},{"key":"e_1_3_3_13_2","first-page":"16085","article-title":"Certifiably adversarially robust detection of out-of-distribution data","author":"Bitterwolf Julian","year":"2020","unstructured":"Julian Bitterwolf, Alexander Meinke, and Matthias Hein. 2020. Certifiably adversarially robust detection of out-of-distribution data. In Proceedings of the 34th International Conference on Neural Information Processing Systems. 16085\u201316095.","journal-title":"Proceedings of the 34th International Conference on Neural Information Processing Systems"},{"key":"e_1_3_3_14_2","unstructured":"Tom Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared D. Kaplan Prafulla Dhariwal Arvind Neelakantan Pranav Shyam Girish Sastry Amanda Askell and others. 2020. Language models are few-shot learners. Advances in Neural Information Processing Systems 33 (2020) 1877\u20131901."},{"key":"e_1_3_3_15_2","first-page":"1","volume-title":"Proceedings of the 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP\u201923)","author":"Bukhsh Zaharah","year":"2023","unstructured":"Zaharah Bukhsh and Aaqib Saeed. 2023. On out-of-distribution detection for audio with deep nearest neighbors. In Proceedings of the 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP\u201923). IEEE, 1\u20135."},{"key":"e_1_3_3_16_2","article-title":"Notmnist dataset","volume":"2","author":"Bulatov Yaroslav","year":"2011","unstructured":"Yaroslav Bulatov. 2011. Notmnist dataset. Google (Books\/OCR), Technical Report [Online]. 2 (2011).","journal-title":"Google (Books\/OCR), Technical Report [Online]."},{"key":"e_1_3_3_17_2","unstructured":"Nicholas Carlini et\u00a0al. 2019. On evaluating adversarial robustness. arXiv:1902.06705. Retrieved from https:\/\/arxiv.org\/abs\/1902.06705"},{"key":"e_1_3_3_18_2","doi-asserted-by":"publisher","DOI":"10.1145\/3128572.3140444"},{"key":"e_1_3_3_19_2","doi-asserted-by":"publisher","DOI":"10.1109\/SP.2017.49"},{"issue":"3","key":"e_1_3_3_20_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/1541880.1541882","article-title":"Anomaly detection: A survey","volume":"41","author":"Kumar Varun Chandola, Arindam Banerjee, and Vipin","year":"2009","unstructured":"Varun Chandola, Arindam Banerjee, and Vipin Kumar2009. Anomaly detection: A survey. ACM Computing Surveys (CSUR) 41, 3 (2009), 1\u201358.","journal-title":"ACM Computing Surveys (CSUR)"},{"key":"e_1_3_3_21_2","article-title":"Vicinal risk minimization","author":"Chapelle Olivier","year":"2000","unstructured":"Olivier Chapelle, Jason Weston, L\u00e9on Bottou, and Vladimir Vapnik2000. Vicinal risk minimization. Proceedings of the 14th International Conference on Neural Information Processing Systems.","journal-title":"Proceedings of the 14th International Conference on Neural Information Processing Systems"},{"key":"e_1_3_3_22_2","unstructured":"Jiefeng Chen Yixuan Li Xi Wu Yingyu Liang and Somesh Jha. 2022. Robust out-of-distribution detection for neural networks. In The AAAI-22 Workshop on Adversarial Machine Learning and Beyond."},{"key":"e_1_3_3_23_2","first-page":"430","volume-title":"Proceedings of the European Conference on Machine Learning and Knowledge Discovery in Databases, ECML PKDD 2021","author":"Chen Jiefeng","year":"2021","unstructured":"Jiefeng Chen, Yixuan Li, Xi Wu, Yingyu Liang, and Somesh Jha. 2021. Atom: Robustifying out-of-distribution detection using outlier mining. In Proceedings of the European Conference on Machine Learning and Knowledge Discovery in Databases, ECML PKDD 2021. Springer, 430\u2013445."},{"key":"e_1_3_3_24_2","volume-title":"Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing","author":"Chen Kejiang","year":"2020","unstructured":"Kejiang Chen, Yuefeng Chen, Hang Zhou, Xiaofeng Mao, Yuhong Li, Yuan He, Hui Xue, Weiming Zhang, and Nenghai Yu. 2020. Self-supervised adversarial training. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing."},{"key":"e_1_3_3_25_2","doi-asserted-by":"publisher","DOI":"10.1145\/3128572.3140448"},{"key":"e_1_3_3_26_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.461"},{"key":"e_1_3_3_27_2","first-page":"1310","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Cohen Jeremy","year":"2019","unstructured":"Jeremy Cohen, Elan Rosenfeld, and Zico Kolter. 2019. Certified adversarial robustness via randomized smoothing. In Proceedings of the International Conference on Machine Learning. PMLR, 1310\u20131320."},{"key":"e_1_3_3_28_2","doi-asserted-by":"crossref","unstructured":"Joana C. Costa Tiago Roxo Hugo Proen\u00e7a and Pedro Ricardo Morais In\u00e1cio. 2024. How deep learning sees the world: A survey on adversarial attacks & defenses. IEEE Access 12 (2024) 61113\u201361136.","DOI":"10.1109\/ACCESS.2024.3395118"},{"key":"e_1_3_3_29_2","first-page":"2206","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Croce Francesco","year":"2020","unstructured":"Francesco Croce and Matthias Hein. 2020. Reliable evaluation of adversarial robustness with an ensemble of diverse parameter-free attacks. In Proceedings of the International Conference on Machine Learning. PMLR, 2206\u20132216."},{"key":"e_1_3_3_30_2","doi-asserted-by":"publisher","DOI":"10.3390\/electronics11213500"},{"key":"e_1_3_3_31_2","doi-asserted-by":"publisher","unstructured":"Thilini Dahanayaka Yasod Ginige Yi Huang Guillaume Jourjon and Suranga Seneviratne. 2023. Robust open-set classification for encrypted traffic fingerprinting. Computer Networks 236 C (2023). DOI:10.1016\/j.comnet.2023.109991","DOI":"10.1016\/j.comnet.2023.109991"},{"key":"e_1_3_3_32_2","doi-asserted-by":"publisher","DOI":"10.1145\/1143844.1143874"},{"key":"e_1_3_3_33_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"e_1_3_3_34_2","doi-asserted-by":"publisher","DOI":"10.1109\/MSP.2012.2211477"},{"key":"e_1_3_3_35_2","unstructured":"Jacob Devlin Ming-Wei Chang Kenton Lee and Kristina Toutanova. 2019. Bert: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies volume 1 (long and short papers) 4171\u20134186."},{"key":"e_1_3_3_36_2","unstructured":"Terrance DeVries. 2017. Improved regularization of convolutional neural networks with cutout. arXiv:1708.04552. Retrieved from https:\/\/arxiv.org\/abs\/1708.04552"},{"key":"e_1_3_3_37_2","first-page":"137","volume-title":"Proceedings of the Joint European Conference on Machine Learning and Knowledge Discovery in Databases","author":"Yaghoobi Nikolaos Dionelis, Sotirios A. Tsaftaris, and Mehrdad","year":"2022","unstructured":"Nikolaos Dionelis, Sotirios A. Tsaftaris, and Mehrdad Yaghoobi. 2022. FROB: Few-Shot ROBust model for joint classification and out-of-distribution detection. In Proceedings of the Joint European Conference on Machine Learning and Knowledge Discovery in Databases. Springer, 137\u2013153."},{"key":"e_1_3_3_38_2","unstructured":"Hao Dong Yue Zhao Eleni Chatzi and Olga Fink. 2024. MultiOOD: Scaling out-of-distribution detection for multiple modalities. In The Thirty-eighth Annual Conference on Neural Information Processing Systems."},{"key":"e_1_3_3_39_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00957"},{"key":"e_1_3_3_40_2","unstructured":"Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai Thomas Unterthiner Mostafa Dehghani Matthias Minderer Georg Heigold Sylvain Gelly Jakob Uszkoreit and Neil Houlsby. 2021. An Image is Worth \\(16\\times 16\\) Words: transformers for image recognition at scale. In International Conference on Learning Representations."},{"key":"e_1_3_3_41_2","doi-asserted-by":"publisher","unstructured":"Mohammad Esmaeilpour Patrick Cardinal and Alessandro Lameiras Koerich. 2020. A robust approach for securing audio classification against adversarial attacks. IEEE Transactions on Information Forensics and Security 15 (2020) 2147\u20132159. DOI:10.1109\/TIFS.2019.2956591","DOI":"10.1109\/TIFS.2019.2956591"},{"key":"e_1_3_3_42_2","unstructured":"Stanislav Fort. 2022. Adversarial vulnerability of powerful near out-of-distribution detection. arXiv:2201.07012. Retrieved from https:\/\/arxiv.org\/abs\/2201.07012"},{"key":"e_1_3_3_43_2","doi-asserted-by":"publisher","DOI":"10.1145\/3447548.3467145"},{"key":"e_1_3_3_44_2","doi-asserted-by":"crossref","first-page":"2414","DOI":"10.1109\/CVPR.2016.265","volume-title":"Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201916)","author":"Gatys Leon A.","year":"2016","unstructured":"Leon A. Gatys, Alexander S. Ecker, and Matthias Bethge. 2016. Image style transfer using convolutional neural networks. In Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201916). 2414\u20132423."},{"key":"e_1_3_3_45_2","unstructured":"Navid Ghassemi and Ehsan Fazl-Ersi. 2022. A comprehensive review of trends applications and challenges in out-of-distribution detection. arXiv:2209.12935. Retrieved from https:\/\/arxiv.org\/abs\/2209.12935"},{"key":"e_1_3_3_46_2","doi-asserted-by":"crossref","unstructured":"Tejas Gokhale Swaroop Mishra Man Luo Bhavdeep Singh Sachdeva and Chitta Baral. 2022. Generalized but not Robust? Comparing the effects of data modification methods on out-of-domain generalization and adversarial robustness. CoRR abs\/2203.07653 (2022).","DOI":"10.18653\/v1\/2022.findings-acl.213"},{"key":"e_1_3_3_47_2","unstructured":"Ian J. Goodfellow Jonathon Shlens and Christian Szegedy. 2015. Explaining and harnessing adversarial examples. In ICLR (Poster)."},{"key":"e_1_3_3_48_2","first-page":"34","volume-title":"Proceedings of the IEEE\/CVF Winter Conference on Applications of Computer Vision","author":"Gorbett Matt","year":"2022","unstructured":"Matt Gorbett and Nathaniel Blanchard. 2022. Utilizing network features to detect erroneous inputs. In Proceedings of the IEEE\/CVF Winter Conference on Applications of Computer Vision. 34\u201343."},{"key":"e_1_3_3_49_2","unstructured":"Sven Gowal Krishnamurthy Dvijotham Robert Stanforth Rudy Bunel Chongli Qin Jonathan Uesato Relja Arandjelovic Timothy Mann and Pushmeet Kohli. 2018. On the effectiveness of interval bound propagation for training verifiably robust models. arXiv:1810.12715. Retrieved from https:\/\/arxiv.org\/abs\/1810.12715"},{"key":"e_1_3_3_50_2","doi-asserted-by":"crossref","unstructured":"Shreya Goyal Sumanth Doddapaneni Mitesh M. Khapra and Balaraman Ravindran. 2023. A survey of adversarial defenses and robustness in nlp. ACM Computing Surveys 55 14s (2023) 1\u201339.","DOI":"10.1145\/3593042"},{"key":"e_1_3_3_51_2","volume-title":"Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV\u201915)","author":"He K.","year":"2015","unstructured":"K. He, X. Zhang, S. Ren, and J. Sun. 2015. Delving deep into rectifiers: Surpassing human-level performance on ImageNet classification. In Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV\u201915)."},{"key":"e_1_3_3_52_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90"},{"key":"e_1_3_3_53_2","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Hein Matthias","year":"2019","unstructured":"Matthias Hein , Maksym Andriushchenko, and Julian Bitterwolf. 2019. Why relu networks yield high-confidence predictions far away from the training data and how to mitigate the problem. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition."},{"key":"e_1_3_3_54_2","first-page":"8340","volume-title":"Proceedings of the IEEE\/CVF International Conference on Computer Vision","author":"Guo Dan Hendrycks, Steven Basart, Norman Mu, Saurav Kadavath, Frank Wang, Evan Dorundo, Rahul Desai, Tyler Zhu, Samyak Parajuli, Mike","year":"2021","unstructured":"Dan Hendrycks, Steven Basart, Norman Mu, Saurav Kadavath, Frank Wang, Evan Dorundo, Rahul Desai, Tyler Zhu, Samyak Parajuli, Mike Guo et\u00a0al. 2021. The many faces of robustness: A critical analysis of out-of-distribution generalization. In Proceedings of the IEEE\/CVF International Conference on Computer Vision. 8340\u20138349."},{"key":"e_1_3_3_55_2","unstructured":"Dan Hendrycks Nicholas Carlini John Schulman and Jacob Steinhardt. 2021. Unsolved problems in ML safety. arXiv:2109.13916. Retrieved from https:\/\/arxiv.org\/abs\/2109.13916"},{"key":"e_1_3_3_56_2","unstructured":"Dan Hendrycks and Thomas Dietterich. 2019. Benchmarking neural network robustness to common corruptions and perturbations. In International Conference on Learning Representations."},{"key":"e_1_3_3_57_2","unstructured":"Dan Hendrycks and Kevin Gimpel. 2017. A baseline for detecting misclassified and out-of-distribution examples in neural networks. In International Conference on Learning Representations."},{"key":"e_1_3_3_58_2","first-page":"2712","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Hendrycks Dan","year":"2019","unstructured":"Dan Hendrycks, Kimin Lee, and Mantas Mazeika. 2019. Using pre-training can improve model robustness and uncertainty. In Proceedings of the International Conference on Machine Learning. PMLR, 2712\u20132721."},{"key":"e_1_3_3_59_2","volume-title":"Proceedings of the International Conference on Learning Representations","author":"Hendrycks Dan","year":"2019","unstructured":"Dan Hendrycks, Mantas Mazeika, and Thomas Dietterich. 2019. Deep anomaly detection with outlier exposure. In Proceedings of the International Conference on Learning Representations. Retrieved from https:\/\/openreview.net\/forum?id=HyxCxhRcY7"},{"key":"e_1_3_3_60_2","article-title":"Using self-supervised learning can improve model robustness and uncertainty","author":"Hendrycks Dan","year":"2019","unstructured":"Dan Hendrycks, Mantas Mazeika, Saurav Kadavath, and Dawn Song. 2019. Using self-supervised learning can improve model robustness and uncertainty. In Proceedings of the 33rd International Conference on Neural Information Processing Systems.","journal-title":"Proceedings of the 33rd International Conference on Neural Information Processing Systems"},{"key":"e_1_3_3_61_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR46437.2021.01501"},{"key":"e_1_3_3_62_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.01628"},{"key":"e_1_3_3_63_2","doi-asserted-by":"publisher","unstructured":"Waleed Hilal S. Andrew Gadsden and John Yawney. 2022. Financial Fraud: A review of anomaly detection techniques and recent advances. Expert Systems With Applications 193 C (2022). DOI:10.1016\/j.eswa.2021.116429","DOI":"10.1016\/j.eswa.2021.116429"},{"key":"e_1_3_3_64_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.243"},{"key":"e_1_3_3_65_2","doi-asserted-by":"publisher","DOI":"10.1109\/34.291440"},{"key":"e_1_3_3_66_2","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence","author":"Kaur Ramneet","year":"2022","unstructured":"Ramneet Kaur, Susmit Jha, Anirban Roy, Sangdon Park, Edgar Dobriban, Oleg Sokolsky, and Insup Lee. 2022. iDECODe: In-distribution equivariance for conformal out-of-distribution detection. In Proceedings of the AAAI Conference on Artificial Intelligence."},{"key":"e_1_3_3_67_2","unstructured":"Yigitcan Kaya Muhammad Bilal Zafar Sergul Aydore Nathalie Rauschmayr and Krishnaram Kenthapadi. 2022. Generating distributional adversarial examples to evade statistical detectors. In Proceedings of the 39th International Conference on Machine Learning (Proceedings of Machine Learning Research) PMLR 10895\u201310911."},{"key":"e_1_3_3_68_2","first-page":"163","volume-title":"Proceedings of the 2022 IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW\u201922)","author":"Khalid Umar","year":"2022","unstructured":"Umar Khalid, Ashkan Esmaeili, Nazmul Karim, and Nazanin Rahnavard. 2022. Rodd: A self-supervised approach for robust out-of-distribution detection. In Proceedings of the 2022 IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW\u201922). IEEE, 163\u2013170."},{"key":"e_1_3_3_69_2","first-page":"2983","article-title":"Adversarial self-supervised contrastive learning","author":"Kim Minseon","year":"2020","unstructured":"Minseon Kim, Jihoon Tack, and Sung Ju Hwang. 2020. Adversarial self-supervised contrastive learning. Proceedings of the 34th International Conference on Neural Information Processing Systems. 2983\u20132994.","journal-title":"Proceedings of the 34th International Conference on Neural Information Processing Systems"},{"key":"e_1_3_3_70_2","unstructured":"Pang Wei Koh Shiori Sagawa Henrik Marklund Sang Michael Xie Marvin Zhang Akshay Balsubramani Weihua Hu Michihiro Yasunaga Richard Lanas Phillips Irena Gao and others. 2021. Wilds: A benchmark of in-the-wild distribution shifts. In International Conference on Machine Learning PMLR 5637\u20135664."},{"key":"e_1_3_3_71_2","doi-asserted-by":"crossref","unstructured":"Zelun Kong Junfeng Guo Ang Li and Cong Liu. 2020. Physgan: Generating physical-world-resilient adversarial examples for autonomous driving. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 14254\u201314263.","DOI":"10.1109\/CVPR42600.2020.01426"},{"key":"e_1_3_3_72_2","unstructured":"Alex Krizhevsky Vinod Nair and Geoffrey Hinton. 2009. CIFAR-10. (2009). Retrieved February 19 2025 from http:\/\/www.cs.toronto.edu\/kriz\/cifar.html"},{"key":"e_1_3_3_73_2","unstructured":"Alex Krizhevsky and others. 2009. Learning multiple layers of features from tiny images. (2009)."},{"key":"e_1_3_3_74_2","volume-title":"Proceedings of the 26th International Conference on Neural Information Processing Systems","author":"Krizhevsky Alex","year":"2012","unstructured":"Alex Krizhevsky, Ilya Sutskever, and Geoffrey E. Hinton. 2012. ImageNet classification with deep convolutional neural networks. In Proceedings of the 26th International Conference on Neural Information Processing Systems."},{"key":"e_1_3_3_75_2","article-title":"Imagenet classification with deep convolutional neural networks","author":"Krizhevsky Alex","year":"2012","unstructured":"Alex Krizhevsky, Ilya Sutskever, and Geoffrey E. Hinton. 2012. Imagenet classification with deep convolutional neural networks. In Proceedings of the 26th International Conference on Neural Information Processing Systems.","journal-title":"Proceedings of the 26th International Conference on Neural Information Processing Systems"},{"key":"e_1_3_3_76_2","doi-asserted-by":"publisher","DOI":"10.1201\/9781351251389-8"},{"key":"e_1_3_3_77_2","unstructured":"Hao Lang Yinhe Zheng Yixuan Li Jian SUN Fei Huang and Yongbin Li. 2024. A survey on out-of-distribution detection in NLP. Transactions on Machine Learning Research (2024)."},{"key":"e_1_3_3_78_2","unstructured":"Ya Le and Xuan S. Yang. 2015. Tiny ImageNet visual recognition challenge."},{"key":"e_1_3_3_79_2","unstructured":"Jinsol Lee Mohit Prabhushankar and Ghassan AlRegib. 2022. Gradient-based adversarial and out-of-distribution detection. arXiv:2206.08255. Retrieved from https:\/\/arxiv.org\/abs\/2206.08255"},{"key":"e_1_3_3_80_2","article-title":"A simple unified framework for detecting out-of-distribution samples and adversarial attacks","author":"Lee Kimin","year":"2018","unstructured":"Kimin Lee, Kibok Lee, Honglak Lee, and Jinwoo Shin. 2018. A simple unified framework for detecting out-of-distribution samples and adversarial attacks. In Proceedings of the 32nd International Conference on Neural Information Processing Systems.","journal-title":"Proceedings of the 32nd International Conference on Neural Information Processing Systems"},{"key":"e_1_3_3_81_2","doi-asserted-by":"publisher","DOI":"10.23919\/ICCAS50221.2020.9268406"},{"key":"e_1_3_3_82_2","unstructured":"Mark Lee and Zico Kolter. 2019. On physical adversarial patches for object detection. arXiv:1906.11897. Retrieved from https:\/\/arxiv.org\/abs\/1906.11897"},{"key":"e_1_3_3_83_2","doi-asserted-by":"crossref","unstructured":"Chao Li Handing Wang Wen Yao and Tingsong Jiang. 2024. Adversarial attacks in computer vision: A survey. Journal of Membrane Computing 6 2 (2024) 130\u2013147.","DOI":"10.1007\/s41965-024-00142-3"},{"key":"e_1_3_3_84_2","first-page":"231","volume-title":"Proceedings of the 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP\u201922)","author":"Li Juncheng B.","year":"2022","unstructured":"Juncheng B. Li, Shuhui Qu, Xinjian Li, Po-Yao Bernie Huang, and Florian Metze. 2022. On adversarial robustness of large-scale audio visual learning. In Proceedings of the 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP\u201922). IEEE, 231\u2013235."},{"key":"e_1_3_3_85_2","volume-title":"Proceedings of the 12th International Conference on Learning Representations","author":"Li Kuan","year":"2024","unstructured":"Kuan Li, YiWen Chen, Yang Liu, Jin Wang, Qing He, Minhao Cheng, and Xiang Ao. 2024. Boosting the adversarial robustness of graph neural networks: An OOD perspective. In Proceedings of the 12th International Conference on Learning Representations. Retrieved from https:\/\/openreview.net\/forum?id=DCDT918ZkI"},{"issue":"8","key":"e_1_3_3_86_2","doi-asserted-by":"crossref","first-page":"1283","DOI":"10.3390\/electronics11081283","article-title":"Adversarial attack and defense: A survey","volume":"11","author":"Liang Hongshuo","year":"2022","unstructured":"Hongshuo Liang, Erlu He, Yangyang Zhao, Zhe Jia, and Hao Li2022. Adversarial attack and defense: A survey. Electronics 11, 8 (2022), 1283.","journal-title":"Electronics"},{"key":"e_1_3_3_87_2","unstructured":"Shiyu Liang Yixuan Li and R. Srikant. 2018. Enhancing The reliability of out-of-distribution image detection in neural networks. In International Conference on Learning Representations."},{"key":"e_1_3_3_88_2","doi-asserted-by":"publisher","DOI":"10.5555\/3495724.3497526"},{"key":"e_1_3_3_89_2","first-page":"3730","volume-title":"Proceedings of the IEEE International Conference on Computer Vision","author":"Liu Ziwei","year":"2015","unstructured":"Ziwei Liu, Ping Luo, Xiaogang Wang, and Xiaoou Tang. 2015. Deep learning face attributes in the wild. In Proceedings of the IEEE International Conference on Computer Vision. 3730\u20133738."},{"key":"e_1_3_3_90_2","unstructured":"Fan Lu Kai Zhu Kecheng Zheng Wei Zhai and Yang Cao. 2023. Likelihood-aware semantic alignment for full-spectrum out-of-distribution detection. CoRR abs\/2312.01732 (2023)."},{"key":"e_1_3_3_91_2","volume-title":"Proceedings of the 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP\u201923)","author":"Lu Kangkang","year":"2023","unstructured":"Kangkang Lu, Manh Cuong Nguyen, Xun Xu, and Chuan Sheng Foo. 2023. On adversarial robustness of audio classifiers. In Proceedings of the 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP\u201923)."},{"key":"e_1_3_3_92_2","unstructured":"Xingjun Ma Bo Li Yisen Wang Sarah M. Erfani Sudanthi Wijewickrema Grant Schoenebeck Michael E. Houle Dawn Song and James Bailey. 2018. Characterizing adversarial subspaces using local intrinsic dimensionality. In International Conference on Learning Representations."},{"key":"e_1_3_3_93_2","unstructured":"Aleksander Madry Aleksandar Makelov Ludwig Schmidt Dimitris Tsipras and Adrian Vladu. 2018. Towards deep learning models resistant to adversarial attacks. In International Conference on Learning Representations."},{"key":"e_1_3_3_94_2","first-page":"37","volume-title":"Proceedings of the 2021 IEEE 4th International Conference on Artificial Intelligence and Knowledge Engineering (AIKE\u201921)","author":"Mahdavi A.","year":"2021","unstructured":"A. Mahdavi and M. Carvalho. 2021. A survey on open set recognition. In Proceedings of the 2021 IEEE 4th International Conference on Artificial Intelligence and Knowledge Engineering (AIKE\u201921). 37\u201344."},{"key":"e_1_3_3_95_2","article-title":"Predictive uncertainty estimation via prior networks","author":"Malinin Andrey","year":"2018","unstructured":"Andrey Malinin and Mark Gales. 2018. Predictive uncertainty estimation via prior networks. In Proceedings of the 32nd International Conference on Neural Information Processing Systems.","journal-title":"Proceedings of the 32nd International Conference on Neural Information Processing Systems"},{"key":"e_1_3_3_96_2","article-title":"Reverse KL-divergence training of prior networks: Improved uncertainty and adversarial robustness","author":"Malinin Andrey","year":"2019","unstructured":"Andrey Malinin and Mark Gales. 2019. Reverse KL-divergence training of prior networks: Improved uncertainty and adversarial robustness. In Proceedings of the 33rd International Conference on Neural Information Processing Systems.","journal-title":"Proceedings of the 33rd International Conference on Neural Information Processing Systems"},{"key":"e_1_3_3_97_2","unstructured":"Andrey Malinin and Mark Gales. 2019. Reverse kl-divergence training of prior networks: Improved uncertainty and adversarial robustness. Advances in Neural Information Processing Systems 32 (2019)."},{"key":"e_1_3_3_98_2","first-page":"30167","article-title":"Provably adversarially robust detection of out-of-distribution data (almost) for free","author":"Meinke Alexander","year":"2022","unstructured":"Alexander Meinke, Julian Bitterwolf, and Matthias Hein. 2022. Provably adversarially robust detection of out-of-distribution data (almost) for free. Proceedings of the 36th International Conference on Neural Information Processing Systems. 30167\u201330180.","journal-title":"Proceedings of the 36th International Conference on Neural Information Processing Systems"},{"key":"e_1_3_3_99_2","volume-title":"Proceedings of the International Conference on Learning Representations","author":"Meinke Alexander","year":"2019","unstructured":"Alexander Meinke and Matthias Hein. 2019. Towards neural networks that provably know when they don\u2019t know. In Proceedings of the International Conference on Learning Representations."},{"key":"e_1_3_3_100_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.282"},{"key":"e_1_3_3_101_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00034"},{"key":"e_1_3_3_102_2","volume-title":"Proceedings of the NIPS Workshop on Deep Learning and Unsupervised Feature Learning 2011","author":"Netzer Yuval","year":"2011","unstructured":"Yuval Netzer, Tao Wang, Adam Coates, Alessandro Bissacco, Baolin Wu, and Andrew Y. Ng. 2011. Reading digits in natural images with unsupervised feature learning. In Proceedings of the NIPS Workshop on Deep Learning and Unsupervised Feature Learning 2011."},{"key":"e_1_3_3_103_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298640"},{"key":"e_1_3_3_104_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v34i04.5973"},{"key":"e_1_3_3_105_2","doi-asserted-by":"publisher","DOI":"10.1109\/ITSC48978.2021.9564545"},{"key":"e_1_3_3_106_2","unstructured":"USA National Transport Safety Board. 2016. Collision between a car operating with automated vehicle control systems and a tractor-semitrailer truck near williston florida. Retrieved March 3 2025 from https:\/\/www.ntsb.gov\/investigations\/accidentreports\/reports\/har1702.pdf"},{"key":"e_1_3_3_107_2","volume-title":"Proceedings of the IEEE\/CVF International Conference on Computer Vision","author":"Ojaswee Ojaswee","year":"2023","unstructured":"Ojaswee Ojaswee, Akshay Agarwal, and Nalini Ratha. 2023. Benchmarking image classifiers for physical out-of-distribution examples detection. In Proceedings of the IEEE\/CVF International Conference on Computer Vision."},{"key":"e_1_3_3_108_2","unstructured":"OpenAI. 2023. ChatGPT: October 2023 Version. Retrieved February 19 2025 from https:\/\/chat.openai.com\/"},{"key":"e_1_3_3_109_2","first-page":"5551","volume-title":"Proceedings of the IEEE\/CVF Winter Conference on Applications of Computer Vision","author":"Nishide Genki Osada, Tsubasa Takahashi, Budrul Ahsan, and Takashi","year":"2023","unstructured":"Genki Osada, Tsubasa Takahashi, Budrul Ahsan, and Takashi Nishide. 2023. Out-of-distribution detection with reconstruction error and typicality-based penalty. In Proceedings of the IEEE\/CVF Winter Conference on Applications of Computer Vision. 5551\u20135563."},{"key":"e_1_3_3_110_2","doi-asserted-by":"publisher","DOI":"10.1109\/SP.2016.41"},{"key":"e_1_3_3_111_2","article-title":"Using mixup as a regularizer can surprisingly improve accuracy & out-of-distribution robustness","author":"Pinto Francesco","year":"2022","unstructured":"Francesco Pinto, Harry Yang, Ser Nam Lim, Philip Torr, Puneet Dokania2022. Using mixup as a regularizer can surprisingly improve accuracy & out-of-distribution robustness. In Proceedings of the International Conference on Neural Information Processing Systems.","journal-title":"Proceedings of the International Conference on Neural Information Processing Systems"},{"key":"e_1_3_3_112_2","first-page":"20052","article-title":"Fast minimum-norm adversarial attacks through adaptive norm constraints","author":"Pintor Maura","year":"2021","unstructured":"Maura Pintor, Fabio Roli, Wieland Brendel, and Battista Biggio. 2021. Fast minimum-norm adversarial attacks through adaptive norm constraints. In Proceedings of the 35th International Conference on Neural Information Processing Systems. 20052\u201320062.","journal-title":"Proceedings of the 35th International Conference on Neural Information Processing Systems"},{"key":"e_1_3_3_113_2","first-page":"8017","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence","volume":"36","author":"Qiu Xin","year":"2022","unstructured":"Xin Qiu and Risto Miikkulainen. 2022. Detecting misclassification errors in neural networks with a Gaussian process model. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 36. 8017\u20138027."},{"key":"e_1_3_3_114_2","volume-title":"Dataset Shift in Machine Learning","year":"2008","unstructured":"Quinonero-Candela et\u00a0al. 2008. Dataset Shift in Machine Learning. MIT Press."},{"key":"e_1_3_3_115_2","first-page":"5361","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Ratzlaff Neale","year":"2019","unstructured":"Neale Ratzlaff and Li Fuxin. 2019. HyperGAN: A generative model for diverse, performant neural networks. In Proceedings of the International Conference on Machine Learning. PMLR, 5361\u20135369."},{"key":"e_1_3_3_116_2","unstructured":"Jie Ren Stanislav Fort Jeremiah Liu Abhijit Guha Roy Shreyas Padhy and Balaji Lakshminarayanan. 2021. A simple fix to Mahalanobis distance for improving near-OOD detection. arXiv:2106.09022. Retrieved from https:\/\/arxiv.org\/abs\/2106.09022"},{"key":"e_1_3_3_117_2","unstructured":"Mohammadreza Salehi Hossein Mirzaei Dan Hendrycks Yixuan Li Mohammad Hossein Rohban and Mohammad Sabokrou. 2022. A unified survey on anomaly novelty open-set and out of-distribution detection: Solutions and future challenges. Transactions on Machine Learning Research (2022)."},{"key":"e_1_3_3_118_2","doi-asserted-by":"crossref","unstructured":"Jerome H. Saltzer and Michael D. Schroeder. 1975. The protection of information in computer systems. Proceedings of the IEEE 63 9 (1975) 1278\u20131308.","DOI":"10.1109\/PROC.1975.9939"},{"key":"e_1_3_3_119_2","article-title":"Quantification of uncertainty with adversarial models","author":"Schweighofer Kajetan","year":"2023","unstructured":"Kajetan Schweighofer, Lukas Aichberger, Mykyta Ielanskyi, G\u00fcnter Klambauer, and Sepp Hochreiter. 2023. Quantification of uncertainty with adversarial models. In Proceedings of the 37th International Conference on Neural Information Processing Systems.","journal-title":"Proceedings of the 37th International Conference on Neural Information Processing Systems"},{"key":"e_1_3_3_120_2","unstructured":"V. Sehwag A. N. Bhagoji L. Song C. Sitawarin D. Cullina M. Chiang and P. Mittal. 2019. Better the devil you know: An analysis of evasion attacks using out-of-distribution adversarial examples. arXiv:1905.01726. Retrieved from https:\/\/arxiv.org\/abs\/1905.01726"},{"key":"e_1_3_3_121_2","doi-asserted-by":"publisher","DOI":"10.1145\/3338501.3357372"},{"key":"e_1_3_3_122_2","first-page":"5620","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence","volume":"34","author":"Sensoy Murat","year":"2020","unstructured":"Murat Sensoy, Lance Kaplan, Federico Cerutti, and Maryam Saleki. 2020. Uncertainty-aware deep classifiers using generative models. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 34. 5620\u20135627."},{"key":"e_1_3_3_123_2","doi-asserted-by":"publisher","unstructured":"Zheyan Shen Jiashuo Liu Yue He Xingxuan Zhang Renzhe Xu Han Yu and Peng Cui. 2021. Towards out-of-distribution generalization: A Survey. arXiv:2108.13624. Retrieved from 10.48550\/ARXIV.2108.13624","DOI":"10.48550\/ARXIV.2108.13624"},{"key":"e_1_3_3_124_2","unstructured":"Samuel Henrique Silva and Peyman Najafirad. 2020. Opportunities and challenges in deep learning adversarial robustness: A survey. arXiv:2007.00753. Retrieved from https:\/\/arxiv.org\/abs\/2007.00753"},{"key":"e_1_3_3_125_2","unstructured":"K. Simonyan and A. Zisserman. 2015. Very deep convolutional networks for large-scale image recognition. In 3rd International Conference on Learning Representations (ICLR 2015)."},{"key":"e_1_3_3_126_2","volume-title":"Proceedings of the International Conference on Neural Information Processing Systems","author":"Sun Yiyou","year":"2021","unstructured":"Yiyou Sun, Chuan Guo, and Yixuan Li. 2021. ReAct: Out-of-distribution detection with rectified activations. In Proceedings of the International Conference on Neural Information Processing Systems."},{"key":"e_1_3_3_127_2","volume-title":"Proceedings of the European Conference on Computer Vision","author":"Sun Yiyou","year":"2022","unstructured":"Yiyou Sun and Yixuan Li. 2022. DICE: Leveraging sparsification for out-of-distribution detection. In Proceedings of the European Conference on Computer Vision."},{"key":"e_1_3_3_128_2","unstructured":"Christian Szegedy Wojciech Zaremba Ilya Sutskever Joan Bruna Dumitru Erhan Ian J. Goodfellow and Rob Fergus. 2014. Intriguing properties of neural networks. In 2nd International Conference on Learning Representations ICLR 2014 Banff AB Canada April 14-16 2014 Conference Track Proceedings Yoshua Bengio and Yann LeCun (Eds.)."},{"key":"e_1_3_3_129_2","doi-asserted-by":"crossref","unstructured":"Neeraj Varshney Swaroop Mishra and Chitta Baral. 2022. Investigating selective prediction approaches across several tasks in IID OOD and adversarial settings. In Findings of the Association for Computational Linguistics: ACL 2022. 1995\u20132002.","DOI":"10.18653\/v1\/2022.findings-acl.158"},{"key":"e_1_3_3_130_2","unstructured":"Jindong Wang Xixu HU Wenxin Hou Hao Chen Runkai Zheng Yidong Wang Linyi Yang Wei Ye Haojun Huang Xiubo Geng Binxing Jiao Yue Zhang and Xing Xie. 2023. On the robustness of ChatGPT: An adversarial and out-of-distribution perspective. In ICLR 2023 Workshop on Trustworthy and Reliable Large-Scale Machine Learning Models."},{"key":"e_1_3_3_131_2","article-title":"Improving out-of-distribution generalization by adversarial training with structured priors","author":"Wang Qixun","year":"2022","unstructured":"Qixun Wang, Yifei Wang, Hong Zhu, and Yisen Wang. 2022. Improving out-of-distribution generalization by adversarial training with structured priors. In Proceedings of the 36th International Conference on Neural Information Processing Systems.","journal-title":"Proceedings of the 36th International Conference on Neural Information Processing Systems"},{"key":"e_1_3_3_132_2","doi-asserted-by":"crossref","unstructured":"Tao Wang. 2020. High precision open-world website fingerprinting. In 2020 IEEE Symposium on Security and Privacy (SP) IEEE 152\u2013167.","DOI":"10.1109\/SP40000.2020.00015"},{"key":"e_1_3_3_133_2","unstructured":"Hongxin Wei Renchunzi Xie Hao Cheng Lei Feng Bo An and Yixuan Li. 2022. Mitigating neural network overconfidence with logit normalization. In International Conference on Machine Learning PMLR 23631\u201323644."},{"key":"e_1_3_3_134_2","unstructured":"Tong Wu Liang Tong and Yevgeniy Vorobeychik. 2020. Defending against physically realizable attacks on image classification. In International Conference on Learning Representations."},{"key":"e_1_3_3_135_2","unstructured":"Han Xiao Kashif Rasul and Roland Vollgraf. 2017. Fashion-MNIST: A novel image dataset for benchmarking machine learning algorithms. arXiv:1708.07747. Retrieved from https:\/\/arxiv.org\/abs\/1708.07747"},{"key":"e_1_3_3_136_2","unstructured":"Pingmei Xu Krista A. Ehinger Yinda Zhang Adam Finkelstein Sanjeev R. Kulkarni and Jianxiong Xiao. 2015. Turkergaze: Crowdsourcing saliency with webcam based eye tracking. arXiv:1504.06755. Retrieved from https:\/\/arxiv.org\/abs\/1504.06755"},{"key":"e_1_3_3_137_2","volume-title":"Proceedings of the 25th Asia and South Pacific Design Automation Conference","author":"Chen Zirui Xu, Fuxun Yu, and Xiang","year":"2020","unstructured":"Zirui Xu, Fuxun Yu, and Xiang Chen. 2020. LanCe: A comprehensive and lightweight CNN defense methodology against physical adversarial attacks on embedded multimedia applications. In Proceedings of the 25th Asia and South Pacific Design Automation Conference. IEEE."},{"key":"e_1_3_3_138_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.00819"},{"key":"e_1_3_3_139_2","doi-asserted-by":"crossref","unstructured":"Jingkang Yang Kaiyang Zhou Yixuan Li and Ziwei Liu. 2024. Generalized out-of-distribution detection: A survey. International Journal of Computer Vision 132 12 (2024) 5635\u20135662.","DOI":"10.1007\/s11263-024-02117-4"},{"key":"e_1_3_3_140_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-023-01811-z"},{"key":"e_1_3_3_141_2","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Yi Mingyang","year":"2021","unstructured":"Mingyang Yi, Lu Hou, Jiacheng Sun, Lifeng Shang, Xin Jiang, Qun Liu, and Zhiming Ma. 2021. Improved OOD generalization via adversarial training and pretraing. In Proceedings of the International Conference on Machine Learning. PMLR."},{"key":"e_1_3_3_142_2","first-page":"209","volume-title":"Proceedings of the European Conference on Computer Vision","author":"Yin Xuwang","year":"2022","unstructured":"Xuwang Yin, Shiying Li, and Gustavo K. Rohde. 2022. Learning energy-based models with adversarial training. In Proceedings of the European Conference on Computer Vision. Springer, 209\u2013226."},{"key":"e_1_3_3_143_2","unstructured":"Sangwoong Yoon Jinwon Choi Yonghyeon Lee Yung-Kyun Noh and Frank Chongwoo Park. 2022. Evaluating out-of-distribution detectors through adversarial generation of outliers. arXiv:2208.10940. Retrieved from https:\/\/arxiv.org\/abs\/2208.10940"},{"key":"e_1_3_3_144_2","unstructured":"Fisher Yu Ari Seff Yinda Zhang Shuran Song Thomas Funkhouser and Jianxiong Xiao. 2015. LSUN: Construction of a large-scale image dataset using deep learning with humans in the loop. arXiv:1506.03365. Retrieved from https:\/\/arxiv.org\/abs\/1506.03365"},{"key":"e_1_3_3_145_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00961"},{"key":"e_1_3_3_146_2","first-page":"25721","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Yu Yaodong","year":"2022","unstructured":"Yaodong Yu, Zitong Yang, Alexander Wei, Yi Ma, and Jacob Steinhardt. 2022. Predicting out-of-distribution error with the projection norm. In Proceedings of the International Conference on Machine Learning. PMLR, 25721\u201325746."},{"key":"e_1_3_3_147_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00612"},{"key":"e_1_3_3_148_2","doi-asserted-by":"crossref","unstructured":"Sergey Zagoruyko and Nikos Komodakis. 2016. Wide residual networks. In British Machine Vision Conference 2016 British Machine Vision Association.","DOI":"10.5244\/C.30.87"},{"key":"e_1_3_3_149_2","first-page":"5631","volume-title":"Proceedings of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies","author":"Xu Zhiyuan Zeng, Keqing He, Yuanmeng Yan, Hong Xu, and Weiran","year":"2021","unstructured":"Zhiyuan Zeng, Keqing He, Yuanmeng Yan, Hong Xu, and Weiran Xu. 2021. Adversarial self-supervised learning for out-of-domain detection. In Proceedings of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 5631\u20135639."},{"key":"e_1_3_3_150_2","unstructured":"Hongyi Zhang Moustapha Cisse Yann N. Dauphin and David Lopez-Paz. 2018. mixup: Beyond empirical risk minimization. In International Conference on Learning Representations."},{"key":"e_1_3_3_151_2","first-page":"5531","volume-title":"Proceedings of the IEEE\/CVF Winter Conference on Applications of Computer Vision","author":"Li Jingyang Zhang, Nathan Inkawhich, Randolph Linderman, Yiran Chen, and Hai","year":"2023","unstructured":"Jingyang Zhang, Nathan Inkawhich, Randolph Linderman, Yiran Chen, and Hai Li. 2023. Mixture outlier exposure: Towards out-of-distribution detection in fine-grained environments. In Proceedings of the IEEE\/CVF Winter Conference on Applications of Computer Vision. 5531\u20135540."},{"key":"e_1_3_3_152_2","unstructured":"Jingyang Zhang Jingkang Yang Pengyun Wang Haoqi Wang Yueqian Lin Haoran Zhang Yiyou Sun Xuefeng Du Yixuan Li Ziwei Liu Yiran Chen and Hai Li. 2024. OpenOOD v1.5: Enhanced benchmark for out-of-distribution detection. Journal of Data-centric Machine Learning Research (2024)."},{"issue":"6","key":"e_1_3_3_153_2","doi-asserted-by":"crossref","first-page":"1452","DOI":"10.1109\/TPAMI.2017.2723009","article-title":"Places: A 10 million image database for scene recognition","volume":"40","author":"Zhou Bolei","year":"2017","unstructured":"Bolei Zhou, Agata Lapedriza, Aditya Khosla, Aude Oliva, and Antonio Torralba. 2017. Places: A 10 million image database for scene recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence 40, 6 (2017), 1452\u20131464.","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"e_1_3_3_154_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2022.3195549"},{"key":"e_1_3_3_155_2","article-title":"On the adversarial robustness of out-of-distribution generalization models","author":"Zou Xin","year":"2024","unstructured":"Xin Zou and Weiwei Liu. 2024. On the adversarial robustness of out-of-distribution generalization models. In Proceedings of the 37th International Conference on Neural Information Processing Systems.","journal-title":"Proceedings of the 37th International Conference on Neural Information Processing Systems"}],"container-title":["ACM Computing Surveys"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3719292","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3719292","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T18:43:21Z","timestamp":1750272201000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3719292"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,3,23]]},"references-count":154,"journal-issue":{"issue":"8","published-print":{"date-parts":[[2025,8,31]]}},"alternative-id":["10.1145\/3719292"],"URL":"https:\/\/doi.org\/10.1145\/3719292","relation":{},"ISSN":["0360-0300","1557-7341"],"issn-type":[{"value":"0360-0300","type":"print"},{"value":"1557-7341","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,3,23]]},"assertion":[{"value":"2024-04-08","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-02-19","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-03-23","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}