{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,13]],"date-time":"2026-05-13T09:18:21Z","timestamp":1778663901482,"version":"3.51.4"},"publisher-location":"New York, NY, USA","reference-count":29,"publisher":"ACM","license":[{"start":{"date-parts":[[2019,12,9]],"date-time":"2019-12-09T00:00:00Z","timestamp":1575849600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["1406192, 1700527"],"award-info":[{"award-number":["1406192, 1700527"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2019,12,9]]},"DOI":"10.1145\/3359992.3366642","type":"proceedings-article","created":{"date-parts":[[2019,11,19]],"date-time":"2019-11-19T13:46:52Z","timestamp":1574171212000},"page":"14-21","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":57,"title":["Towards Evaluation of NIDSs in Adversarial Setting"],"prefix":"10.1145","author":[{"given":"Mohammad J.","family":"Hashemi","sequence":"first","affiliation":[{"name":"University of Colorado Boulder, Boulder, Colorado"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Greg","family":"Cusack","sequence":"additional","affiliation":[{"name":"University of Colorado Boulder, Boulder, Colorado"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Eric","family":"Keller","sequence":"additional","affiliation":[{"name":"University of Colorado Boulder, Boulder, Colorado"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2019,12,9]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2018.2869577"},{"key":"e_1_3_2_1_2_1","volume-title":"Proceedings of the 35th International Conference on Machine Learning, ICML 2018. https:\/\/arxiv.org\/abs\/1802","author":"Athalye Anish","year":"2018","unstructured":"Anish Athalye , Nicholas Carlini , and David Wagner . 2018 . Obfuscated Gradients Give a False Sense of Security: Circumventing Defenses to Adversarial Examples . In Proceedings of the 35th International Conference on Machine Learning, ICML 2018. https:\/\/arxiv.org\/abs\/1802 .00420 Anish Athalye, Nicholas Carlini, and David Wagner. 2018. Obfuscated Gradients Give a False Sense of Security: Circumventing Defenses to Adversarial Examples. In Proceedings of the 35th International Conference on Machine Learning, ICML 2018. https:\/\/arxiv.org\/abs\/1802.00420"},{"key":"e_1_3_2_1_3_1","volume-title":"Proceedings of AAAI-2018","author":"Baluja Shumeet","year":"2018","unstructured":"Shumeet Baluja and Ian Fischer . 2018 . Learning to Attack: Adversarial Transformation Networks . In Proceedings of AAAI-2018 . http:\/\/www.esprockets.com\/papers\/aaai2018.pdf Shumeet Baluja and Ian Fischer. 2018. Learning to Attack: Adversarial Transformation Networks. In Proceedings of AAAI-2018. http:\/\/www.esprockets.com\/papers\/aaai2018.pdf"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"crossref","unstructured":"Battista Biggio Igino Corona Davide Maiorca Blaine Nelson Nedim Srndic Pavel Laskov Giorgio Giacinto and Fabio Roli. 2013. Evasion Attacks against Machine Learning at Test Time. In ECML\/PKDD.  Battista Biggio Igino Corona Davide Maiorca Blaine Nelson Nedim Srndic Pavel Laskov Giorgio Giacinto and Fabio Roli. 2013. Evasion Attacks against Machine Learning at Test Time. In ECML\/PKDD.","DOI":"10.1007\/978-3-642-40994-3_25"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/SP.2017.49"},{"key":"e_1_3_2_1_6_1","volume-title":"Audio Adversarial Examples: Targeted Attacks on Speech-to-Text. In Deep Learning and Security Workshop.","author":"Carlini Nicholas","year":"2018","unstructured":"Nicholas Carlini and David Wagner . 2018 . Audio Adversarial Examples: Targeted Attacks on Speech-to-Text. In Deep Learning and Security Workshop. Nicholas Carlini and David Wagner. 2018. Audio Adversarial Examples: Targeted Attacks on Speech-to-Text. In Deep Learning and Security Workshop."},{"key":"e_1_3_2_1_7_1","volume-title":"Deep Learning for Anomaly Detection: A Survey. CoRR abs\/1901.03407","author":"Chalapathy Raghavendra","year":"2019","unstructured":"Raghavendra Chalapathy and Sanjay Chawla . 2019. Deep Learning for Anomaly Detection: A Survey. CoRR abs\/1901.03407 ( 2019 ). arXiv:1901.03407 http:\/\/arxiv.org\/abs\/1901.03407 Raghavendra Chalapathy and Sanjay Chawla. 2019. Deep Learning for Anomaly Detection: A Survey. CoRR abs\/1901.03407 (2019). arXiv:1901.03407 http:\/\/arxiv.org\/abs\/1901.03407"},{"key":"e_1_3_2_1_8_1","volume-title":"Computer Vision and Pattern Recognition","author":"Eykholt Kevin","unstructured":"Kevin Eykholt , Ivan Evtimov , Earlence Fernandes , Bo Li , Amir Rahmati , Chaowei Xiao , Atul Prakash , Tadayoshi Kohno , and Dawn Song . 2018. Robust Physical-World Attacks on Deep Learning Visual Classification . In Computer Vision and Pattern Recognition . IEEE. Kevin Eykholt, Ivan Evtimov, Earlence Fernandes, Bo Li, Amir Rahmati, Chaowei Xiao, Atul Prakash, Tadayoshi Kohno, and Dawn Song. 2018. Robust Physical-World Attacks on Deep Learning Visual Classification. In Computer Vision and Pattern Recognition. IEEE."},{"key":"e_1_3_2_1_9_1","volume-title":"International Conference on Learning Representations.","author":"Goodfellow Ian J","year":"2015","unstructured":"Ian J Goodfellow , Jonathon Shlens , and Christian Szegedy . 2015 . Explaining and harnessing adversarial examples . In International Conference on Learning Representations. Ian J Goodfellow, Jonathon Shlens, and Christian Szegedy. 2015. Explaining and harnessing adversarial examples. In International Conference on Learning Representations."},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-66399-9_4"},{"key":"e_1_3_2_1_11_1","volume-title":"Mohammad Mamun, and Ali Ghorbani.","author":"Lashkari Arash Habibi","year":"2016","unstructured":"Arash Habibi Lashkari , Gerard Draper Gil , Mohammad Mamun, and Ali Ghorbani. 2016 . Characterization of Encrypted and VPN Traffic Using Time-Related Features . https:\/\/doi.org\/10.5220\/0005740704070414 10.5220\/0005740704070414 Arash Habibi Lashkari, Gerard Draper Gil, Mohammad Mamun, and Ali Ghorbani. 2016. Characterization of Encrypted and VPN Traffic Using Time-Related Features. https:\/\/doi.org\/10.5220\/0005740704070414"},{"key":"e_1_3_2_1_12_1","volume-title":"USENIX Security Symposium.","author":"Handley Mark","year":"2001","unstructured":"Mark Handley , Vern Paxson , and Christian Kreibich . 2001 . Network Intrusion Detection: Evasion, Traffic Normalization, and End-to-End Protocol Semantics . In USENIX Security Symposium. Mark Handley, Vern Paxson, and Christian Kreibich. 2001. Network Intrusion Detection: Evasion, Traffic Normalization, and End-to-End Protocol Semantics. In USENIX Security Symposium."},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3270101.3270111"},{"key":"e_1_3_2_1_14_1","unstructured":"ICS-CERT. 2016. Cyber-attack against Ukrainian critical infrastructure. www.ics-cert.us-cert.gov\/alerts\/IR-ALERT-H-16-056-01.  ICS-CERT. 2016. Cyber-attack against Ukrainian critical infrastructure. www.ics-cert.us-cert.gov\/alerts\/IR-ALERT-H-16-056-01."},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3128572.3140445"},{"key":"e_1_3_2_1_16_1","volume-title":"International Conference on Learning Representations.","author":"Liu Yanpei","year":"2017","unstructured":"Yanpei Liu , Xinyun Chen , Chang Liu , and Dawn Song . 2017 . Delving into Transferable Adversarial Examples and Black-box Attacks . In International Conference on Learning Representations. Yanpei Liu, Xinyun Chen, Chang Liu, and Dawn Song. 2017. Delving into Transferable Adversarial Examples and Black-box Attacks. In International Conference on Learning Representations."},{"key":"e_1_3_2_1_17_1","volume-title":"An Empirical Evaluation of Deep Learning for Network Anomaly Detection. In 2018 International Conference on Computing, Networking and Communications (ICNC). 893--898","author":"Malaiya R. K.","year":"2018","unstructured":"R. K. Malaiya , D. Kwon , J. Kim , S. C. Suh , H. Kim , and I. Kim . 2018 . An Empirical Evaluation of Deep Learning for Network Anomaly Detection. In 2018 International Conference on Computing, Networking and Communications (ICNC). 893--898 . https:\/\/doi.org\/10.1109\/ICCNC. 2018 .8390278 10.1109\/ICCNC.2018.8390278 R. K. Malaiya, D. Kwon, J. Kim, S. C. Suh, H. Kim, and I. Kim. 2018. An Empirical Evaluation of Deep Learning for Network Anomaly Detection. In 2018 International Conference on Computing, Networking and Communications (ICNC). 893--898. https:\/\/doi.org\/10.1109\/ICCNC.2018.8390278"},{"key":"e_1_3_2_1_18_1","volume-title":"Kit-sune: An Ensemble of Autoencoders for Online Network Intrusion Detection. In Network and Distributed System Security Symposium 2018 (NDSS'18)","author":"Mirsky Yisroel","year":"2018","unstructured":"Yisroel Mirsky , Tomer Doitshman , Yuval Elovici , and Asaf Shabtai . 2018 . Kit-sune: An Ensemble of Autoencoders for Online Network Intrusion Detection. In Network and Distributed System Security Symposium 2018 (NDSS'18) . Yisroel Mirsky, Tomer Doitshman, Yuval Elovici, and Asaf Shabtai. 2018. Kit-sune: An Ensemble of Autoencoders for Online Network Intrusion Detection. In Network and Distributed System Security Symposium 2018 (NDSS'18)."},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.282"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3052973.3053009"},{"key":"e_1_3_2_1_21_1","volume-title":"2016 IEEE European Symposium on. IEEE, 372--387","author":"Papernot Nicolas","year":"2016","unstructured":"Nicolas Papernot , Patrick McDaniel , Somesh Jha , Matt Fredrikson , Z Berkay Celik , and Ananthram Swami . 2016 . The Limitations of Deep Learning in Adversarial Settings. In Security and Privacy (EuroS&P) , 2016 IEEE European Symposium on. IEEE, 372--387 . Nicolas Papernot, Patrick McDaniel, Somesh Jha, Matt Fredrikson, Z Berkay Celik, and Ananthram Swami. 2016. The Limitations of Deep Learning in Adversarial Settings. In Security and Privacy (EuroS&P), 2016 IEEE European Symposium on. IEEE, 372--387."},{"key":"e_1_3_2_1_22_1","volume-title":"4th International Conference on Information Systems Security and Privacy (ICISSP).","author":"Sharafaldin Iman","unstructured":"Iman Sharafaldin , Arash Habibi Lashkari , and Ali A. Ghorbani . 2018. Toward Generating a New Intrusion Detection Dataset and Intrusion Traffic Characterization . In 4th International Conference on Information Systems Security and Privacy (ICISSP). Iman Sharafaldin, Arash Habibi Lashkari, and Ali A. Ghorbani. 2018. Toward Generating a New Intrusion Detection Dataset and Intrusion Traffic Characterization. In 4th International Conference on Information Systems Security and Privacy (ICISSP)."},{"key":"e_1_3_2_1_23_1","volume-title":"Proceedings of the 2016 ACM SIGSAC Conference on Computer and Communications Security (CCS '16)","author":"Sharif Mahmood","unstructured":"Mahmood Sharif , Sruti Bhagavatula , Lujo Bauer , and Michael K. Reiter . 2016. Accessorize to a Crime: Real and Stealthy Attacks on State-of-the-Art Face Recognition . In Proceedings of the 2016 ACM SIGSAC Conference on Computer and Communications Security (CCS '16) . ACM, New York, NY, USA, 1528--1540. https:\/\/doi.org\/10.1145\/2976749.2978392 10.1145\/2976749.2978392 Mahmood Sharif, Sruti Bhagavatula, Lujo Bauer, and Michael K. Reiter. 2016. Accessorize to a Crime: Real and Stealthy Attacks on State-of-the-Art Face Recognition. In Proceedings of the 2016 ACM SIGSAC Conference on Computer and Communications Security (CCS '16). ACM, New York, NY, USA, 1528--1540. https:\/\/doi.org\/10.1145\/2976749.2978392"},{"key":"e_1_3_2_1_24_1","unstructured":"Symantec. 2019. Internet Security Threat Report. https:\/\/www.symantec.com\/security-center\/threat-report.  Symantec. 2019. Internet Security Threat Report. https:\/\/www.symantec.com\/security-center\/threat-report."},{"key":"e_1_3_2_1_25_1","volume-title":"Intriguing properties of neural networks. arXiv preprint arXiv:1312.6199","author":"Szegedy Christian","year":"2013","unstructured":"Christian Szegedy , Wojciech Zaremba , Ilya Sutskever , Joan Bruna , Dumitru Erhan , Ian Goodfellow , and Rob Fergus . 2013. Intriguing properties of neural networks. arXiv preprint arXiv:1312.6199 ( 2013 ). Christian Szegedy, Wojciech Zaremba, Ilya Sutskever, Joan Bruna, Dumitru Erhan, Ian Goodfellow, and Rob Fergus. 2013. Intriguing properties of neural networks. arXiv preprint arXiv:1312.6199 (2013)."},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICAIBD.2018.8396200"},{"key":"e_1_3_2_1_27_1","volume-title":"Network Intrusion Detection through Stacking Dilated Convolutional Autoencoders. Security and Communication Networks 2017","author":"Yu Yang","year":"2017","unstructured":"Yang Yu , Jun Long , and Zhiping Cai . 2017. Network Intrusion Detection through Stacking Dilated Convolutional Autoencoders. Security and Communication Networks 2017 ( 2017 ). https:\/\/doi.org\/10.1155\/2017\/4184196 10.1155\/2017 Yang Yu, Jun Long, and Zhiping Cai. 2017. Network Intrusion Detection through Stacking Dilated Convolutional Autoencoders. Security and Communication Networks 2017 (2017). https:\/\/doi.org\/10.1155\/2017\/4184196"},{"key":"e_1_3_2_1_28_1","volume-title":"Bruno Lecouat, Gaurav Manek, and Vijay Ramaseshan Chandrasekhar.","author":"Zenati Houssam","year":"2018","unstructured":"Houssam Zenati , Chuan Sheng Foo , Bruno Lecouat, Gaurav Manek, and Vijay Ramaseshan Chandrasekhar. 2018 . Efficient GAN-Based Anomaly Detection. CoRR abs\/1802.06222 (2018). arXiv:1802.06222 http:\/\/arxiv.org\/abs\/1802.06222 Houssam Zenati, Chuan Sheng Foo, Bruno Lecouat, Gaurav Manek, and Vijay Ramaseshan Chandrasekhar. 2018. Efficient GAN-Based Anomaly Detection. CoRR abs\/1802.06222 (2018). arXiv:1802.06222 http:\/\/arxiv.org\/abs\/1802.06222"},{"key":"e_1_3_2_1_29_1","volume-title":"Deep Autoencoding Gaussian Mixture Model for Unsupervised Anomaly Detection. In International Conference on Learning Representations. https:\/\/openreview.net\/forum?id=BJJLHbb0-","author":"Zong Bo","year":"2018","unstructured":"Bo Zong , Qi Song , Martin Renqiang Min , Wei Cheng , Cristian Lumezanu , Daeki Cho , and Haifeng Chen . 2018 . Deep Autoencoding Gaussian Mixture Model for Unsupervised Anomaly Detection. In International Conference on Learning Representations. https:\/\/openreview.net\/forum?id=BJJLHbb0- Bo Zong, Qi Song, Martin Renqiang Min, Wei Cheng, Cristian Lumezanu, Daeki Cho, and Haifeng Chen. 2018. Deep Autoencoding Gaussian Mixture Model for Unsupervised Anomaly Detection. In International Conference on Learning Representations. https:\/\/openreview.net\/forum?id=BJJLHbb0-"}],"event":{"name":"CoNEXT '19: The 15th International Conference on emerging Networking EXperiments and Technologies","location":"Orlando FL USA","acronym":"CoNEXT '19","sponsor":["SIGCOMM ACM Special Interest Group on Data Communication"]},"container-title":["Proceedings of the 3rd ACM CoNEXT Workshop on Big DAta, Machine Learning and Artificial Intelligence for Data Communication Networks"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3359992.3366642","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3359992.3366642","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3359992.3366642","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:13:28Z","timestamp":1750202008000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3359992.3366642"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,12,9]]},"references-count":29,"alternative-id":["10.1145\/3359992.3366642","10.1145\/3359992"],"URL":"https:\/\/doi.org\/10.1145\/3359992.3366642","relation":{},"subject":[],"published":{"date-parts":[[2019,12,9]]},"assertion":[{"value":"2019-12-09","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}