{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,17]],"date-time":"2026-11-17T02:35:29Z","timestamp":1794882929855,"version":"4.9.1"},"reference-count":161,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2024,3,21]],"date-time":"2024-03-21T00:00:00Z","timestamp":1710979200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Digital Threats"],"published-print":{"date-parts":[[2024,3,31]]},"abstract":"<jats:p>Machine Learning (ML) has been widely applied to cybersecurity and is considered state-of-the-art for solving many of the open issues in that field. However, it is very difficult to evaluate how good the produced solutions are, since the challenges faced in security may not appear in other areas. One of these challenges is the concept drift, which increases the existing arms race between attackers and defenders: malicious actors can always create novel threats to overcome the defense solutions, which may not consider them in some approaches. Due to this, it is essential to know how to properly build and evaluate an ML-based security solution. In this article, we identify, detail, and discuss the main challenges in the correct application of ML techniques to cybersecurity data. We evaluate how concept drift, evolution, delayed labels, and adversarial ML impact the existing solutions. Moreover, we address how issues related to data collection affect the quality of the results presented in the security literature, showing that new strategies are needed to improve current solutions. Finally, we present how existing solutions may fail under certain circumstances and propose mitigations to them, presenting a novel checklist to help the development of future ML solutions for cybersecurity.<\/jats:p>","DOI":"10.1145\/3617897","type":"journal-article","created":{"date-parts":[[2023,9,1]],"date-time":"2023-09-01T08:24:32Z","timestamp":1693556672000},"page":"1-32","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":35,"title":["Machine Learning (In) Security: A Stream of Problems"],"prefix":"10.1145","volume":"5","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6853-8083","authenticated-orcid":false,"given":"Fabr\u00edcio","family":"Ceschin","sequence":"first","affiliation":[{"name":"Federal University of Paran\u00e1, Curitiba, Brazil and Georgia Institute of Technology, Atlanta, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6870-1178","authenticated-orcid":false,"given":"Marcus","family":"Botacin","sequence":"additional","affiliation":[{"name":"Texas A&amp;M University, College Station, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8339-7773","authenticated-orcid":false,"given":"Albert","family":"Bifet","sequence":"additional","affiliation":[{"name":"University of Waikato, Hamilton, New Zealand"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3732-5787","authenticated-orcid":false,"given":"Bernhard","family":"Pfahringer","sequence":"additional","affiliation":[{"name":"University of Waikato, Hamilton, New Zealand"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1804-8147","authenticated-orcid":false,"given":"Luiz S.","family":"Oliveira","sequence":"additional","affiliation":[{"name":"Federal University of Paran\u00e1, Curitiba, Brazil"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5276-637X","authenticated-orcid":false,"given":"Heitor Murilo","family":"Gomes","sequence":"additional","affiliation":[{"name":"Victoria University of Wellington, Curitiba, New Zealand"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1766-5757","authenticated-orcid":false,"given":"Andr\u00e9","family":"Gr\u00e9gio","sequence":"additional","affiliation":[{"name":"Federal University of Paran\u00e1, Curitiba, Brazil"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2024,3,21]]},"reference":[{"key":"e_1_3_2_2_2","first-page":"3252","volume-title":"IEEE International Conference on Big Data (Big Data\u201919)","author":"Abri F.","year":"2019","unstructured":"F. Abri, S. Siami-Namini, M. A. Khanghah, F. M. Soltani, and A. S. Namin. 2019. Can machine\/deep learning classifiers detect zero-day malware with high accuracy? In IEEE International Conference on Big Data (Big Data\u201919). 3252\u20133259."},{"key":"e_1_3_2_3_2","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1007\/s10115-017-1070-0","article-title":"Modeling recurring concepts in data streams: A graph-based framework","volume":"55","author":"Ahmadi Zahra","year":"2017","unstructured":"Zahra Ahmadi and Stefan Kramer. 2017. Modeling recurring concepts in data streams: A graph-based framework. Knowl. Inf. Syst. 55 (2017), 15\u201344.","journal-title":"Knowl. Inf. Syst."},{"key":"e_1_3_2_4_2","doi-asserted-by":"crossref","first-page":"468","DOI":"10.1145\/2901739.2903508","volume-title":"13th International Conference on Mining Software Repositories (MSR\u201916)","author":"Allix Kevin","year":"2016","unstructured":"Kevin Allix, Tegawend\u00e9 F. Bissyand\u00e9, Jacques Klein, and Yves Le Traon. 2016. AndroZoo: Collecting millions of Android apps for the research community. In 13th International Conference on Mining Software Repositories (MSR\u201916). ACM, New York, NY, 468\u2013471. DOI:10.1145\/2901739.2903508"},{"key":"e_1_3_2_5_2","unstructured":"Hyrum S. Anderson Anant Kharkar Bobby Filar David Evans and Phil Roth. 2018. Learning to Evade Static PE Machine Learning Malware Models via Reinforcement Learning. arxiv:1801.08917 [cs.CR]."},{"key":"e_1_3_2_6_2","article-title":"EMBER: An open dataset for training static PE malware machine learning models","author":"Anderson H. S.","year":"2018","unstructured":"H. S. Anderson and P. Roth. 2018. EMBER: An open dataset for training static PE malware machine learning models. ArXiv E-prints (Apr.2018). arxiv:1804.04637 [cs.CR].","journal-title":"ArXiv E-prints"},{"key":"e_1_3_2_7_2","volume-title":"1st IEEE Conference on Secure and Trustworthy Machine Learning (SaTML\u201923)","author":"Apruzzese Giovanni","year":"2023","unstructured":"Giovanni Apruzzese, Hyrum S. Anderson, Savino Dambra, David Freeman, Fabio Pierazzi, and Kevin A. Roundy. 2023. \u201cReal attackers don\u2019t compute gradients\u201d: Bridging the gap between adversarial ML research and practice. In 1st IEEE Conference on Secure and Trustworthy Machine Learning (SaTML\u201923)."},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1109\/TETCI.2019.2961157"},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1145\/3545574"},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1109\/eurosp53844.2022.00010"},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1145\/3373464.3373472"},{"key":"e_1_3_2_12_2","volume-title":"USENIX Security Symposium","author":"Arp Daniel","year":"2022","unstructured":"Daniel Arp, Erwin Quiring, Feargus Pendlebury, Alexander Warnecke, Fabio Pierazzi, Christian Wressnegger, Lorenzo Cavallaro, and Konrad Rieck. 2022. Dos and don\u2019ts of machine learning in computer security. In USENIX Security Symposium."},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.14722\/ndss.2014.23247"},{"key":"e_1_3_2_14_2","article-title":"Obfuscated gradients give a false sense of security: Circumventing defenses to adversarial examples","volume":"1802","author":"Athalye Anish","year":"2018","unstructured":"Anish Athalye, Nicholas Carlini, and David A. Wagner. 2018. Obfuscated gradients give a false sense of security: Circumventing defenses to adversarial examples. CoRR abs\/1802.00420 (2018).","journal-title":"CoRR"},{"key":"e_1_3_2_15_2","unstructured":"Manuel Baena-Gar\u0107\u0131a Jos\u00e9 del Campo-\u00c1vila Ra\u00fal Fidalgo Albert Bifet Ricard Gavald\u00e0 and Rafael Morales-Bueno. 2006. Early drift detection method."},{"key":"e_1_3_2_16_2","first-page":"4796","volume-title":"29th International Joint Conference on Artificial Intelligence (IJCAI\u201920)","author":"Bahri Maroua","year":"2020","unstructured":"Maroua Bahri, Albert Bifet, Silviu Maniu, and Heitor Murilo Gomes. 2020. Survey on feature transformation techniques for data streams. In 29th International Joint Conference on Artificial Intelligence (IJCAI\u201920), Christian Bessiere (Ed.). International Joint Conferences on Artificial Intelligence Organization, 4796\u20134802. DOI:10.24963\/ijcai.2020\/668"},{"key":"e_1_3_2_17_2","unstructured":"Zoltan Balazs. 2020. CUJO AI Partners with Microsoft for the Machine Learning Security Evasion Competition 2020. Retrieved from https:\/\/cujo.com\/machine-learning-security-evasion-competition-2020\/"},{"key":"e_1_3_2_18_2","unstructured":"Willi Ballenthin and Moritz Raabe. 2020. capa: Automatically Identify Malware Capabilities. Retrieved from https:\/\/www.mandiant.com\/resources\/blog\/capa-automatically-identify-malware-capabilities"},{"key":"e_1_3_2_19_2","first-page":"381","volume-title":"Conference on Information Security","author":"Beppler Tamy","year":"2019","unstructured":"Tamy Beppler, Marcus Botacin, Fabr\u00edcio Ceschin, Luiz E. S. Oliveira, and Andr\u00e9 Gr\u00e9gio. 2019. L(a)ying in (Test)Bed: How biased datasets produce impractical results for actual malware families\u2019 classification. In Conference on Information Security, Zhiqiang Lin, Charalampos Papamanthou, and Michalis Polychronakis (Eds.). Springer International Publishing, Cham, 381\u2013401. Retrieved from https:\/\/link.springer.com\/chapter\/10.1007\/978-3-030-30215-3_19"},{"key":"e_1_3_2_20_2","first-page":"97","volume-title":"18th Symposium on Usable Privacy and Security (SOUPS\u201922)","author":"Bieringer Lukas","year":"2022","unstructured":"Lukas Bieringer, Kathrin Grosse, Michael Backes, Battista Biggio, and Katharina Krombholz. 2022. Industrial practitioners\u2019 mental models of adversarial machine learning. In 18th Symposium on Usable Privacy and Security (SOUPS\u201922). USENIX Association, Boston, MA, 97\u2013116. Retrieved from https:\/\/www.usenix.org\/conference\/soups2022\/presentation\/bieringer"},{"key":"e_1_3_2_21_2","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/10654.001.0001","volume-title":"Machine Learning for Data Streams with Practical Examples in MOA","author":"Bifet Albert","year":"2018","unstructured":"Albert Bifet, Ricard Gavald\u00e0, Geoff Holmes, and Bernhard Pfahringer. 2018. Machine Learning for Data Streams with Practical Examples in MOA. MIT Press. Retrieved from https:\/\/moa.cms.waikato.ac.nz\/book\/"},{"key":"e_1_3_2_22_2","article-title":"Learning from time-changing data with adaptive windowing","author":"Bifet Albert","year":"2007","unstructured":"Albert Bifet and Ricard Gavald\u00e0. 2007. Learning from time-changing data with adaptive windowing, In SIAM International Conference on Data Mining.","journal-title":"SIAM International Conference on Data Mining"},{"key":"e_1_3_2_23_2","first-page":"1601","article-title":"MOA: Massive online analysis","volume":"11","author":"Bifet Albert","year":"2010","unstructured":"Albert Bifet, Geoff Holmes, Richard Kirkby, and Bernhard Pfahringer. 2010. MOA: Massive online analysis. J. Mach. Learn. Res. 11 (Aug.2010), 1601\u20131604.","journal-title":"J. Mach. Learn. Res."},{"key":"e_1_3_2_24_2","volume-title":"Pattern Recognition and Machine Learning","author":"Bishop C. M.","year":"2006","unstructured":"C. M. Bishop. 2006. Pattern Recognition and Machine Learning. Springer."},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1145\/3473856.3473869"},{"key":"e_1_3_2_26_2","doi-asserted-by":"crossref","unstructured":"Marcus Botacin Giovanni Bert\u00e3o Paulo de Geus Andr\u00e9 Gr\u00e9gio Christopher Kruegel and Giovanni Vigna. 2020. On the security of application installer & online software repositories. InConference on Detection of Intrusions and Malware & Vulnerability (DIMVA\u201920). Springer.","DOI":"10.1007\/978-3-030-52683-2_10"},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cose.2020.101859"},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cose.2021.102500"},{"key":"e_1_3_2_29_2","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1109\/ReCoSoC48741.2019.9034972","volume-title":"14th International Symposium on Reconfigurable Communication-centric Systems-on-Chip (ReCoSoC\u201919)","author":"Botacin M.","year":"2019","unstructured":"M. Botacin, L. Galante, F. Ceschin, P. C. Santos, L. Carro, P. de Geus, A. Gr\u00e9gio, and M. A. Z. Alves. 2019. The AV says: Your hardware definitions were updated! In 14th International Symposium on Reconfigurable Communication-centric Systems-on-Chip (ReCoSoC\u201919). 27\u201334."},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1023\/A:1018054314350"},{"key":"e_1_3_2_31_2","article-title":"Deconstructing the phishing campaigns that target gmail users","author":"Bursztein Elie","year":"2019","unstructured":"Elie Bursztein and Daniela Oliveira. 2019. Deconstructing the phishing campaigns that target gmail users. Black Hat USA 2019 (2019). Retrieved from https:\/\/elie.net\/talk\/deconstructing-the-phishing-campaigns-that-target-gmail-users\/","journal-title":"Black Hat USA 2019"},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2017.11.032"},{"key":"e_1_3_2_33_2","article-title":"Towards evaluating the robustness of neural networks","volume":"1608","author":"Carlini Nicholas","year":"2016","unstructured":"Nicholas Carlini and David A. Wagner. 2016. Towards evaluating the robustness of neural networks. CoRR abs\/1608.04644 (2016).","journal-title":"CoRR"},{"key":"e_1_3_2_34_2","unstructured":"Lorenzo Cavallaro. 2019. When the Magic Wears Off: Flaws in ML for Security Evaluations (and What to Do about It). USENIX Association Burlingame CA."},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.1145\/3375894.3375898"},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2022.118590"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1145\/3433667.3433669"},{"issue":"6","key":"e_1_3_2_38_2","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1109\/MSEC.2018.2875369","article-title":"The need for speed: An analysis of Brazilian malware classifers","volume":"16","author":"Ceschin Fabr\u00edcio","year":"2018","unstructured":"Fabr\u00edcio Ceschin, Felipe Pinage, Marcos Castilho, David Menotti, Luis S. Oliveira, and Andr\u00e9 Gregio. 2018. The need for speed: An analysis of Brazilian malware classifers. IEEE Secur. Priv. 16, 6 (2018), 31\u201341.","journal-title":"IEEE Secur. Priv."},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.1109\/TDSC.2017.2739145"},{"key":"e_1_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.1613\/jair.953"},{"key":"e_1_3_2_41_2","article-title":"Deep transfer learning for static malware classification","volume":"1812","author":"Chen Li","year":"2018","unstructured":"Li Chen. 2018. Deep transfer learning for static malware classification. CoRR abs\/1812.07606 (2018).","journal-title":"CoRR"},{"key":"e_1_3_2_42_2","unstructured":"Li Chen Ravi Sahita Jugal Parikh and Marc Marino. 2020. STAMINA Deep Learning for Malware Protection. Retrieved from https:\/\/www.intel.com\/content\/www\/us\/en\/artificial-intelligence\/documents\/stamina-deep-learning-for-malware-protection-whitepaper.html"},{"key":"e_1_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.1145\/3352020.3352024"},{"key":"e_1_3_2_44_2","first-page":"886","volume-title":"IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201905)","volume":"1","author":"Dalal N.","year":"2005","unstructured":"N. Dalal and B. Triggs. 2005. Histograms of oriented gradients for human detection. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201905), Vol. 1. 886\u2013893."},{"key":"e_1_3_2_45_2","first-page":"233","volume-title":"23rd International Conference on Machine Learning (ICML\u201906)","author":"Davis Jesse","year":"2006","unstructured":"Jesse Davis and Mark Goadrich. 2006. The relationship between precision-recall and ROC curves. In 23rd International Conference on Machine Learning (ICML\u201906). Association for Computing Machinery, New York, NY, 233\u2013240. DOI:10.1145\/1143844.1143874"},{"key":"e_1_3_2_46_2","doi-asserted-by":"crossref","first-page":"1329","DOI":"10.3233\/IDA-150207","article-title":"A novel concept drift detection method in data streams using ensemble classifiers","volume":"20","author":"Dehghan M.","year":"2016","unstructured":"M. Dehghan, H. Beigy, and Poorya Zaremoodi. 2016. A novel concept drift detection method in data streams using ensemble classifiers. Intell. Data Anal. 20 (2016), 1329\u20131350.","journal-title":"Intell. Data Anal."},{"key":"e_1_3_2_47_2","volume-title":"ACM Workshop on Artificial Intelligence and Security (AISec\u201916)","author":"Deo Amit","year":"2016","unstructured":"Amit Deo, Santanu Kumar Dash, Guillermo Suarez-Tangil, Volodya Vovk, and Lorenzo Cavallaro. 2016. Prescience: Probabilistic guidance on the retraining conundrum for malware detection. In ACM Workshop on Artificial Intelligence and Security (AISec\u201916). Association for Computing Machinery, New York, NY."},{"key":"e_1_3_2_48_2","first-page":"593","volume-title":"International Conference on Advanced Communication Control and Computing Technologies (ICACCCT\u201916)","author":"Dev M.","year":"2016","unstructured":"M. Dev, H. Gupta, S. Mehta, and B. Balamurugan. 2016. Cache implementation using collective intelligence on cloud based antivirus architecture. In International Conference on Advanced Communication Control and Computing Technologies (ICACCCT\u201916). 593\u2013595."},{"key":"e_1_3_2_49_2","doi-asserted-by":"publisher","DOI":"10.1561\/0400000042"},{"key":"e_1_3_2_50_2","doi-asserted-by":"publisher","DOI":"10.1109\/SP46214.2022.9833671"},{"key":"e_1_3_2_51_2","first-page":"5330","volume-title":"IEEE International Conference on Big Data (Big Data\u201918)","author":"Hadj M. A. El","year":"2018","unstructured":"M. A. El Hadj, M. Erradi, A. Khoumsi, and Y. Benkaouz. 2018. Validation and correction of large security policies: A clustering and access log based approach. In IEEE International Conference on Big Data (Big Data\u201918). 5330\u20135332."},{"key":"e_1_3_2_52_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-9280.2006.01704.x"},{"key":"e_1_3_2_53_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.patrec.2008.08.010"},{"key":"e_1_3_2_54_2","unstructured":"FireEye. 2019. StringSifter. Retrieved from https:\/\/github.com\/fireeye\/stringsifter"},{"key":"e_1_3_2_55_2","unstructured":"William Fleshman Edward Raff Jared Sylvester Steven Forsyth and Mark McLean. 2018. Non-negative Networks Against Adversarial Attacks. Retrieved from https:\/\/arxiv.org\/abs\/1806.06108"},{"key":"e_1_3_2_56_2","doi-asserted-by":"publisher","DOI":"10.1006\/jcss.1997.1504"},{"key":"e_1_3_2_57_2","first-page":"303","volume-title":"the Web Conference (WWW\u201920)","author":"Gade Krishna","year":"2020","unstructured":"Krishna Gade, Sahin Geyik, Krishnaram Kenthapadi, Varun Mithal, and Ankur Taly. 2020. Explainable AI in industry: Practical challenges and lessons learned. In the Web Conference (WWW\u201920). Association for Computing Machinery, New York, NY, 303\u2013304. DOI:10.1145\/3366424.3383110"},{"key":"e_1_3_2_58_2","doi-asserted-by":"crossref","unstructured":"Lucas Galante Marcus Botacin Andr\u00e9 Gr\u00e9gio and Paulo de Geus. 2019. Machine learning for malware detection: Beyond accuracy rates. InBrazilian Security Symposium (SBSeg\u201919).","DOI":"10.5753\/sbseg_estendido.2019.14005"},{"issue":"4","key":"e_1_3_2_59_2","doi-asserted-by":"crossref","first-page":"463","DOI":"10.1109\/TSMCC.2011.2161285","article-title":"A review on ensembles for the class imbalance problem: Bagging-, boosting-, and hybrid-based approaches","volume":"42","author":"Galar M.","year":"2012","unstructured":"M. Galar, A. Fernandez, E. Barrenechea, H. Bustince, and F. Herrera. 2012. A review on ensembles for the class imbalance problem: Bagging-, boosting-, and hybrid-based approaches. IEEE Trans. Syst., Man, Cybern., Part C (Applic. Rev.) 42, 4 (2012), 463\u2013484.","journal-title":"IEEE Trans. Syst., Man, Cybern., Part C (Applic. Rev.)"},{"key":"e_1_3_2_60_2","doi-asserted-by":"crossref","first-page":"286","DOI":"10.1007\/978-3-540-28645-5_29","volume-title":"Advances in Artificial Intelligence \u2013 SBIA 2004","author":"Gama Jo\u00e3o","year":"2004","unstructured":"Jo\u00e3o Gama, Pedro Medas, Gladys Castillo, and Pedro Rodrigues. 2004. Learning with drift detection. In Advances in Artificial Intelligence \u2013 SBIA 2004, Ana L. C. Bazzan and Sofiane Labidi (Eds.). Springer Berlin, 286\u2013295."},{"key":"e_1_3_2_61_2","doi-asserted-by":"publisher","DOI":"10.1145\/2523813"},{"key":"e_1_3_2_62_2","doi-asserted-by":"crossref","first-page":"325","DOI":"10.1145\/3351095.3372862","volume-title":"Conference on Fairness, Accountability, and Transparency (FAT*\u201920)","author":"Geiger R. Stuart","year":"2020","unstructured":"R. Stuart Geiger, Kevin Yu, Yanlai Yang, Mindy Dai, Jie Qiu, Rebekah Tang, and Jenny Huang. 2020. Garbage in, garbage out? Do machine learning application papers in social computing report where human-labeled training data comes from? In Conference on Fairness, Accountability, and Transparency (FAT*\u201920). Association for Computing Machinery, New York, NY, 325\u2013336. DOI:10.1145\/3351095.3372862"},{"key":"e_1_3_2_63_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jnca.2019.102526"},{"key":"e_1_3_2_64_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-017-5642-8"},{"key":"e_1_3_2_65_2","doi-asserted-by":"publisher","DOI":"10.1145\/3373464.3373470"},{"key":"e_1_3_2_66_2","unstructured":"Ian J. Goodfellow Jean Pouget-Abadie Mehdi Mirza Bing Xu David Warde-Farley Sherjil Ozair Aaron Courville and Yoshua Bengio. 2014. Generative Adversarial Networks. arxiv:1406.2661 [stat.ML]."},{"key":"e_1_3_2_67_2","unstructured":"Ian J. Goodfellow Jonathon Shlens and Christian Szegedy. 2014. Explaining and Harnessing Adversarial Examples. arxiv:1412.6572 [stat.ML]."},{"key":"e_1_3_2_68_2","doi-asserted-by":"publisher","DOI":"10.1145\/3145905"},{"key":"e_1_3_2_69_2","volume-title":"Hands-on Machine Learning with Scikit-Learn and TensorFlow: Concepts, Tools, and Techniques to Build Intelligent Systems (1st ed.)","author":"Gron Aurlien","year":"2017","unstructured":"Aurlien Gron. 2017. Hands-on Machine Learning with Scikit-Learn and TensorFlow: Concepts, Tools, and Techniques to Build Intelligent Systems (1st ed.). O\u2019Reilly Media, Inc."},{"key":"e_1_3_2_70_2","doi-asserted-by":"publisher","DOI":"10.1109\/tifs.2023.3251842"},{"key":"e_1_3_2_71_2","volume-title":"European Symposium on Research in Computer Security (ESORICS\u201917)","author":"Grosse Kathrin","year":"2017","unstructured":"Kathrin Grosse, Nicolas Papernot, Praveen Manoharan, Michael Backes, and Patrick D. McDaniel. 2017. Adversarial examples for malware detection. In European Symposium on Research in Computer Security (ESORICS\u201917)."},{"key":"e_1_3_2_72_2","article-title":"Simple black-box adversarial attacks","volume":"1905","author":"Guo Chuan","year":"2019","unstructured":"Chuan Guo, Jacob R. Gardner, Yurong You, Andrew Gordon Wilson, and Kilian Q. Weinberger. 2019. Simple black-box adversarial attacks. CoRR abs\/1905.07121 (2019).","journal-title":"CoRR"},{"key":"e_1_3_2_73_2","doi-asserted-by":"publisher","DOI":"10.1145\/1656274.1656278"},{"key":"e_1_3_2_74_2","unstructured":"Paul Hick Emile Aben KC Claffy and Josh Polterock. 2007. The CAIDA DDoS attack 2007 dataset. Retrieved from https:\/\/www.caida.org\/data\/passive\/ddos-20070804_dataset.xml"},{"key":"e_1_3_2_75_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10115-015-0837-4"},{"key":"e_1_3_2_76_2","article-title":"Fine-tuned language models for text classification","volume":"1801","author":"Howard Jeremy","year":"2018","unstructured":"Jeremy Howard and Sebastian Ruder. 2018. Fine-tuned language models for text classification. CoRR abs\/1801.06146 (2018).","journal-title":"CoRR"},{"key":"e_1_3_2_77_2","article-title":"Generating adversarial malware examples for black-box attacks based on GAN","volume":"1702","author":"Hu Weiwei","year":"2017","unstructured":"Weiwei Hu and Ying Tan. 2017. Generating adversarial malware examples for black-box attacks based on GAN. CoRR abs\/1702.05983 (2017).","journal-title":"CoRR"},{"key":"e_1_3_2_78_2","doi-asserted-by":"publisher","DOI":"10.1145\/3199674"},{"key":"e_1_3_2_79_2","first-page":"425","volume-title":"IEEE International Working Conference on Mining Software Repositories","author":"Hurier Mederic","year":"2017","unstructured":"Mederic Hurier, Guillermo Suarez-Tangil, Santanu Kumar Dash, Tegawende F. Bissyande, Yves Le Traon, Jacques Klein, and Lorenzo Cavallaro. 2017. Euphony: Harmonious unification of cacophonous anti-virus vendor labels for Android malware. In IEEE International Working Conference on Mining Software Repositories. IEEE Computer Society, 425\u2013435. DOI:10.1109\/MSR.2017.57"},{"key":"e_1_3_2_80_2","doi-asserted-by":"crossref","first-page":"191","DOI":"10.1007\/978-3-319-97982-3_16","volume-title":"Advances in Computational Intelligence Systems","author":"Hussain Mahbub","year":"2019","unstructured":"Mahbub Hussain, Jordan J. Bird, and Diego R. Faria. 2019. A study on CNN transfer learning for image classification. In Advances in Computational Intelligence Systems, Ahmad Lotfi, Hamid Bouchachia, Alexander Gegov, Caroline Langensiepen, and Martin McGinnity (Eds.). Springer International Publishing, Cham, 191\u2013202."},{"key":"e_1_3_2_81_2","first-page":"209","volume-title":"28th Annual Computer Security Applications Conference (ACSAC\u201912)","author":"Jarabek Chris","year":"2012","unstructured":"Chris Jarabek, David Barrera, and John Aycock. 2012. ThinAV: Truly lightweight mobile cloud-based anti-malware. In 28th Annual Computer Security Applications Conference (ACSAC\u201912). Association for Computing Machinery, New York, NY, 209\u2013218. DOI:10.1145\/2420950.2420983"},{"key":"e_1_3_2_82_2","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1108\/eb026526","article-title":"A statistical interpretation of term specificity and its application in retrieval","volume":"28","author":"Jones Karen Sp\u00e4rck","year":"1972","unstructured":"Karen Sp\u00e4rck Jones. 1972. A statistical interpretation of term specificity and its application in retrieval. J. Document. 28 (1972), 11\u201321.","journal-title":"J. Document."},{"key":"e_1_3_2_83_2","first-page":"625","volume-title":"26th USENIX Security Symposium (USENIX Security\u201917)","author":"Jordaney Roberto","year":"2017","unstructured":"Roberto Jordaney, Kumar Sharad, Santanu K. Dash, Zhi Wang, Davide Papini, Ilia Nouretdinov, and Lorenzo Cavallaro. 2017. Transcend: Detecting concept drift in malware classification models. In 26th USENIX Security Symposium (USENIX Security\u201917). USENIX Association, 625\u2013642. Retrieved from https:\/\/www.usenix.org\/conference\/usenixsecurity17\/technical-sessions\/presentation\/jordaney"},{"key":"e_1_3_2_84_2","doi-asserted-by":"publisher","DOI":"10.1145\/2517312.2517320"},{"key":"e_1_3_2_85_2","doi-asserted-by":"publisher","DOI":"10.1145\/2808769.2808780"},{"key":"e_1_3_2_86_2","doi-asserted-by":"publisher","DOI":"10.1145\/2020408.2020496"},{"issue":"4","key":"e_1_3_2_87_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3343440","article-title":"A systematic review on imbalanced data challenges in machine learning: Applications and solutions","volume":"52","author":"Kaur Harsurinder","year":"2019","unstructured":"Harsurinder Kaur, Husanbir Singh Pannu, and Avleen Kaur Malhi. 2019. A systematic review on imbalanced data challenges in machine learning: Applications and solutions. ACM Comput. Surv. 52, 4 (2019), 1\u201336.","journal-title":"ACM Comput. Surv."},{"key":"e_1_3_2_88_2","first-page":"577","volume-title":"15th International Conference on Signal-Image Technology Internet-Based Systems (SITIS\u201919)","author":"Keser R. K.","year":"2019","unstructured":"R. K. Keser and B. U. T\u00f6reyin. 2019. Autoencoder based dimensionality reduction of feature vectors for object recognition. In 15th International Conference on Signal-Image Technology Internet-Based Systems (SITIS\u201919). 577\u2013584."},{"key":"e_1_3_2_89_2","volume-title":"A Non-Aristotelian System and Its Necessity for Rigour in Mathematics and Physics: Abstract","author":"Korzybski A.","year":"1931","unstructured":"A. Korzybski. 1931. A Non-Aristotelian System and Its Necessity for Rigour in Mathematics and Physics: Abstract."},{"key":"e_1_3_2_90_2","doi-asserted-by":"publisher","DOI":"10.1145\/2674026.2674028"},{"key":"e_1_3_2_91_2","unstructured":"Alex Krizhevsky. 2012. Learning Multiple Layers of Features from Tiny Images. University of Toronto."},{"key":"e_1_3_2_92_2","doi-asserted-by":"publisher","DOI":"10.1109\/MITP.2021.3100177"},{"key":"e_1_3_2_93_2","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557238"},{"key":"e_1_3_2_94_2","first-page":"1","volume-title":"International Conference for Convergence for Technology","author":"Kumar M.","year":"2014","unstructured":"M. Kumar and R. Mathur. 2014. Unsupervised outlier detection technique for intrusion detection in cloud computing. In International Conference for Convergence for Technology. 1\u20134."},{"key":"e_1_3_2_95_2","first-page":"1397","volume-title":"2nd International Conference on Inventive Communication and Computational Technologies (ICICCT\u201918)","author":"Kumar S.","year":"2018","unstructured":"S. Kumar and C. Bhim Bhan Singh. 2018. A zero-day resistant malware detection method for securing cloud using SVM and sandboxing techniques. In 2nd International Conference on Inventive Communication and Computational Technologies (ICICCT\u201918). 1397\u20131402."},{"key":"e_1_3_2_96_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-17551-5_4"},{"key":"e_1_3_2_97_2","unstructured":"Linyi Li Xiangyu Qi Tao Xie and Bo Li. 2020. SoK: Certified Robustness for Deep Neural Networks. arxiv:2009.04131 [cs.LG]."},{"key":"e_1_3_2_98_2","unstructured":"LightGBM. 2018. LightGBM. Retrieved from https:\/\/lightgbm.readthedocs.io\/en\/latest\/"},{"key":"e_1_3_2_99_2","doi-asserted-by":"publisher","DOI":"10.1145\/2133360.2133363"},{"key":"e_1_3_2_100_2","first-page":"112","volume-title":"34th Annual Computer Security Applications Conference (ACSAC\u201918)","author":"Machiry Aravind","year":"2018","unstructured":"Aravind Machiry, Nilo Redini, Eric Gustafson, Yanick Fratantonio, Yung Ryn Choe, Christopher Kruegel, and Giovanni Vigna. 2018. Using loops for malware classification resilient to feature-unaware perturbations. In 34th Annual Computer Security Applications Conference (ACSAC\u201918). Association for Computing Machinery, New York, NY, 112\u2013123. DOI:10.1145\/3274694.3274731"},{"issue":"4","key":"e_1_3_2_101_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3332184","article-title":"Towards adversarial malware detection: Lessons learned from PDF-based attacks","volume":"52","author":"Maiorca Davide","year":"2019","unstructured":"Davide Maiorca, Battista Biggio, and Giorgio Giacinto. 2019. Towards adversarial malware detection: Lessons learned from PDF-based attacks. ACM Comput. Surv. 52, 4 (2019), 1\u201336.","journal-title":"ACM Comput. Surv."},{"key":"e_1_3_2_102_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2020.2974752"},{"key":"e_1_3_2_103_2","article-title":"Cloud-based malware detection for evolving data streams","author":"Masud Mohammad M.","year":"2008","unstructured":"Mohammad M. Masud, Tahseen M. Al-Khateeb, Kevin W. Hamlen, Jing Gao, Latifur Khan, Jiawei Han, and Bhavani Thuraisingham. 2008. Cloud-based malware detection for evolving data streams. ACM Trans. Manag. Inf. Syst. (Oct.2008).","journal-title":"ACM Trans. Manag. Inf. Syst."},{"key":"e_1_3_2_104_2","volume-title":"Spark Structured Streaming: A New High-level API for Streaming","author":"Das Michael Armbrust Matei Zaharia, Tathagata","year":"2016","unstructured":"Michael Armbrust Matei Zaharia, Tathagata Das, and Reynold Xin. 2016. Spark Structured Streaming: A New High-level API for Streaming. Retrieved from https:\/\/databricks.com\/blog\/2016\/07\/28\/structured-streaming-in-apache-spark.html"},{"key":"e_1_3_2_105_2","article-title":"SecML: A Python library for secure and explainable machine learning","author":"Melis Marco","year":"2019","unstructured":"Marco Melis, Ambra Demontis, Maura Pintor, Angelo Sotgiu, and Battista Biggio. 2019. SecML: A Python library for secure and explainable machine learning. arXiv preprint arXiv:1912.10013 (2019).","journal-title":"arXiv preprint arXiv:1912.10013"},{"key":"e_1_3_2_106_2","volume-title":"Machine Learning, Neural and Statistical Classification","author":"Michie Donald","year":"1994","unstructured":"Donald Michie, D. J. Spiegelhalter, C. C. Taylor, and John Campbell (Eds.). 1994. Machine Learning, Neural and Statistical Classification. Ellis Horwood, Upper Saddle River, NJ."},{"key":"e_1_3_2_107_2","article-title":"Efficient estimation of word representations in vector space","volume":"1301","author":"Mikolov Tomas","year":"2013","unstructured":"Tomas Mikolov, Kai Chen, Greg Corrado, and Jeffrey Dean. 2013. Efficient estimation of word representations in vector space. CoRR abs\/1301.3781 (2013).","journal-title":"CoRR"},{"key":"e_1_3_2_108_2","unstructured":"Jacob Montiel Max Halford Saulo Martiello Mastelini Geoffrey Bolmier Raphael Sourty Robin Vaysse Adil Zouitine Heitor Murilo Gomes Jesse Read Talel Abdessalem and Albert Bifet. 2020. River: Machine learning for streaming data in Python. arxiv:2012.04740 [cs.LG]"},{"key":"e_1_3_2_109_2","article-title":"Scikit-multiflow: A multi-output streaming framework","author":"Montiel Jacob","year":"2018","unstructured":"Jacob Montiel, Jesse Read, Albert Bifet, and Talel Abdessalem. 2018. Scikit-multiflow: A multi-output streaming framework. J. Mach. Learn. Res. (2018).","journal-title":"J. Mach. Learn. Res."},{"key":"e_1_3_2_110_2","doi-asserted-by":"publisher","DOI":"10.1186\/s40537-014-0007-7"},{"key":"e_1_3_2_111_2","volume-title":"International Joint Conference on Neural Networks (IJCNN\u201916)","author":"Narayanan A.","year":"2016","unstructured":"A. Narayanan, L. Yang, L. Chen, and L. Jinliang. 2016. Adaptive and scalable Android malware detection through online learning. In International Joint Conference on Neural Networks (IJCNN\u201916)."},{"key":"e_1_3_2_112_2","unstructured":"NetResec. 2020. Publicly available PCAP files. Retrieved from https:\/\/www.netresec.com\/?page=PcapFiles"},{"key":"e_1_3_2_113_2","article-title":"Minimizing compute costs: When should we run more expensive malware analysis? In","author":"Nguyen Andre","year":"2022","unstructured":"Andre Nguyen, Richard Zak, Luke Edward Richards, Maya Fuchs, Fred Lu, Robert Brandon, Garay David Lopez Munoz, Ed Raff, Charles Nicholas, and James Holt. 2022. Minimizing compute costs: When should we run more expensive malware analysis? In Conference on Applied Machine Learning in Information Security (CAMLIS\u201922). Retrieved from https:\/\/www.camlis.org\/andre-nguyen-2022","journal-title":"Conference on Applied Machine Learning in Information Security (CAMLIS\u201922)"},{"key":"e_1_3_2_114_2","doi-asserted-by":"publisher","DOI":"10.1145\/3533378"},{"key":"e_1_3_2_115_2","first-page":"2","volume-title":"5th ACM SIGCOMM Conference on Internet Measurement","author":"Pang Ruoming","year":"2005","unstructured":"Ruoming Pang, Mark Allman, Mike Bennett, Jason Lee, Vern Paxson, and Brian Tierney. 2005. A first look at modern enterprise traffic. In 5th ACM SIGCOMM Conference on Internet Measurement. 2\u20132."},{"key":"e_1_3_2_116_2","first-page":"506","volume-title":"4th International Conference on Computational Intelligence and Communication Networks","author":"Panigrahi P. K.","year":"2012","unstructured":"P. K. Panigrahi. 2012. A comparative study of supervised machine learning techniques for spam e-mail filtering. In 4th International Conference on Computational Intelligence and Communication Networks. 506\u2013512."},{"key":"e_1_3_2_117_2","article-title":"Technical report on the cleverhans v2.1.0 adversarial examples library","author":"Papernot Nicolas","year":"2018","unstructured":"Nicolas Papernot, Fartash Faghri, Nicholas Carlini, Ian Goodfellow, Reuben Feinman, Alexey Kurakin, Cihang Xie, Yash Sharma, Tom Brown, Aurko Roy, Alexander Matyasko, Vahid Behzadan, Karen Hambardzumyan, Zhishuai Zhang, Yi-Lin Juang, Zhi Li, Ryan Sheatsley, Abhibhav Garg, Jonathan Uesato, Willi Gierke, Yinpeng Dong, David Berthelot, Paul Hendricks, Jonas Rauber, and Rujun Long. 2018. Technical report on the cleverhans v2.1.0 adversarial examples library. arXiv preprint arXiv:1610.00768 (2018).","journal-title":"arXiv preprint arXiv:1610.00768"},{"key":"e_1_3_2_118_2","doi-asserted-by":"publisher","DOI":"10.1109\/EuroSP.2018.00035"},{"key":"e_1_3_2_119_2","article-title":"Practical black-box attacks against deep learning systems using adversarial examples","volume":"1602","author":"Papernot Nicolas","year":"2016","unstructured":"Nicolas Papernot, Patrick D. McDaniel, Ian J. Goodfellow, Somesh Jha, Z. Berkay Celik, and Ananthram Swami. 2016. Practical black-box attacks against deep learning systems using adversarial examples. CoRR abs\/1602.02697 (2016).","journal-title":"CoRR"},{"key":"e_1_3_2_120_2","article-title":"The limitations of deep learning in adversarial settings","volume":"1511","author":"Papernot Nicolas","year":"2015","unstructured":"Nicolas Papernot, Patrick D. McDaniel, Somesh Jha, Matt Fredrikson, Z. Berkay Celik, and Ananthram Swami. 2015. The limitations of deep learning in adversarial settings. CoRR abs\/1511.07528 (2015).","journal-title":"CoRR"},{"key":"e_1_3_2_121_2","first-page":"2825","article-title":"Scikit-learn: Machine learning in Python","volume":"12","author":"Pedregosa F.","year":"2011","unstructured":"F. Pedregosa, G. Varoquaux, A. Gramfort, V. Michel, B. Thirion, O. Grisel, M. Blondel, P. Prettenhofer, R. Weiss, V. Dubourg, J. Vanderplas, A. Passos, D. Cournapeau, M. Brucher, M. Perrot, and E. Duchesnay. 2011. Scikit-learn: Machine learning in Python. J. Mach. Learn. Res. 12 (2011), 2825\u20132830.","journal-title":"J. Mach. Learn. Res."},{"key":"e_1_3_2_122_2","first-page":"729","volume-title":"28th USENIX Security Symposium (USENIX Security\u201919)","author":"Pendlebury Feargus","year":"2019","unstructured":"Feargus Pendlebury, Fabio Pierazzi, Roberto Jordaney, Johannes Kinder, and Lorenzo Cavallaro. 2019. TESSERACT: Eliminating experimental bias in malware classification across space and time. In 28th USENIX Security Symposium (USENIX Security\u201919). USENIX Association, Santa Clara, CA, 729\u2013746. Retrieved from https:\/\/www.usenix.org\/conference\/usenixsecurity19\/presentation\/pendlebury"},{"key":"e_1_3_2_123_2","unstructured":"Ryan Permeh. 2017. True AI\/ML vs. Glorified Signature-based Solutions. Retrieved from https:\/\/threatvector.cylance.com\/en_us\/home\/true-ai-ml-vs-glorified-signature-based-solutions.html"},{"issue":"5","key":"e_1_3_2_124_2","doi-asserted-by":"crossref","first-page":"1333","DOI":"10.1109\/TIFS.2017.2787987","article-title":"Privacy-preserving deep learning via additively homomorphic encryption","volume":"13","author":"Phong L. T.","year":"2018","unstructured":"L. T. Phong, Y. Aono, T. Hayashi, L. Wang, and S. Moriai. 2018. Privacy-preserving deep learning via additively homomorphic encryption. IEEE Trans. Inf. Forens. Secur. 13, 5 (2018), 1333\u20131345.","journal-title":"IEEE Trans. Inf. Forens. Secur."},{"key":"e_1_3_2_125_2","unstructured":"Alec Radford. 2018. Improving Language Understanding by Generative Pre-Training."},{"key":"e_1_3_2_126_2","unstructured":"Edward Raff Jon Barker Jared Sylvester Robert Brandon Bryan Catanzaro and Charles Nicholas. 2017. Malware Detection by Eating a Whole EXE. Retrieved from https:\/\/arxiv.org\/abs\/1710.09435"},{"key":"e_1_3_2_127_2","article-title":"Transfusion: Understanding transfer learning with applications to medical imaging","volume":"1902","author":"Raghu Maithra","year":"2019","unstructured":"Maithra Raghu, Chiyuan Zhang, Jon M. Kleinberg, and Samy Bengio. 2019. Transfusion: Understanding transfer learning with applications to medical imaging. CoRR abs\/1902.07208 (2019).","journal-title":"CoRR"},{"key":"e_1_3_2_128_2","article-title":"A target-agnostic attack on deep models: Exploiting security vulnerabilities of transfer learning","volume":"1904","author":"Rezaei Shahbaz","year":"2019","unstructured":"Shahbaz Rezaei and Xin Liu. 2019. A target-agnostic attack on deep models: Exploiting security vulnerabilities of transfer learning. CoRR abs\/1904.04334 (2019).","journal-title":"CoRR"},{"issue":"1","key":"e_1_3_2_129_2","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1109\/TIFS.2016.2603960","article-title":"Authorship attribution for social media forensics","volume":"12","author":"Rocha A.","year":"2017","unstructured":"A. Rocha, W. J. Scheirer, C. W. Forstall, T. Cavalcante, A. Theophilo, B. Shen, A. R. B. Carvalho, and E. Stamatatos. 2017. Authorship attribution for social media forensics. IEEE Trans. Inf. Forens. Secur. 12, 1 (2017), 5\u201333.","journal-title":"IEEE Trans. Inf. Forens. Secur."},{"key":"e_1_3_2_130_2","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2019.2946162"},{"key":"e_1_3_2_131_2","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2019.2946162"},{"issue":"1","key":"e_1_3_2_132_2","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1145\/3229329.3229332","article-title":"A survey on anomaly detection in evolving data: With application to forest fire risk prediction","volume":"20","author":"Salehi Mahsa","year":"2018","unstructured":"Mahsa Salehi and Lida Rashidi. 2018. A survey on anomaly detection in evolving data: With application to forest fire risk prediction. ACM SIGKDD Explor. Newslett. 20, 1 (2018), 13\u201323.","journal-title":"ACM SIGKDD Explor. Newslett."},{"key":"e_1_3_2_133_2","unstructured":"Joshua Saxe. 2020. Sophos AI YaraML Rules Repository. Retrieved from https:\/\/github.com\/sophos-ai\/yaraml_rules"},{"key":"e_1_3_2_134_2","volume-title":"Malware Data Science: Attack Detection and Attribution","author":"Saxe Joshua","year":"2018","unstructured":"Joshua Saxe and Hillary Sanders. 2018. Malware Data Science: Attack Detection and Attribution. No Starch Press, San Francisco, CA."},{"key":"e_1_3_2_135_2","first-page":"5","article-title":"On challenges in machine learning model management","volume":"41","author":"Schelter Sebastian","year":"2018","unstructured":"Sebastian Schelter, Felix Bie\u00dfmann, Tim Januschowski, David Salinas, Stephan Seufert, and Gyuri Szarvas. 2018. On challenges in machine learning model management. IEEE Data Eng. Bull. 41 (2018), 5\u201315.","journal-title":"IEEE Data Eng. Bull."},{"key":"e_1_3_2_136_2","first-page":"582","volume-title":"12th International Conference on Neural Information Processing Systems (NIPS\u201999)","author":"Sch\u00f6lkopf Bernhard","year":"1999","unstructured":"Bernhard Sch\u00f6lkopf, Robert Williamson, Alex Smola, John Shawe-Taylor, and John Platt. 1999. Support vector method for novelty detection. In 12th International Conference on Neural Information Processing Systems (NIPS\u201999). MIT Press, Cambridge, MA, 582\u2013588."},{"key":"e_1_3_2_137_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-45719-2_11"},{"key":"e_1_3_2_138_2","unstructured":"Amazon Web Services. 2020. Amazon Machine Learning Key Concepts. Retrieved from https:\/\/docs.aws.amazon.com\/machine-learning\/latest\/dg\/amazon-machine-learning-key-concepts.html"},{"key":"e_1_3_2_139_2","article-title":"Adversarially robust transfer learning","volume":"1905","author":"Shafahi Ali","year":"2019","unstructured":"Ali Shafahi, Parsa Saadatpanah, Chen Zhu, Amin Ghiasi, Christoph Studer, David W. Jacobs, and Tom Goldstein. 2019. Adversarially robust transfer learning. CoRR abs\/1905.08232 (2019).","journal-title":"CoRR"},{"key":"e_1_3_2_140_2","doi-asserted-by":"crossref","first-page":"412","DOI":"10.1145\/2623330.2623609","volume-title":"20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD\u201914)","author":"Shao Junming","year":"2014","unstructured":"Junming Shao, Zahra Ahmadi, and Stefan Kramer. 2014. Prototype-based learning on concept-drifting data streams. In 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD\u201914). Association for Computing Machinery, New York, NY, 412\u2013421. DOI:10.1145\/2623330.2623609"},{"issue":"3","key":"e_1_3_2_141_2","doi-asserted-by":"crossref","first-page":"357","DOI":"10.1016\/j.cose.2011.12.012","article-title":"Toward developing a systematic approach to generate benchmark datasets for intrusion detection","volume":"31","author":"Shiravi Ali","year":"2012","unstructured":"Ali Shiravi, Hadi Shiravi, Mahbod Tavallaee, and Ali A. Ghorbani. 2012. Toward developing a systematic approach to generate benchmark datasets for intrusion detection. Comput. Secur. 31, 3 (2012), 357\u2013374.","journal-title":"Comput. Secur."},{"key":"e_1_3_2_142_2","article-title":"Empirical model-building and response surfaces.","volume":"37","author":"Shoesmith Eddie","year":"1987","unstructured":"Eddie Shoesmith, George E. P. Box, and Norman R. Draper. 1987. Empirical model-building and response surfaces. Statistician 37 (1987), 82.","journal-title":"Statistician"},{"key":"e_1_3_2_143_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2017.08.033"},{"key":"e_1_3_2_144_2","volume-title":"5th ACM Workshop on Security and Artificial Intelligence (AISec\u201912)","author":"Singh Anshuman","year":"2012","unstructured":"Anshuman Singh, Andrew Walenstein, and Arun Lakhotia. 2012. Tracking concept drift in malware families. In 5th ACM Workshop on Security and Artificial Intelligence (AISec\u201912). Association for Computing Machinery, New York, NY."},{"key":"e_1_3_2_145_2","volume-title":"Spark Streaming","author":"Spark Apache","year":"2020","unstructured":"Apache Spark. 2020. Spark Streaming. Retrieved from https:\/\/spark.apache.org\/streaming\/"},{"key":"e_1_3_2_146_2","unstructured":"J. Michael Steele. 2006. Models: Masterpieces and Lame Excuses. Retrieved from http:\/\/www-stat.wharton.upenn.edu\/steele\/Rants\/ModelsMandLE.html"},{"key":"e_1_3_2_147_2","first-page":"1","article-title":"A praise for defensive programming: Leveraging uncertainty for effective malware mitigation","author":"Sun R.","year":"2020","unstructured":"R. Sun, M. Botacin, N. Sapountzis, X. Yuan, M. Bishop, D. E. Porter, X. Li, A. Gregio, and D. Oliveira. 2020. A praise for defensive programming: Leveraging uncertainty for effective malware mitigation. IEEE Trans. Depend. Sec. Comput. (2020), 1\u20131.","journal-title":"IEEE Trans. Depend. Sec. Comput."},{"key":"e_1_3_2_148_2","article-title":"Going deeper with convolutions","volume":"1409","author":"Szegedy Christian","year":"2014","unstructured":"Christian Szegedy, Wei Liu, Yangqing Jia, Pierre Sermanet, Scott E. Reed, Dragomir Anguelov, Dumitru Erhan, Vincent Vanhoucke, and Andrew Rabinovich. 2014. Going deeper with convolutions. CoRR abs\/1409.4842 (2014).","journal-title":"CoRR"},{"key":"e_1_3_2_149_2","doi-asserted-by":"crossref","unstructured":"Rahim Taheri Reza Javidan Mohammad Shojafar Zahra Pooranian Ali Miri and Mauro Conti. 2019. On Defending Against Label Flipping Attacks on Malware Detection Systems. arxiv:1908.04473 [cs.LG].","DOI":"10.1007\/s00521-020-05043-x"},{"key":"e_1_3_2_150_2","first-page":"1","volume-title":"18th Panhellenic Conference on Informatics (PCI\u201914)","author":"Tasiopoulos Vasilis G.","year":"2014","unstructured":"Vasilis G. Tasiopoulos and Sokratis K. Katsikas. 2014. Bypassing antivirus detection with encryption. In 18th Panhellenic Conference on Informatics (PCI\u201914). Association for Computing Machinery, New York, NY, 1\u20132. DOI:10.1145\/2645791.2645857"},{"key":"e_1_3_2_151_2","doi-asserted-by":"crossref","first-page":"242","DOI":"10.4018\/978-1-60566-766-9.ch011","volume-title":"Handbook of Research on Machine Learning Applications and Trends: Algorithms, Methods, and Techniques","author":"Torrey Lisa","year":"2010","unstructured":"Lisa Torrey and Jude Shavlik. 2010. Transfer learning. In Handbook of Research on Machine Learning Applications and Trends: Algorithms, Methods, and Techniques. IGI Global, 242\u2013264."},{"key":"e_1_3_2_152_2","doi-asserted-by":"publisher","DOI":"10.1145\/3291061"},{"key":"e_1_3_2_153_2","unstructured":"Todd Underwood. 2019. All of Our ML Ideas Are Bad (and We Should Feel Bad). USENIX Association Dublin."},{"key":"e_1_3_2_154_2","unstructured":"VirusShare. 2019. VirusShare on Twitter. Retrieved from https:\/\/twitter.com\/VXShare\/status\/1095411986949652480"},{"key":"e_1_3_2_155_2","unstructured":"VirusTotal. 2020. VirusTotal: Free Online Virus Malware and URL Scanner. Retrieved from https:\/\/www.virustotal.com\/"},{"key":"e_1_3_2_156_2","article-title":"Machine learning that matters","volume":"1206","author":"Wagstaff Kiri","year":"2012","unstructured":"Kiri Wagstaff. 2012. Machine learning that matters. CoRR abs\/1206.4656 (2012).","journal-title":"CoRR"},{"key":"e_1_3_2_157_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.websem.2011.05.003"},{"key":"e_1_3_2_158_2","volume-title":"IEEE European Symposium on Security and Privacy (EuroSP\u201919)","author":"Xu K.","year":"2019","unstructured":"K. Xu, Y. Li, R. Deng, K. Chen, and J. Xu. 2019. DroidEvolver: Self-evolving Android malware detection system. In IEEE European Symposium on Security and Privacy (EuroSP\u201919)."},{"key":"e_1_3_2_159_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2015.01.037"},{"key":"e_1_3_2_160_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10115-018-1266-y"},{"key":"e_1_3_2_161_2","first-page":"2361","volume-title":"29th USENIX Security Symposium (USENIX Security\u201920)","author":"Zhu Shuofei","year":"2020","unstructured":"Shuofei Zhu, Jianjun Shi, Limin Yang, Boqin Qin, Ziyi Zhang, Linhai Song, and Gang Wang. 2020. Measuring and modeling the label dynamics of online anti-malware engines. In 29th USENIX Security Symposium (USENIX Security\u201920). USENIX Association, 2361\u20132378. Retrieved from https:\/\/www.usenix.org\/conference\/usenixsecurity20\/presentation\/zhu"},{"key":"e_1_3_2_162_2","doi-asserted-by":"crossref","first-page":"843","DOI":"10.1109\/ICDMW.2010.49","volume-title":"IEEE International Conference on Data Mining Workshops","author":"\u017dliobait\u00e9 I.","year":"2010","unstructured":"I. \u017dliobait\u00e9. 2010. Change with delayed labeling: When is it detectable? In IEEE International Conference on Data Mining Workshops. 843\u2013850."}],"container-title":["Digital Threats: Research and Practice"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3617897","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3617897","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T12:37:58Z","timestamp":1750163878000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3617897"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,3,21]]},"references-count":161,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2024,3,31]]}},"alternative-id":["10.1145\/3617897"],"URL":"https:\/\/doi.org\/10.1145\/3617897","relation":{},"ISSN":["2692-1626","2576-5337"],"issn-type":[{"value":"2692-1626","type":"print"},{"value":"2576-5337","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,3,21]]},"assertion":[{"value":"2022-11-30","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-08-24","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-03-21","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}