{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,8]],"date-time":"2026-10-08T11:33:33Z","timestamp":1791459213299,"version":"4.3.4"},"reference-count":85,"publisher":"Association for Computing Machinery (ACM)","issue":"ISSTA","license":[{"start":{"date-parts":[[2025,6,22]],"date-time":"2025-06-22T00:00:00Z","timestamp":1750550400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/legalcode"}],"funder":[{"DOI":"10.13039\/501100012166","name":"National Key Research and Development Program of China","doi-asserted-by":"publisher","award":["No.2021YFB3101500"],"award-info":[{"award-number":["No.2021YFB3101500"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. ACM Softw. Eng."],"published-print":{"date-parts":[[2025,6,22]]},"abstract":"<jats:p>\n                    Android malware detection remains a critical challenge in cybersecurity research. Recent advancements leverage AI techniques, particularly deep neural networks (DNNs), to train a detection model, but their effectiveness is often compromised by the pronounced imbalance among malware families in commonly used training datasets. This imbalance leads to overfitting in dominant categories and poor performance in underrepresented ones, increasing predictive uncertainty for less common malware families. To address the suboptimal performance of many DNN models, we introduce\n                    <jats:sc>MalTutor<\/jats:sc>\n                    , a novel framework that enhances model robustness through an optimized training process. Our primary insight lies in transforming uncertainties from \u201cliabilities\u201d into \u201cassets\u201d by strategically incorporating them into DNN training methodologies. Specifically, we begin by evaluating the predictive uncertainty of DNN models throughout various training epochs, which guides our sample categorization. Incorporating Curriculum Learning strategies, we commence training with easy-to-learn samples with lower uncertainty, progressively incorporating difficult-to-learn ones with higher uncertainty. Our experimental results demonstrate that\n                    <jats:sc>MalTutor<\/jats:sc>\n                    significantly improves the performance of models trained on imbalanced datasets, increasing accuracy by 31.0%, elevating the F1 score by 138.8%, and specifically boosting the average accuracy in detecting various types of malicious apps by 133.9%. Our findings provide valuable insights into the potential benefits of incorporating uncertainty to improve the robustness of DNN models for prediction-oriented software engineering tasks.\n                  <\/jats:p>","DOI":"10.1145\/3728884","type":"journal-article","created":{"date-parts":[[2025,6,22]],"date-time":"2025-06-22T10:52:56Z","timestamp":1750589576000},"page":"320-342","source":"Crossref","is-referenced-by-count":4,"title":["Understanding Model Weaknesses: A Path to Strengthening DNN-Based Android Malware Detection"],"prefix":"10.1145","volume":"2","author":[{"ORCID":"https:\/\/orcid.org\/0009-0004-1649-7549","authenticated-orcid":false,"given":"Haodong","family":"Li","sequence":"first","affiliation":[{"name":"Beijing University of Posts and Telecommunications, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5456-3827","authenticated-orcid":false,"given":"Xiao","family":"Cheng","sequence":"additional","affiliation":[{"name":"UNSW, Sydney, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8793-5367","authenticated-orcid":false,"given":"Yanjie","family":"Zhao","sequence":"additional","affiliation":[{"name":"Huazhong University of Science and Technology, Wuhan, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3310-926X","authenticated-orcid":false,"given":"Guosheng","family":"Xu","sequence":"additional","affiliation":[{"name":"Beijing University of Posts and Telecommunications, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9582-0698","authenticated-orcid":false,"given":"Guoai","family":"Xu","sequence":"additional","affiliation":[{"name":"Harbin Institute of Technology, Shenzhen, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1100-8633","authenticated-orcid":false,"given":"Haoyu","family":"Wang","sequence":"additional","affiliation":[{"name":"Huazhong University of Science and Technology, Wuhan, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2025,6,22]]},"reference":[{"key":"e_1_3_1_2_2","doi-asserted-by":"publisher","unstructured":"Mohiuddin Ahmed Raihan Seraj and Syed Mohammed Shamsul Islam. 2020. The k-means algorithm: A comprehensive survey and performance evaluation. Electronics (2020). https:\/\/doi.org\/10.3390\/electronics9081295 10.3390\/electronics9081295","DOI":"10.3390\/electronics9081295"},{"key":"e_1_3_1_3_2","doi-asserted-by":"publisher","unstructured":"Kevin Allix Tegawend\u00e9 F Bissyand\u00e9 Jacques Klein and Yves Le Traon. 2016. Androzoo: Collecting millions of android apps for the research community. In Proceedings of the 13th international conference on mining software repositories. https:\/\/doi.org\/10.1145\/2901739.2903508 10.1145\/2901739.2903508","DOI":"10.1145\/2901739.2903508"},{"key":"e_1_3_1_4_2","unstructured":"Alexander Amini Ava Soleimany Sertac Karaman and Daniela Rus. 2018. Spatial uncertainty sampling for end-to-end control. arXiv preprint arXiv:1805.04829 (2018)."},{"key":"e_1_3_1_5_2","doi-asserted-by":"publisher","unstructured":"Daniel Arp Michael Spreitzenbarth Malte Hubner Hugo Gascon Konrad Rieck and CERT Siemens. 2014. Drebin: Effective and explainable detection of android malware in your pocket. In Ndss. https:\/\/doi.org\/10.14722\/ndss.2014.23247 10.14722\/ndss.2014.23247","DOI":"10.14722\/ndss.2014.23247"},{"key":"e_1_3_1_6_2","doi-asserted-by":"publisher","unstructured":"Michael Backes and Mohammad Nauman. 2017. LUNA: quantifying and leveraging uncertainty in android malware analysis through Bayesian machine learning. In 2017 IEEE European symposium on security and privacy (euros&p). IEEE. https:\/\/doi.org\/10.1109\/EuroSP.2017.24 10.1109\/EuroSP.2017.24","DOI":"10.1109\/EuroSP.2017.24"},{"key":"e_1_3_1_7_2","doi-asserted-by":"publisher","unstructured":"Yoshua Bengio J\u00e9r\u00f4me Louradour Ronan Collobert and Jason Weston. 2009. Curriculum learning. In Proceedings of the 26th annual international conference on machine learning. https:\/\/doi.org\/10.1145\/1553374.1553380 10.1145\/1553374.1553380","DOI":"10.1145\/1553374.1553380"},{"key":"e_1_3_1_8_2","unstructured":"Charles Blundell Julien Cornebise Koray Kavukcuoglu and Daan Wierstra. 2015. Weight uncertainty in neural network. In International conference on machine learning. PMLR. https:\/\/dl.acm.org\/doi\/10.5555\/3045118.3045290"},{"key":"e_1_3_1_9_2","unstructured":"Kaidi Cao Colin Wei Adrien Gaidon Nikos Arechiga and Tengyu Ma. 2019. Learning imbalanced datasets with label-distribution-aware margin loss. Advances in neural information processing systems (2019). https:\/\/dl.acm.org\/doi\/10.5555\/3454287.3454427"},{"key":"e_1_3_1_10_2","doi-asserted-by":"crossref","unstructured":"Nitesh V Chawla Kevin W Bowyer Lawrence O Hall and W Philip Kegelmeyer. 2002. SMOTE: synthetic minority over-sampling technique. Journal of artificial intelligence research (2002). https:\/\/dl.acm.org\/doi\/10.5555\/1622407.1622416","DOI":"10.1613\/jair.953"},{"key":"e_1_3_1_11_2","unstructured":"Yizheng Chen Zhoujie Ding and David Wagner. 2023. Continuous Learning for Android Malware Detection. In 32nd USENIX Security Symposium (USENIX Security 23). USENIX Association Anaheim CA 1127\u20131144. https:\/\/www.usenix.org\/conference\/usenixsecurity23\/presentation\/chen-yizheng"},{"key":"e_1_3_1_12_2","doi-asserted-by":"publisher","unstructured":"Xiao Cheng Haoyu Wang Jiayi Hua Guoai Xu and Yulei Sui. 2021. Deepwukong: Statically detecting software vulnerabilities using deep graph neural network. ACM Transactions on Software Engineering and Methodology (TOSEM) (2021). https:\/\/doi.org\/10.1145\/3436877 10.1145\/3436877","DOI":"10.1145\/3436877"},{"key":"e_1_3_1_13_2","doi-asserted-by":"publisher","unstructured":"Volkan Cirik Eduard Hovy and Louis-Philippe Morency. 2016. Visualizing and understanding curriculum learning for long short-term memory networks. arXiv preprint arXiv:1611.06204 (2016). https:\/\/doi.org\/10.48550\/arxiv.1611.06204 10.48550\/arxiv.1611.06204","DOI":"10.48550\/arxiv.1611.06204"},{"key":"e_1_3_1_14_2","doi-asserted-by":"crossref","unstructured":"Roland Coghetto. 2016. Chebyshev distance. Formalized Mathematics (2016). https:\/\/intapi.sciendo.com\/pdf\/10.1515\/forma-2016-0010","DOI":"10.1515\/forma-2016-0010"},{"key":"e_1_3_1_15_2","doi-asserted-by":"publisher","unstructured":"Yin Cui Menglin Jia Tsung-Yi Lin Yang Song and Serge Belongie. 2019. Class-balanced loss based on effective number of samples. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition. https:\/\/doi.org\/10.1109\/CVPR.2019.00949 10.1109\/CVPR.2019.00949","DOI":"10.1109\/CVPR.2019.00949"},{"key":"e_1_3_1_16_2","doi-asserted-by":"crossref","unstructured":"Per-Erik Danielsson. 1980. Euclidean distance mapping. Computer Graphics and image processing (1980).","DOI":"10.1016\/0146-664X(80)90054-4"},{"key":"e_1_3_1_17_2","unstructured":"Canadian Institute for Cybersecurity. 2024. Canadian Institute for Cybersecurity datasets are used around the world by universities private industry and independent researchers. https:\/\/www.unb.ca\/cic\/datasets\/index.html"},{"key":"e_1_3_1_18_2","doi-asserted-by":"publisher","unstructured":"Jakob Gawlikowski Cedrique Rovile Njieutcheu Tassi Mohsin Ali Jongseok Lee Matthias Humt Jianxiang Feng Anna Kruspe Rudolph Triebel Peter Jung Ribana Roscher et al. 2023. A survey of uncertainty in deep neural networks.Artificial Intelligence Review (2023). https:\/\/doi.org\/10.1007\/s10462-023-10562-9 10.1007\/s10462-023-10562-9","DOI":"10.1007\/s10462-023-10562-9"},{"key":"e_1_3_1_19_2","doi-asserted-by":"publisher","unstructured":"Wenshu Ge Huan Ma Peizhuo Sheng and Changqing Zhang. 2024. Uncertainty-aware Dynamic Re-weighting Robust Classification. In 2024 International Joint Conference on Neural Networks (IJCNN). https:\/\/doi.org\/10.1109\/IJCNN60899.2024.10651411 10.1109\/IJCNN60899.2024.10651411","DOI":"10.1109\/IJCNN60899.2024.10651411"},{"key":"e_1_3_1_20_2","doi-asserted-by":"publisher","unstructured":"Kathrin Grosse Nicolas Papernot Praveen Manoharan Michael Backes and Patrick McDaniel. 2017. Adversarial examples for malware detection. In Computer Security\u2013ESORICS 2017: 22nd European Symposium on Research in Computer Security. Springer. https:\/\/doi.org\/10.1007\/978-3-319-66399-9_4 10.1007\/978-3-319-66399-9_4","DOI":"10.1007\/978-3-319-66399-9_4"},{"key":"e_1_3_1_21_2","doi-asserted-by":"publisher","unstructured":"Isredza Rahmi A Hamid Nur Syafiqah Khalid Nurul Azma Abdullah Nurul Hidayah Ab Rahman and Chuah Chai Wen. 2017. Android Malware classification using K-means Clustering algorithm. In IOP Conference Series: Materials Science and Engineering. IOP Publishing. https:\/\/doi.org\/10.1088\/1757-899X\/226\/1\/012105 10.1088\/1757-899X\/226\/1\/012105","DOI":"10.1088\/1757-899X\/226\/1\/012105"},{"key":"e_1_3_1_22_2","doi-asserted-by":"publisher","unstructured":"Haibo He and Edwardo A Garcia. 2009. Learning from imbalanced data. IEEE Transactions on knowledge and data engineering (2009). https:\/\/doi.org\/10.1109\/TKDE.2008.239 10.1109\/TKDE.2008.239","DOI":"10.1109\/TKDE.2008.239"},{"key":"e_1_3_1_23_2","doi-asserted-by":"publisher","unstructured":"Donghui Hu Zhongjin Ma Xiaotian Zhang Peipei Li Dengpan Ye Baohong Ling et al. 2017. The concept drift problem in Android malware detection and its solution. Security and Communication Networks (2017). https:\/\/doi.org\/10.1155\/2017\/4956386 10.1155\/2017\/4956386","DOI":"10.1155\/2017\/4956386"},{"key":"e_1_3_1_24_2","doi-asserted-by":"publisher","unstructured":"Chen Huang Yining Li Chen Change Loy and Xiaoou Tang. 2016. Learning Deep Representation for Imbalanced Classification. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). https:\/\/doi.org\/10.1109\/CVPR.2016.580 10.1109\/CVPR.2016.580","DOI":"10.1109\/CVPR.2016.580"},{"key":"e_1_3_1_25_2","doi-asserted-by":"publisher","unstructured":"Chen Huang Yining Li Chen Change Loy and Xiaoou Tang. 2019. Deep imbalanced learning for face recognition and attribute prediction. IEEE transactions on pattern analysis and machine intelligence (2019). https:\/\/doi.org\/10.1109\/TPAMI.2019.2914680 10.1109\/TPAMI.2019.2914680","DOI":"10.1109\/TPAMI.2019.2914680"},{"key":"e_1_3_1_26_2","doi-asserted-by":"publisher","unstructured":"Eyke H\u00fcllermeier and Willem Waegeman. 2021. Aleatoric and epistemic uncertainty in machine learning: An introduction to concepts and methods. Machine learning (2021). https:\/\/doi.org\/10.1007\/s10994-021-05946-3 10.1007\/s10994-021-05946-3","DOI":"10.1007\/s10994-021-05946-3"},{"key":"e_1_3_1_27_2","doi-asserted-by":"publisher","unstructured":"Jae-wook Jang Huy Kang Kim et al. 2016. Function-oriented mobile malware analysis as first aid. Mobile Information Systems (2016). https:\/\/doi.org\/10.1155\/2016\/6707524 10.1155\/2016\/6707524","DOI":"10.1155\/2016\/6707524"},{"key":"e_1_3_1_28_2","doi-asserted-by":"publisher","unstructured":"Hyunjae Kang Jae-wook Jang Aziz Mohaisen and Huy Kang Kim. 2015. Detecting and classifying android malware using static analysis along with creator information. International Journal of Distributed Sensor Networks (2015). https:\/\/doi.org\/10.1155\/2015\/479174 10.1155\/2015\/479174","DOI":"10.1155\/2015\/479174"},{"key":"e_1_3_1_29_2","doi-asserted-by":"publisher","unstructured":"ElMouatez Billah Karbab Mourad Debbabi Abdelouahid Derhab and Djedjiga Mouheb. 2018. MalDozer: Automatic framework for android malware detection using deep learning. Digital Investigation (2018). https:\/\/doi.org\/10.1016\/j.diin.2018.01.007 10.1016\/j.diin.2018.01.007","DOI":"10.1016\/j.diin.2018.01.007"},{"key":"e_1_3_1_30_2","unstructured":"Alex Kendall and Yarin Gal. 2017. What uncertainties do we need in bayesian deep learning for computer vision? Advances in neural information processing systems (2017). https:\/\/dl.acm.org\/doi\/10.5555\/3295222.3295309"},{"key":"e_1_3_1_31_2","doi-asserted-by":"publisher","unstructured":"Jan M K\u00f6hler Maximilian Autenrieth and William H Beluch. 2019. Uncertainty Based Detection and Relabeling of Noisy Image Labels.. In CVPR Workshops. https:\/\/doi.org\/10.48550\/arXiv.1906.11876 10.48550\/arXiv.1906.11876","DOI":"10.48550\/arXiv.1906.11876"},{"key":"e_1_3_1_32_2","doi-asserted-by":"crossref","unstructured":"Solomon Kullback and Richard A Leibler. 1951. On information and sufficiency. The annals of mathematical statistics (1951). https:\/\/www.researchgate.net\/publication\/2820405_On_Information_and_Sufficiency","DOI":"10.1214\/aoms\/1177729694"},{"key":"e_1_3_1_33_2","unstructured":"Balaji Lakshminarayanan Alexander Pritzel and Charles Blundell. 2017. Simple and scalable predictive uncertainty estimation using deep ensembles. Advances in neural information processing systems (2017). https:\/\/dl.acm.org\/doi\/10.5555\/3295222.3295387"},{"key":"e_1_3_1_34_2","doi-asserted-by":"publisher","unstructured":"Arash Habibi Lashkari Andi Fitriah A Kadir Hugo Gonzalez Kenneth Fon Mbah and Ali A Ghorbani. 2017. Towards a network-based framework for android malware detection and characterization. In 2017 15th Annual conference on privacy security and trust (PST). IEEE. https:\/\/doi.org\/10.1109\/PST.2017.00035 10.1109\/PST.2017.00035","DOI":"10.1109\/PST.2017.00035"},{"key":"e_1_3_1_35_2","doi-asserted-by":"publisher","unstructured":"Arash Habibi Lashkari Andi Fitriah A Kadir Laya Taheri and Ali A Ghorbani. 2018. Toward developing a systematic approach to generate benchmark android malware datasets and classification. In 2018 International Carnahan conference on security technology (ICCST). IEEE. https:\/\/doi.org\/10.1109\/CCST.2018.8585560 10.1109\/CCST.2018.8585560","DOI":"10.1109\/CCST.2018.8585560"},{"key":"e_1_3_1_36_2","doi-asserted-by":"publisher","unstructured":"Deqiang Li Tian Qiu Shuo Chen Qianmu Li and Shouhuai Xu. 2021. Can we leverage predictive uncertainty to detect dataset shift and adversarial examples in android malware detection?. In Annual Computer Security Applications Conference. https:\/\/doi.org\/10.1145\/3485832.3485916 10.1145\/3485832.3485916","DOI":"10.1145\/3485832.3485916"},{"key":"e_1_3_1_37_2","doi-asserted-by":"publisher","unstructured":"Dongfang Li Zhaoguo Wang and Yibo Xue. 2018. Fine-grained android malware detection based on deep learning. In 2018 IEEE Conference on Communications and Network Security (CNS). IEEE. https:\/\/doi.org\/10.1109\/CNS.2018.8433204 10.1109\/CNS.2018.8433204","DOI":"10.1109\/CNS.2018.8433204"},{"key":"e_1_3_1_38_2","doi-asserted-by":"publisher","unstructured":"Haodong Li Xiao Cheng Guohan Zhang Guosheng Xu Guoai Xu and Haoyu Wang. 2025. Mitigating Emergent Malware Label Noise in DNN-Based Android Malware Detection. Proceedings of the ACM on Software Engineering 2 FSE (2025). https:\/\/doi.org\/10.1145\/3715769 10.1145\/3715769","DOI":"10.1145\/3715769"},{"key":"e_1_3_1_39_2","doi-asserted-by":"publisher","unstructured":"Haodong Li Guosheng Xu Liu Wang Xusheng Xiao Xiapu Luo Guoai Xu and Haoyu Wang. 2024. MalCertain: Enhancing Deep Neural Network Based Android Malware Detection by Tackling Prediction Uncertainty. In Proceedings of the IEEE\/ACM 46th International Conference on Software Engineering. https:\/\/doi.org\/10.1145\/3597503.3639122 10.1145\/3597503.3639122","DOI":"10.1145\/3597503.3639122"},{"key":"e_1_3_1_40_2","doi-asserted-by":"publisher","unstructured":"Li Li Daoyuan Li Tegawend\u00e9 F Bissyand\u00e9 Jacques Klein Yves Le Traon David Lo and Lorenzo Cavallaro. 2017. Understanding android app piggybacking: A systematic study of malicious code grafting. IEEE Transactions on Information Forensics and Security (2017). https:\/\/doi.org\/10.1109\/TIFS.2017.2656460 10.1109\/TIFS.2017.2656460","DOI":"10.1109\/TIFS.2017.2656460"},{"key":"e_1_3_1_41_2","doi-asserted-by":"publisher","unstructured":"Guanjun Lin Sheng Wen Qing-Long Han Jun Zhang and Yang Xiang. 2020. Software vulnerability detection using deep neural networks: a survey. Proc. IEEE (2020). https:\/\/doi.org\/10.1109\/JPROC.2020.2993293 10.1109\/JPROC.2020.2993293","DOI":"10.1109\/JPROC.2020.2993293"},{"key":"e_1_3_1_42_2","doi-asserted-by":"publisher","unstructured":"Zhuo Ma Haoran Ge Zhuzhu Wang Yang Liu and Ximeng Liu. 2020. Droidetec: Android malware detection and malicious code localization through deep learning. arXiv preprint arXiv:2002.03594 (2020). https:\/\/doi.org\/10.48550\/arXiv.2002.03594 10.48550\/arXiv.2002.03594","DOI":"10.48550\/arXiv.2002.03594"},{"key":"e_1_3_1_43_2","doi-asserted-by":"publisher","unstructured":"Samaneh Mahdavifar Dima Alhadidi and Ali A Ghorbani. 2022. Effective and efficient hybrid android malware classification using pseudo-label stacked auto-encoder. Journal of network and systems management (2022). https:\/\/doi.org\/10.1007\/s10922-021-09634-4 10.1007\/s10922-021-09634-4","DOI":"10.1007\/s10922-021-09634-4"},{"key":"e_1_3_1_44_2","doi-asserted-by":"publisher","unstructured":"Sebasti\u00e1n Maldonado Julio L\u00f3pez and Carla Vairetti. 2019. An alternative SMOTE oversampling strategy for high-dimensional datasets. Applied Soft Computing (2019). https:\/\/doi.org\/10.1016\/j.asoc.2018.12.024 10.1016\/j.asoc.2018.12.024","DOI":"10.1016\/j.asoc.2018.12.024"},{"key":"e_1_3_1_45_2","unstructured":"MalTutor. 2025. (Artifact) Understanding Model Weaknesses: A Path to Strengthening DNN-Based Android Malware Detection. https:\/\/github.com\/Dirtyboy1029\/MALTUTOR."},{"key":"e_1_3_1_46_2","unstructured":"Gilberto Manunza Matteo Pagliardini Martin Jaggi and Tatjana Chavdarova. 2021. Improved Adversarial Robustness via Uncertainty Targeted Attacks. In ICML Workshop on Uncertainty and Robustness in Deep Learning. https:\/\/icml.cc\/virtual\/2021\/12413"},{"key":"e_1_3_1_47_2","doi-asserted-by":"publisher","unstructured":"Niall McLaughlin Jesus Martinez del Rincon BooJoong Kang Suleiman Yerima Paul Miller Sakir Sezer Yeganeh Safaei Erik Trickel Ziming Zhao Adam Doup\u00e9 and Gail Joon Ahn. 2017. Deep Android Malware Detection. In Proceedings of the Seventh ACM on Conference on Data and Application Security and Privacy (Scottsdale Arizona USA) (CODASPY \u201917). Association for Computing Machinery New York NY USA. https:\/\/doi.org\/10.1145\/3029806.3029823 10.1145\/3029806.3029823","DOI":"10.1145\/3029806.3029823"},{"key":"e_1_3_1_48_2","doi-asserted-by":"publisher","unstructured":"Tom\u00e1s Concepci\u00f3n Miranda Pierre-Francois Gimenez Jean-Fran\u00e7ois Lalande Val\u00e9rie Viet Triem Tong and Pierre Wilke. 2022. Debiasing android malware datasets: How can i trust your results if your dataset is biased? IEEE Transactions on Information Forensics and Security (2022). https:\/\/doi.org\/10.1109\/TIFS.2022.3180184 10.1109\/TIFS.2022.3180184","DOI":"10.1109\/TIFS.2022.3180184"},{"key":"e_1_3_1_49_2","doi-asserted-by":"publisher","unstructured":"Aiswarya Raj Munappy Jan Bosch Helena Holmstr\u00f6m Olsson Anders Arpteg and Bj\u00f6rn Brinne. 2022. Data management for production quality deep learning models: Challenges and solutions. Journal of Systems and Software (2022). https:\/\/doi.org\/10.1016\/j.jss.2022.111359 10.1016\/j.jss.2022.111359","DOI":"10.1016\/j.jss.2022.111359"},{"key":"e_1_3_1_50_2","doi-asserted-by":"publisher","unstructured":"Andre T Nguyen Fred Lu Gary Lopez Munoz Edward Raff Charles Nicholas and James Holt. 2022. Out of distribution data detection using dropout bayesian neural networks. In Proceedings of the AAAI Conference on Artificial Intelligence. https:\/\/doi.org\/10.1609\/aaai.v36i7.20757 10.1609\/aaai.v36i7.20757","DOI":"10.1609\/aaai.v36i7.20757"},{"key":"e_1_3_1_51_2","doi-asserted-by":"publisher","unstructured":"Rolf Niedermeier and Peter Sanders. 1996. On the Manhattan Distance Between Points on Space Filling Mesh Indexings. Citeseer. https:\/\/doi.org\/10.5445\/IR\/17796 10.5445\/IR\/17796","DOI":"10.5445\/IR\/17796"},{"key":"e_1_3_1_52_2","doi-asserted-by":"publisher","unstructured":"Curtis Northcutt Lu Jiang and Isaac Chuang. 2021. Confident learning: Estimating uncertainty in dataset labels. Journal of Artificial Intelligence Research (2021). https:\/\/doi.org\/10.1613\/jair.1.12125 10.1613\/jair.1.12125","DOI":"10.1613\/jair.1.12125"},{"key":"e_1_3_1_53_2","doi-asserted-by":"publisher","unstructured":"Rajvardhan Oak Min Du David Yan Harshvardhan Takawale and Idan Amit. 2019. Malware detection on highly imbalanced data through sequence modeling. In Proceedings of the 12th ACM Workshop on artificial intelligence and security. https:\/\/doi.org\/10.1145\/3338501.3357374 10.1145\/3338501.3357374","DOI":"10.1145\/3338501.3357374"},{"key":"e_1_3_1_54_2","unstructured":"Yaniv Ovadia Emily Fertig Jie Ren Zachary Nado David Sculley Sebastian Nowozin Joshua Dillon Balaji Lakshminarayanan and Jasper Snoek. 2019. Can you trust your model\u2019s uncertainty? evaluating predictive uncertainty under dataset shift. Advances in neural information processing systems (2019). https:\/\/dl.acm.org\/doi\/10.5555\/3454287.3455541"},{"key":"e_1_3_1_55_2","doi-asserted-by":"publisher","unstructured":"Samira Pouyanfar Yudong Tao Anup Mohan Haiman Tian Ahmed S Kaseb Kent Gauen Ryan Dailey Sarah Aghajanzadeh Yung-Hsiang Lu Shu-Ching Chen et al. 2018. Dynamic sampling in convolutional neural networks for imbalanced data classification. In 2018 IEEE conference on multimedia information processing and retrieval (MIPR). IEEE. https:\/\/doi.org\/10.1109\/MIPR.2018.00027 10.1109\/MIPR.2018.00027","DOI":"10.1109\/MIPR.2018.00027"},{"key":"e_1_3_1_56_2","unstructured":"David M. W. Powers. 2020. Evaluation: from precision recall and F-measure to ROC informedness markedness and correlation. CoRR (2020). arXiv:2010.16061 https:\/\/arxiv.org\/abs\/2010.16061"},{"key":"e_1_3_1_57_2","doi-asserted-by":"publisher","unstructured":"Junyang Qiu Jun Zhang Wei Luo Lei Pan Surya Nepal and Yang Xiang. 2020. A Survey of Android Malware Detection with Deep Neural Models. (2020). https:\/\/doi.org\/10.1145\/3417978 10.1145\/3417978","DOI":"10.1145\/3417978"},{"key":"e_1_3_1_58_2","doi-asserted-by":"publisher","unstructured":"Aiman A Abu Samra Kangbin Yim and Osama A Ghanem. 2013. Analysis of clustering technique in android malware detection. In 2013 Seventh International Conference on Innovative Mobile and Internet Services in Ubiquitous Computing. IEEE. https:\/\/doi.org\/10.1109\/IMIS.2013.111 10.1109\/IMIS.2013.111","DOI":"10.1109\/IMIS.2013.111"},{"key":"e_1_3_1_59_2","doi-asserted-by":"publisher","unstructured":"Marcos Sebasti\u00e1n Richard Rivera Platon Kotzias and Juan Caballero. 2016. Avclass: A tool for massive malware labeling. In Research in Attacks Intrusions and Defenses: 19th International Symposium RAID 2016 Paris France September 19-21 2016 Proceedings 19. Springer. https:\/\/doi.org\/10.1007\/978-3-319-45719-2_11 10.1007\/978-3-319-45719-2_11","DOI":"10.1007\/978-3-319-45719-2_11"},{"key":"e_1_3_1_60_2","unstructured":"Valentin I Spitkovsky Hiyan Alshawi and Dan Jurafsky. 2010. From baby steps to leapfrog: How \u201cless is more\u201d in unsupervised dependency parsing. In Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics. https:\/\/aclanthology.org\/N10-1116\/"},{"key":"e_1_3_1_61_2","doi-asserted-by":"publisher","unstructured":"Nan Sun Jun Zhang Paul Rimba Shang Gao Leo Yu Zhang and Yang Xiang. 2019. Data-Driven Cybersecurity Incident Prediction: A Survey. IEEE Communications Surveys & Tutorials (2019). https:\/\/doi.org\/10.1109\/COMST.2018.2885561 10.1109\/COMST.2018.2885561","DOI":"10.1109\/COMST.2018.2885561"},{"key":"e_1_3_1_62_2","doi-asserted-by":"publisher","unstructured":"Seba Susan and Amitesh Kumar. 2021. The balancing trick: Optimized sampling of imbalanced datasets\u2014A brief survey of the recent State of the Art. Engineering Reports (2021). https:\/\/doi.org\/10.1002\/eng2.12298 10.1002\/eng2.12298","DOI":"10.1002\/eng2.12298"},{"key":"e_1_3_1_63_2","unstructured":"Alanna Titterington. 2023. \u201cGoogle Play malware clocks up more than 600 million downloads in 2023\u201d. https:\/\/usa.kaspersky.com\/blog\/malware-in-google-play-2023\/29356\/."},{"key":"e_1_3_1_64_2","doi-asserted-by":"publisher","unstructured":"Radu Tudor Ionescu Bogdan Alexe Marius Leordeanu Marius Popescu Dim P Papadopoulos and Vittorio Ferrari. 2016. How hard can it be? Estimating the difficulty of visual search in an image. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. https:\/\/doi.org\/10.1109\/CVPR.2016.237 10.1109\/CVPR.2016.237","DOI":"10.1109\/CVPR.2016.237"},{"key":"e_1_3_1_65_2","doi-asserted-by":"publisher","unstructured":"Gerald Turkewitz and Patricia A Kenny. 1982. Limitations on input as a basis for neural organization and perceptual development: A preliminary theoretical statement. Developmental Psychobiology: The Journal of the International Society for Developmental Psychobiology (1982). https:\/\/doi.org\/10.1002\/dev.420150408 10.1002\/dev.420150408","DOI":"10.1002\/dev.420150408"},{"key":"e_1_3_1_66_2","unstructured":"Virustotal. 2025. \u201cVirusTotal\u201d. https:\/\/www.virustotal.com\/."},{"key":"e_1_3_1_67_2","doi-asserted-by":"publisher","unstructured":"Chengyi Wang Yu Wu Shujie Liu Ming Zhou and Zhenglu Yang. 2020. Curriculum Pre-training for End-to-End Speech Translation. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics Dan Jurafsky Joyce Chai Natalie Schluter and Joel Tetreault (Eds.). Association for Computational Linguistics Online 3728\u20133738. https:\/\/doi.org\/10.18653\/v1\/2020.acl-main.344 10.18653\/v1\/2020.acl-main.344","DOI":"10.18653\/v1\/2020.acl-main.344"},{"key":"e_1_3_1_68_2","doi-asserted-by":"publisher","unstructured":"Haoyu Wang Junjun Si Hao Li and Yao Guo. 2019. Rmvdroid: towards a reliable android malware dataset with app metadata. In 2019 IEEE\/ACM 16th international conference on mining software repositories (MSR). IEEE. https:\/\/doi.org\/10.1109\/MSR.2019.00067 10.1109\/MSR.2019.00067","DOI":"10.1109\/MSR.2019.00067"},{"key":"e_1_3_1_69_2","doi-asserted-by":"publisher","unstructured":"Ji Wang Qi Jing Jianbo Gao and Xuanwei Qiu. 2020. SEdroid: A Robust Android Malware Detector using Selective Ensemble Learning. In 2020 IEEE Wireless Communications and Networking Conference (WCNC). https:\/\/doi.org\/10.1109\/WCNC45663.2020.9120537 10.1109\/WCNC45663.2020.9120537","DOI":"10.1109\/WCNC45663.2020.9120537"},{"key":"e_1_3_1_70_2","doi-asserted-by":"publisher","unstructured":"Liu Wang Haoyu Wang Ren He Ran Tao Guozhu Meng Xiapu Luo and Xuanzhe Liu. 2022. MalRadar: Demystifying android malware in the new era. Proceedings of the ACM on Measurement and Analysis of Computing Systems (2022). https:\/\/doi.org\/10.1145\/3530906 10.1145\/3530906","DOI":"10.1145\/3530906"},{"key":"e_1_3_1_71_2","doi-asserted-by":"publisher","unstructured":"Liu Wang Haoyu Wang Xiapu Luo and Yulei Sui. 2022. MalWhiteout: Reducing Label Errors in Android Malware Detection. In Proceedings of the 37th IEEE\/ACM International Conference on Automated Software Engineering. https:\/\/doi.org\/10.1145\/3551349.3560418 10.1145\/3551349.3560418","DOI":"10.1145\/3551349.3560418"},{"key":"e_1_3_1_72_2","doi-asserted-by":"publisher","unstructured":"Xin Wang Yudong Chen and Wenwu Zhu. 2021. A survey on curriculum learning. IEEE Transactions on Pattern Analysis and Machine Intelligence (2021). https:\/\/doi.org\/10.1109\/TPAMI.2021.3069908 10.1109\/TPAMI.2021.3069908","DOI":"10.1109\/TPAMI.2021.3069908"},{"key":"e_1_3_1_73_2","unstructured":"Yu-Xiong Wang Deva Ramanan and Martial Hebert. 2017. Learning to Model the Tail. In Advances in Neural Information Processing Systems Vol. 30. Curran Associates Inc."},{"key":"e_1_3_1_74_2","doi-asserted-by":"publisher","unstructured":"Fengguo Wei Yuping Li Sankardas Roy Xinming Ou and Wu Zhou. 2017. Deep ground truth analysis of current android malware. In Detection of Intrusions and Malware and Vulnerability Assessment: 14th International Conference DIMVA 2017 Bonn Germany July 6-7 2017 Proceedings 14. Springer. https:\/\/doi.org\/10.1007\/978-3-319-60876-1_12 10.1007\/978-3-319-60876-1_12","DOI":"10.1007\/978-3-319-60876-1_12"},{"key":"e_1_3_1_75_2","doi-asserted-by":"publisher","unstructured":"Jiande Wu and Chindo Hicks. 2021. Breast cancer type classification using machine learning. Journal of personalized medicine 11 2 (2021) 61. https:\/\/doi.org\/10.1109\/EBBT.2018.8391453 10.1109\/EBBT.2018.8391453","DOI":"10.1109\/EBBT.2018.8391453"},{"key":"e_1_3_1_76_2","doi-asserted-by":"publisher","unstructured":"Xian Wu Wenbo Guo Jia Yan Baris Coskun and Xinyu Xing. 2023. From Grim Reality to Practical Solution: Malware Classification in Real-World Noise. In 2023 IEEE Symposium on Security and Privacy (SP). IEEE Computer Society. https:\/\/doi.org\/10.1109\/SP46215.2023.10179453 10.1109\/SP46215.2023.10179453","DOI":"10.1109\/SP46215.2023.10179453"},{"key":"e_1_3_1_77_2","doi-asserted-by":"publisher","unstructured":"Zhiwu Xu Kerong Ren Shengchao Qin and Florin Craciun. 2018. CDGDroid: Android malware detection based on deep learning using CFG and DFG. In Formal Methods and Software Engineering: 20th International Conference on Formal Engineering Methods. https:\/\/doi.org\/10.1007\/978-3-030-02450-5_11 10.1007\/978-3-030-02450-5_11","DOI":"10.1007\/978-3-030-02450-5_11"},{"key":"e_1_3_1_78_2","unstructured":"Limin Yang Wenbo Guo Qingying Hao Arridhana Ciptadi Ali Ahmadzadeh Xinyu Xing and Gang Wang. 2021. {CADE}: Detecting and explaining concept drift samples for security applications. In 30th USENIX Security Symposium (USENIX Security 21). 2327\u20132344. https:\/\/www.usenix.org\/conference\/usenixsecurity21\/presentation\/yang-limin"},{"key":"e_1_3_1_79_2","doi-asserted-by":"publisher","unstructured":"Xu Yang Shaowei Wang Yi Li and Shaohua Wang. 2023. Does data sampling improve deep learning-based vulnerability detection? Yeas! and Nays!. In 2023 IEEE\/ACM 45th International Conference on Software Engineering (ICSE). IEEE 2287\u20132298. https:\/\/doi.org\/10.1109\/ICSE48619.2023.00192 10.1109\/ICSE48619.2023.00192","DOI":"10.1109\/ICSE48619.2023.00192"},{"key":"e_1_3_1_80_2","doi-asserted-by":"publisher","unstructured":"Hengshuai Yao Dong-lai Zhu Bei Jiang and Peng Yu. 2020. Negative log likelihood ratio loss for deep neural network classification. In Proceedings of the Future Technologies Conference (FTC) 2019: Volume 1. Springer. https:\/\/doi.org\/10.1007\/978-3-030-32520-6_22 10.1007\/978-3-030-32520-6_22","DOI":"10.1007\/978-3-030-32520-6_22"},{"key":"e_1_3_1_81_2","doi-asserted-by":"publisher","unstructured":"Xiyue Zhang Xiaofei Xie Lei Ma Xiaoning Du Qiang Hu Yang Liu Jianjun Zhao and Meng Sun. 2020. Towards characterizing adversarial defects of deep learning software from the lens of uncertainty. In Proceedings of the ACM\/IEEE 42nd International Conference on Software Engineering. https:\/\/doi.org\/10.1145\/3377811.3380368 10.1145\/3377811.3380368","DOI":"10.1145\/3377811.3380368"},{"key":"e_1_3_1_82_2","doi-asserted-by":"publisher","unstructured":"Yanjie Zhao Li Li Haoyu Wang Haipeng Cai Tegawend\u00e9 F Bissyand\u00e9 Jacques Klein and John Grundy. 2021. On the impact of sample duplication in machine-learning-based android malware detection. ACM Transactions on Software Engineering and Methodology (TOSEM) (2021). https:\/\/doi.org\/10.1145\/3446905 10.1145\/3446905","DOI":"10.1145\/3446905"},{"key":"e_1_3_1_83_2","doi-asserted-by":"publisher","unstructured":"Jingnan Zheng Jiahao Liu An Zhang Jun Zeng Ziqi Yang Zhenkai Liang and Tat-Seng Chua. 2024. MaskDroid: Robust Android Malware Detection with Masked Graph Representations (ASE \u201924). Association for Computing Machinery New York NY USA. https:\/\/doi.org\/10.1145\/3691620.3695008 10.1145\/3691620.3695008","DOI":"10.1145\/3691620.3695008"},{"key":"e_1_3_1_84_2","doi-asserted-by":"publisher","unstructured":"Yajin Zhou and Xuxian Jiang. 2012. Dissecting android malware: Characterization and evolution. In 2012 IEEE symposium on security and privacy. IEEE. https:\/\/doi.org\/10.1109\/SP.2012.16 10.1109\/SP.2012.16","DOI":"10.1109\/SP.2012.16"},{"key":"e_1_3_1_85_2","unstructured":"Hongyu Zhu and Xizhao Wang. [n. d.]. A cost-sensitive semi-supervised learning model based on uncertainty. Neurocomputing ([n. d.]). https:\/\/www.sciencedirect.com\/science\/article\/pii\/S092523121730680X"},{"key":"e_1_3_1_86_2","unstructured":"Shuofei Zhu Jianjun Shi Limin Yang Boqin Qin Ziyi Zhang Linhai Song and Gang Wang. 2020. Measuring and modeling the label dynamics of online {Anti-Malware} engines. In 29th USENIX Security Symposium (USENIX Security 20). https:\/\/dl.acm.org\/doi\/10.5555\/3489212.3489345"}],"container-title":["Proceedings of the ACM on Software Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3728884","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,23]],"date-time":"2026-08-23T13:51:05Z","timestamp":1787493065000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3728884"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,22]]},"references-count":85,"journal-issue":{"issue":"ISSTA","published-print":{"date-parts":[[2025,6,22]]}},"alternative-id":["10.1145\/3728884"],"URL":"https:\/\/doi.org\/10.1145\/3728884","relation":{},"ISSN":["2994-970X"],"issn-type":[{"value":"2994-970X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,6,22]]}}}