{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,21]],"date-time":"2026-01-21T02:15:58Z","timestamp":1768961758254,"version":"3.49.0"},"reference-count":112,"publisher":"Association for Computing Machinery (ACM)","issue":"2","funder":[{"name":"European Research Council (ERC) under the European Union\u2019s Horizon 2020 research and innovation program","award":["949014"],"award-info":[{"award-number":["949014"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Softw. Eng. Methodol."],"published-print":{"date-parts":[[2026,2,28]]},"abstract":"<jats:p>The widespread adoption of Deep Neural Networks (DNNs) has brought remarkable advances in machine learning. However, the computational and memory demands of complex DNNs hinder their deployment in resource-constrained environments. To address this challenge, compressed DNN models have emerged, offering a compromise between efficiency and accuracy. Nonetheless, assessing the performance of these compressed models can demand extensive testing, typically requiring high manual labeling costs, rendering the process resource-intensive and time-consuming. To mitigate these challenges, test input prioritization has emerged as a promising technique aimed at reducing labeling costs by prioritizing inputs that are more likely to be misclassified. This enables the early identification of bug-revealing tests with reduced time and manual labeling effort. In this article, we propose PriCod, a novel test prioritization approach designed for compressed DNNs. PriCod leverages the behavior disparities caused by model compression, along with the embeddings of test inputs, to effectively prioritize potentially misclassified tests. It operates on the premises that significant behavior disparities between the models indicate potential misclassifications and that inputs near decision boundaries are more likely to be misclassified. To this end, PriCod generates two types of features for each test input (i.e., deviation features and embedding features) to capture the prediction deviation caused by model compression and the proximity to decision boundaries, respectively. By combining these features, PriCod predicts the probability of misclassification for each test, ranking tests accordingly. We conduct an extensive study to evaluate the effectiveness of PriCod, comparing it with multiple test prioritization approaches. The experimental results demonstrate the effectiveness of PriCod, with average improvements of 7.43%\u201355.89% on natural test inputs, 7.92%\u201352.91% on noisy test inputs, and 7.03%\u201351.59% on adversarial test inputs, compared with existing test prioritization approaches.<\/jats:p>","DOI":"10.1145\/3730435","type":"journal-article","created":{"date-parts":[[2025,4,18]],"date-time":"2025-04-18T10:41:21Z","timestamp":1744972881000},"page":"1-48","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["PriCod: Prioritizing Test Inputs for Compressed Deep Neural Networks"],"prefix":"10.1145","volume":"35","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1390-0393","authenticated-orcid":false,"given":"Yinghua","family":"Li","sequence":"first","affiliation":[{"name":"University of Luxembourg, Luxembourg, Luxembourg"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4097-9543","authenticated-orcid":false,"given":"Xueqi","family":"Dang","sequence":"additional","affiliation":[{"name":"University of Luxembourg, Luxembourg, Luxembourg"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4052-475X","authenticated-orcid":false,"given":"Jacques","family":"Klein","sequence":"additional","affiliation":[{"name":"University of Luxembourg, Luxembourg, Luxembourg"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1045-4861","authenticated-orcid":false,"given":"Yves Le","family":"Traon","sequence":"additional","affiliation":[{"name":"University of Luxembourg, Luxembourg, Luxembourg"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7270-9869","authenticated-orcid":false,"given":"Tegawend\u00e9 F.","family":"Bissyand\u00e9","sequence":"additional","affiliation":[{"name":"University of Luxembourg, Luxembourg, Luxembourg"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2026,1,20]]},"reference":[{"key":"e_1_3_2_2_2","first-page":"3182","volume-title":"IEEE Transactions on Software Engineering","author":"Aghababaeyan Zohreh","year":"2023","unstructured":"Zohreh Aghababaeyan, Manel Abdellatif, Lionel Briand, S. Ramesh, and Mojtaba Bagherzadeh. 2023. Black-box testing of deep neural networks through test case diversity. IEEE Transactions on Software Engineering 49 (2023), 3182\u20133204."},{"key":"e_1_3_2_3_2","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1109\/AITest58265.2023.00015","volume-title":"2023 IEEE International Conference on Artificial Intelligence Testing (AITest)","author":"Al-Qadasi Hamzah","year":"2023","unstructured":"Hamzah Al-Qadasi, Yli\u00e8s Falcone, and Saddek Bensalem. 2023. Difficulty and severity-oriented metrics for test prioritization in deep learning systems. In 2023 IEEE International Conference on Artificial Intelligence Testing (AITest). IEEE, 40\u201348."},{"key":"e_1_3_2_4_2","first-page":"1","volume-title":"2023 IEEE Conference on Software Testing, Verification and Validation (ICST)","author":"Alshahwan Nadia","year":"2023","unstructured":"Nadia Alshahwan, Mark Harman, and Alexandru Marginean. 2023. Software testing research challenges: An industrial perspective. In 2023 IEEE Conference on Software Testing, Verification and Validation (ICST). IEEE, 1\u201310."},{"key":"e_1_3_2_5_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s10462-018-9654-y","article-title":"A review on deep learning for recommender systems: Challenges and remedies","volume":"52","author":"Batmaz Zeynep","year":"2019","unstructured":"Zeynep Batmaz, Ali Yurekli, Alper Bilge, and Cihan Kaleli. 2019. A review on deep learning for recommender systems: Challenges and remedies. Artificial Intelligence Review 52 (2019), 1\u201337.","journal-title":"Artificial Intelligence Review"},{"key":"e_1_3_2_6_2","unstructured":"Tom B. Brown Dandelion Man\u00e9 Aurko Roy Mart\u00edn Abadi and Justin Gilmer. 2017. Adversarial patch. arXiv:1712.09665. Retrieved from https:\/\/arxiv.org\/abs\/1712.09665"},{"key":"e_1_3_2_7_2","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1109\/AITest.2019.000-6","volume-title":"2019 IEEE International Conference on Artificial Intelligence Testing (AITest)","author":"Byun Taejoon","year":"2019","unstructured":"Taejoon Byun, Vaibhav Sharma, Abhishek Vijayakumar, Sanjai Rayadurgam, and Darren Cofer. 2019. Input prioritization for testing neural networks. In 2019 IEEE International Conference on Artificial Intelligence Testing (AITest). IEEE, 63\u201370."},{"key":"e_1_3_2_8_2","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1109\/SP.2017.49","volume-title":"2017 IEEE Symposium on Security and Privacy (SP)","author":"Carlini Nicholas","year":"2017","unstructured":"Nicholas Carlini and David Wagner. 2017. Towards evaluating the robustness of neural networks. In 2017 IEEE Symposium on Security and Privacy (SP). IEEE, 39\u201357."},{"key":"e_1_3_2_9_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s10107-016-0998-2","article-title":"Relative entropy optimization and its applications","volume":"161","author":"Chandrasekaran Venkat","year":"2017","unstructured":"Venkat Chandrasekaran and Parikshit Shah. 2017. Relative entropy optimization and its applications. Mathematical Programming 161 (2017), 1\u201332.","journal-title":"Mathematical Programming"},{"issue":"2","key":"e_1_3_2_10_2","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1109\/TSE.2018.2889771","article-title":"Coverage prediction for accelerating compiler testing","volume":"47","author":"Chen Junjie","year":"2018","unstructured":"Junjie Chen, Guancheng Wang, Dan Hao, Yingfei Xiong, Hongyu Zhang, Lu Zhang, and Bing Xie. 2018. Coverage prediction for accelerating compiler testing. IEEE Transactions on Software Engineering 47, 2 (2018), 261\u2013278.","journal-title":"IEEE Transactions on Software Engineering"},{"key":"e_1_3_2_11_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3394112","article-title":"Practical accuracy estimation for efficient deep neural network testing","volume":"29","author":"Chen Junjie","year":"2020","unstructured":"Junjie Chen, Zhuo Wu, Zan Wang, Hanmo You, Lingming Zhang, and Ming Yan. 2020. Practical accuracy estimation for efficient deep neural network testing. ACM Transactions on Software Engineering and Methodology 29, 4 (2020), 1\u201335.","journal-title":"ACM Transactions on Software Engineering and Methodology"},{"key":"e_1_3_2_12_2","doi-asserted-by":"crossref","first-page":"514","DOI":"10.1109\/ICDCS.2019.00058","volume-title":"2019 IEEE 39th International Conference on Distributed Computing Systems (ICDCS)","author":"Chen Qi","year":"2019","unstructured":"Qi Chen, Sihai Tang, Qing Yang, and Song Fu. 2019. Cooper: Cooperative perception for connected autonomous vehicles based on 3D point clouds. In 2019 IEEE 39th International Conference on Distributed Computing Systems (ICDCS). IEEE, 514\u2013524."},{"key":"e_1_3_2_13_2","first-page":"785","volume-title":"22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining","author":"Chen Tianqi","year":"2016","unstructured":"Tianqi Chen and Carlos Guestrin. 2016. Xgboost: A scalable tree boosting system. In 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 785\u2013794."},{"key":"e_1_3_2_14_2","unstructured":"Tsong Y. Chen Shing C. Cheung and Shiu Ming Yiu .2020. Metamorphic testing: A new approach for generating next test cases. arXiv:2002.12543. Retrieved from https:\/\/arxiv.org\/abs\/2002.12543"},{"issue":"6","key":"e_1_3_2_15_2","doi-asserted-by":"crossref","first-page":"972","DOI":"10.1109\/TEVC.2016.2564158","article-title":"Minimum Manhattan distance approach to multiple criteria decision making in multiobjective optimization problems","volume":"20","author":"Chiu Wei-Yu","year":"2016","unstructured":"Wei-Yu Chiu, Gary G. Yen, and Teng-Kuei Juan. 2016. Minimum Manhattan distance approach to multiple criteria decision making in multiobjective optimization problems. IEEE Transactions on Evolutionary Computation 20, 6 (2016), 972\u2013985.","journal-title":"IEEE Transactions on Evolutionary Computation"},{"key":"e_1_3_2_16_2","doi-asserted-by":"crossref","first-page":"5113","DOI":"10.1007\/s10462-020-09816-7","article-title":"A comprehensive survey on model compression and acceleration","volume":"53","author":"Choudhary Tejalal","year":"2020","unstructured":"Tejalal Choudhary, Vipul Mishra, Anurag Goswami, and Jagannathan Sarangapani. 2020. A comprehensive survey on model compression and acceleration. Artificial Intelligence Review 53 (2020), 5113\u20135155.","journal-title":"Artificial Intelligence Review"},{"key":"e_1_3_2_17_2","first-page":"1","article-title":"Pearson correlation coefficient","author":"Cohen Israel","year":"2009","unstructured":"Israel Cohen, Yiteng Huang, Jingdong Chen, Jacob Benesty, Jacob Benesty, Jingdong Chen, Yiteng Huang, and Israel Cohen. 2009. Pearson correlation coefficient. Noise Reduction in Speech Processing 2 (2009), 1\u20134.","journal-title":"Noise Reduction in Speech Processing"},{"key":"e_1_3_2_18_2","volume-title":"ACM Transactions on Software Engineering and Methodology","author":"Dang Xueqi","year":"2023","unstructured":"Xueqi Dang, Yinghua Li, Mike Papadakis, Jacques Klein, Tegawend\u00e9 F. Bissyand\u00e9, and Yves L. E. Traon. 2023. GraphPrior: Mutation-based test input prioritization for graph neural networks. ACM Transactions on Software Engineering and Methodology 33 (2023), 1--40."},{"key":"e_1_3_2_19_2","first-page":"800","article-title":"TensorFlow lite micro: Embedded machine learning for TinyML systems","volume":"3","author":"David Robert","year":"2021","unstructured":"Robert David, Jared Duke, Advait Jain, Vijay Janapa Reddi, Nat Jeffries, Jian Li, Nick Kreeger, Ian Nappier, Meghna Natraj, Tiezhen Wang, et al. 2021. TensorFlow lite micro: Embedded machine learning for TinyML systems. Proceedings of Machine Learning and Systems 3 (2021), 800\u2013811.","journal-title":"Proceedings of Machine Learning and Systems"},{"issue":"6","key":"e_1_3_2_20_2","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1109\/MSP.2012.2211477","article-title":"The MNIST database of handwritten digit images for machine learning research","volume":"29","author":"Deng Li","year":"2012","unstructured":"Li Deng. 2012. The MNIST database of handwritten digit images for machine learning research. IEEE Signal Processing Magazine 29, 6 (2012), 141\u2013142.","journal-title":"IEEE Signal Processing Magazine"},{"key":"e_1_3_2_21_2","unstructured":"Jacob Devlin Ming-Wei Chang Kenton Lee and Kristina Toutanova. 2018. BERT: Pre-training of deep bidirectional transformers for language understanding. arXiv:1810.04805. Retrieved from https:\/\/arxiv.org\/abs\/1810.04805"},{"key":"e_1_3_2_22_2","first-page":"1597","volume-title":"2017 IEEE 60th International Midwest Symposium on Circuits and Systems (MWSCAS)","author":"Dey Rahul","year":"2017","unstructured":"Rahul Dey and Fathi M. Salem. 2017. Gate-variants of gated recurrent unit (GRU) neural networks. In 2017 IEEE 60th International Midwest Symposium on Circuits and Systems (MWSCAS). IEEE, 1597\u20131600."},{"key":"e_1_3_2_23_2","first-page":"302","volume-title":"2013 IEEE 6th International Conference on Software Testing, Verification and Validation","author":"Di Nardo Daniel","year":"2013","unstructured":"Daniel Di Nardo, Nadia Alshahwan, Lionel Briand, and Yvan Labiche. 2013. Coverage-based test case prioritisation: An industrial case study. In 2013 IEEE 6th International Conference on Software Testing, Verification and Validation. IEEE, 302\u2013311."},{"key":"e_1_3_2_24_2","first-page":"3150","volume-title":"IEEE\/CVF Winter Conference on Applications of Computer Vision","author":"Len Du","year":"2020","unstructured":"Len Du. 2020. How much deep learning does neural style transfer really need? An ablation study. In IEEE\/CVF Winter Conference on Applications of Computer Vision, 3150\u20133159."},{"issue":"2","key":"e_1_3_2_25_2","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1109\/32.988497","article-title":"Test case prioritization: A family of empirical studies","volume":"28","author":"Elbaum Sebastian","year":"2002","unstructured":"Sebastian Elbaum, Alexey G. Malishevsky, and Gregg Rothermel. 2002. Test case prioritization: A family of empirical studies. IEEE Transactions on Software Engineering 28, 2 (2002), 159\u2013182.","journal-title":"IEEE Transactions on Software Engineering"},{"key":"e_1_3_2_26_2","first-page":"235","volume-title":"22nd ACM SIGSOFT International Symposium on Foundations of Software Engineering","author":"Elbaum Sebastian","year":"2014","unstructured":"Sebastian Elbaum, Gregg Rothermel, and John Penix. 2014. Techniques for improving regression testing in continuous integration development environments. In 22nd ACM SIGSOFT International Symposium on Foundations of Software Engineering, 235\u2013245."},{"issue":"1","key":"e_1_3_2_27_2","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1016\/j.infsof.2009.07.001","article-title":"A systematic review on regression test selection techniques","volume":"52","author":"Engstr\u00f6m Emelie","year":"2010","unstructured":"Emelie Engstr\u00f6m, Per Runeson, and Mats Skoglund. 2010. A systematic review on regression test selection techniques. Information and Software Technology 52, 1 (2010), 14\u201330.","journal-title":"Information and Software Technology"},{"key":"e_1_3_2_28_2","first-page":"012085","volume-title":"Journal of Physics: Conference Series","volume":"1858","author":"Fadlilah Umi","year":"2021","unstructured":"Umi Fadlilah, Abd Kadir Mahamad, and Bana Handaga. 2021. The development of android for Indonesian sign language using TensorFlow lite and CNN: An initial study. In Journal of Physics: Conference Series, Vol. 1858. IOP Publishing, 012085."},{"key":"e_1_3_2_29_2","first-page":"177","volume-title":"29th ACM SIGSOFT International Symposium on Software Testing and Analysis","author":"Feng Yang","year":"2020","unstructured":"Yang Feng, Qingkai Shi, Xinyu Gao, Jun Wan, Chunrong Fang, and Zhenyu Chen. 2020. DeepGini: Prioritizing massive tests to enhance the robustness of deep neural networks. In 29th ACM SIGSOFT International Symposium on Software Testing and Analysis, 177\u2013188."},{"key":"e_1_3_2_30_2","first-page":"73","volume-title":"44th International Conference on Software Engineering","author":"Gao Xinyu","year":"2022","unstructured":"Xinyu Gao, Yang Feng, Yining Yin, Zixi Liu, Zhenyu Chen, and Baowen Xu. 2022. Adaptive test selection for deep neural networks. In 44th International Conference on Software Engineering, 73\u201385."},{"key":"e_1_3_2_31_2","doi-asserted-by":"crossref","first-page":"146","DOI":"10.1016\/j.ins.2012.05.028","article-title":"Class distribution estimation based on the Hellinger distance","volume":"218","author":"Gonz\u00e1lez-Castro V\u00edctor","year":"2013","unstructured":"V\u00edctor Gonz\u00e1lez-Castro, Roc\u00edo Alaiz-Rodr\u00edguez, and Enrique Alegre. 2013. Class distribution estimation based on the Hellinger distance. Information Sciences 218 (2013), 146\u2013164.","journal-title":"Information Sciences"},{"key":"e_1_3_2_32_2","unstructured":"Ian J. Goodfellow Jonathon Shlens and Christian Szegedy. 2014. Explaining and harnessing adversarial examples. arXiv:1412.6572. Retrieved from https:\/\/arxiv.org\/abs\/1412.6572"},{"key":"e_1_3_2_33_2","doi-asserted-by":"crossref","first-page":"534","DOI":"10.1109\/SANER56733.2023.00056","volume-title":"2023 IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER)","author":"Hao Yao","year":"2023","unstructured":"Yao Hao, Zhiqiu Huang, Hongjing Guo, and Guohua Shen. 2023. Test input selection for deep neural network enhancement based on multiple-objective optimization. In 2023 IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER). IEEE, 534\u2013545."},{"key":"e_1_3_2_34_2","first-page":"770","volume-title":"IEEE Conference on Computer Vision and Pattern Recognition","author":"He Kaiming","year":"2016","unstructured":"Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Deep residual learning for image recognition. In IEEE Conference on Computer Vision and Pattern Recognition, 770\u2013778."},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.1145\/2430536.2430540"},{"key":"e_1_3_2_36_2","first-page":"523","volume-title":"2016 IEEE\/ACM 38th International Conference on Software Engineering (ICSE)","author":"Henard Christopher","year":"2016","unstructured":"Christopher Henard, Mike Papadakis, Mark Harman, Yue Jia, and Yves Le Traon. 2016. Comparing white-box and black-box test prioritization. In 2016 IEEE\/ACM 38th International Conference on Software Engineering (ICSE). IEEE, 523\u2013534."},{"issue":"7","key":"e_1_3_2_37_2","doi-asserted-by":"crossref","first-page":"650","DOI":"10.1109\/TSE.2014.2327020","article-title":"Bypassing the combinatorial explosion: Using similarity to generate and prioritize t-wise test configurations for software product lines","volume":"40","author":"Henard Christopher","year":"2014","unstructured":"Christopher Henard, Mike Papadakis, Gilles Perrouin, Jacques Klein, Patrick Heymans, and Yves Le Traon. 2014. Bypassing the combinatorial explosion: Using similarity to generate and prioritize t-wise test configurations for software product lines. IEEE Transactions on Software Engineering 40, 7 (2014), 650\u2013670.","journal-title":"IEEE Transactions on Software Engineering"},{"issue":"1","key":"e_1_3_2_38_2","first-page":"1","article-title":"A first look at on-device models in iOS apps","volume":"33","author":"Hu Han","year":"2023","unstructured":"Han Hu, Yujin Huang, Qiuyuan Chen, Terry Yue Zhuo, and Chunyang Chen. 2023. A first look at on-device models in iOS apps. ACM Transactions on Software Engineering and Methodology 33, 1 (2023), 1\u201330.","journal-title":"ACM Transactions on Software Engineering and Methodology"},{"key":"e_1_3_2_39_2","first-page":"917","volume-title":"2021 36th IEEE\/ACM International Conference on Automated Software Engineering (ASE)","author":"Hu Qiang","year":"2021","unstructured":"Qiang Hu, Yuejun Guo, Maxime Cordy, Xiaofei Xie, Wei Ma, Mike Papadakis, and Yves Le Traon. 2021. Towards exploring the limitations of active learning: An empirical study. In 2021 36th IEEE\/ACM International Conference on Automated Software Engineering (ASE). IEEE, 917\u2013929."},{"key":"e_1_3_2_40_2","first-page":"4700","volume-title":"IEEE Conference on Computer Vision and Pattern Recognition","author":"Huang Gao","year":"2017","unstructured":"Gao Huang, Zhuang Liu, Laurens Van Der Maaten, and Kilian Q. Weinberger. 2017. Densely connected convolutional networks. In IEEE Conference on Computer Vision and Pattern Recognition, 4700\u20134708."},{"key":"e_1_3_2_41_2","first-page":"954","volume-title":"IEEE Conference on Computer Vision and Pattern Recognition Workshops","author":"Huang Xinyu","year":"2018","unstructured":"Xinyu Huang, Xinjing Cheng, Qichuan Geng, Binbin Cao, Dingfu Zhou, Peng Wang, Yuanqing Lin, and Ruigang Yang. 2018. The ApolloScape dataset for autonomous driving. In IEEE Conference on Computer Vision and Pattern Recognition Workshops, 954\u2013960."},{"key":"e_1_3_2_42_2","first-page":"67","volume-title":"30th ACM SIGSOFT International Symposium on Software Testing and Analysis","author":"Humbatova Nargiz","year":"2021","unstructured":"Nargiz Humbatova, Gunel Jahangirova, and Paolo Tonella. 2021. DeepCrime: Mutation testing of deep learning systems based on real faults. In 30th ACM SIGSOFT International Symposium on Software Testing and Analysis, 67\u201378."},{"key":"e_1_3_2_43_2","doi-asserted-by":"crossref","first-page":"74","DOI":"10.1109\/ICST46399.2020.00018","volume-title":"2020 IEEE 13th International Conference on Software Testing, Validation and Verification (ICST)","author":"Jahangirova Gunel","year":"2020","unstructured":"Gunel Jahangirova and Paolo Tonella. 2020. An empirical evaluation of mutation operators for deep learning systems. In 2020 IEEE 13th International Conference on Software Testing, Validation and Verification (ICST). IEEE, 74\u201384."},{"key":"e_1_3_2_44_2","article-title":"LightGBM: A highly efficient gradient boosting decision tree. In","author":"Ke Guolin","year":"2017","unstructured":"Guolin Ke, Qi Meng, Thomas Finley, Taifeng Wang, Wei Chen, Weidong Ma, Qiwei Ye, and Tie-Yan Liu. 2017. LightGBM: A highly efficient gradient boosting decision tree. In Advances in Neural Information Processing Systems, Vol. 30.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_45_2","article-title":"Examples are not enough, learn to criticize! Criticism for interpretability","author":"Kim Been","year":"2016","unstructured":"Been Kim, Rajiv Khanna, and Oluwasanmi O. Koyejo. 2016. Examples are not enough, learn to criticize! Criticism for interpretability. In Advances in Neural Information Processing Systems, Vol. 29.","journal-title":"Advances in Neural Information Processing Systems"},{"issue":"6","key":"e_1_3_2_46_2","doi-asserted-by":"crossref","first-page":"540","DOI":"10.4097\/kjae.2015.68.6.540","article-title":"T test as a parametric statistic","volume":"68","author":"Tae Kyun Kim.","year":"2015","unstructured":"Tae Kyun Kim. 2015. T test as a parametric statistic. Korean Journal of Anesthesiology 68, 6 (2015), 540\u2013546.","journal-title":"Korean Journal of Anesthesiology"},{"issue":"6","key":"e_1_3_2_47_2","doi-asserted-by":"crossref","first-page":"2611","DOI":"10.1109\/TIT.2010.2046212","article-title":"Permutation arrays under the Chebyshev distance","volume":"56","author":"Klove Torleiv","year":"2010","unstructured":"Torleiv Klove, Te-Tsung Lin, Shi-Chun Tsai, and Wen-Guey Tzeng. 2010. Permutation arrays under the Chebyshev distance. IEEE Transactions on Information Theory 56, 6 (2010), 2611\u20132617.","journal-title":"IEEE Transactions on Information Theory"},{"key":"e_1_3_2_48_2","unstructured":"Alex Krizhevsky and Geoffrey Hinton. 2009. Learning multiple layers of features from tiny images. University of Toronto 2009 32\u201333."},{"key":"e_1_3_2_49_2","article-title":"ImageNet classification with deep convolutional neural networks. In","author":"Krizhevsky Alex","year":"2012","unstructured":"Alex Krizhevsky, Ilya Sutskever, and Geoffrey E. Hinton. 2012. ImageNet classification with deep convolutional neural networks. In Advances in Neural Information Processing Systems, Vol. 25.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_50_2","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1201\/9781351251389-8","volume-title":"Artificial Intelligence Safety and Security","author":"Kurakin Alexey","year":"2018","unstructured":"Alexey Kurakin, Ian J. Goodfellow, and Samy Bengio. 2018. Adversarial examples in the physical world. In Artificial Intelligence Safety and Security. Roman V. Yampolskiy (Ed.), Chapman and Hall\/CRC, 99\u2013112."},{"issue":"11","key":"e_1_3_2_51_2","doi-asserted-by":"crossref","first-page":"2278","DOI":"10.1109\/5.726791","article-title":"Gradient-based learning applied to document recognition","volume":"86","author":"LeCun Yann","year":"1998","unstructured":"Yann LeCun, L\u00e9on Bottou, Yoshua Bengio, and Patrick Haffner. 1998. Gradient-based learning applied to document recognition. Proceedings of the IEEE 86, 11 (1998), 2278\u20132324.","journal-title":"Proceedings of the IEEE"},{"issue":"1","key":"e_1_3_2_52_2","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1007\/s10515-011-0093-0","article-title":"Prioritizing test cases with string distances","volume":"19","author":"Ledru Yves","year":"2012","unstructured":"Yves Ledru, Alexandre Petrenko, Sergiy Boroday, and Nadine Mandran. 2012. Prioritizing test cases with string distances. Automated Software Engineering 19, 1 (2012), 65\u201395.","journal-title":"Automated Software Engineering"},{"key":"e_1_3_2_53_2","unstructured":"Yinghua Li Xueqi Dang Haoye Tian Tiezhu Sun Zhijie Wang Lei Ma Jacques Klein and Tegawende F. Bissyande. 2022. AI-driven mobile apps: An Explorative Study. arXiv:2212.01635. Retrieved from https:\/\/arxiv.org\/abs\/2212.01635"},{"issue":"4","key":"e_1_3_2_54_2","doi-asserted-by":"crossref","first-page":"225","DOI":"10.1109\/TSE.2007.38","article-title":"Search algorithms for regression test case prioritization","volume":"33","author":"Li Zheng","year":"2007","unstructured":"Zheng Li, Mark Harman, and Robert M. Hierons. 2007. Search algorithms for regression test case prioritization. IEEE Transactions on Software Engineering 33, 4 (2007), 225\u2013237.","journal-title":"IEEE Transactions on Software Engineering"},{"key":"e_1_3_2_55_2","first-page":"499","volume-title":"2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering","author":"Li Zenan","year":"2019","unstructured":"Zenan Li, Xiaoxing Ma, Chang Xu, Chun Cao, Jingwei Xu, and Jian L\u00fc. 2019. Boosting operational DNN testing efficiency through conditioning. In 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering, 499\u2013509."},{"issue":"1","key":"e_1_3_2_56_2","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1137\/120875909","article-title":"Euclidean distance geometry and applications","volume":"56","author":"Liberti Leo","year":"2014","unstructured":"Leo Liberti, Carlile Lavor, Nelson Maculan, and Antonio Mucherino. 2014. Euclidean distance geometry and applications. SIAM Review 56, 1 (2014), 3\u201369.","journal-title":"SIAM Review"},{"key":"e_1_3_2_57_2","unstructured":"Min Lin Qiang Chen and Shuicheng Yan. 2013. Network in network. arXiv:1312.4400. Retrieved from https:\/\/arxiv.org\/abs\/1312.4400"},{"key":"e_1_3_2_58_2","volume-title":"2022 IEEE\/ACM 44th International Conference on Software Engineering (ICSE), 598\u2013609","author":"Liu Zixi","year":"2022","unstructured":"Zixi Liu, Yang Feng, Yining Yin, and Zhenyu Chen. 2022. DeepState: Selecting test suites to enhance the robustness of recurrent neural networks. In 2022 IEEE\/ACM 44th International Conference on Software Engineering (ICSE), 598\u2013609."},{"key":"e_1_3_2_59_2","first-page":"1945","volume-title":"25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining","author":"Luo Yuanfei","year":"1936","unstructured":"Yuanfei Luo, Mengshuo Wang, Hao Zhou, Quanming Yao, Wei-Wei Tu, Yuqiang Chen, Wenyuan Dai, and Qiang Yang. 2019. Autocross: Automatic feature crossing for tabular data in real-world applications. In 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, 1936\u20131945."},{"key":"e_1_3_2_60_2","first-page":"120","volume-title":"33rd ACM\/IEEE International Conference on Automated Software Engineering","author":"Ma Lei","year":"2018","unstructured":"Lei Ma, Felix Juefei-Xu, Fuyuan Zhang, Jiyuan Sun, Minhui Xue, Bo Li, Chunyang Chen, Ting Su, Li Li, Yang Liu, et al. 2018. Deepgauge: Multi-granularity testing criteria for deep learning systems. In 33rd ACM\/IEEE International Conference on Automated Software Engineering, 120\u2013131."},{"key":"e_1_3_2_61_2","first-page":"100","volume-title":"2018 IEEE 29th International Symposium on Software Reliability Engineering (ISSRE)","author":"Ma Lei","year":"2018","unstructured":"Lei Ma, Fuyuan Zhang, Jiyuan Sun, Minhui Xue, Bo Li, Felix Juefei-Xu, Chao Xie, Li Li, Yang Liu, Jianjun Zhao, et al. 2018. Deepmutation: Mutation testing of deep learning systems. In 2018 IEEE 29th International Symposium on Software Reliability Engineering (ISSRE). IEEE, 100\u2013111."},{"issue":"2","key":"e_1_3_2_62_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3417330","article-title":"Test selection for deep learning systems","volume":"30","author":"Ma Wei","year":"2021","unstructured":"Wei Ma, Mike Papadakis, Anestis Tsakmalis, Maxime Cordy, and Yves Le Traon. 2021. Test selection for deep learning systems. ACM Transactions on Software Engineering and Methodology 30, 2 (2021), 1\u201322.","journal-title":"ACM Transactions on Software Engineering and Methodology"},{"key":"e_1_3_2_63_2","unstructured":"Aleksander Madry Aleksandar Makelov Ludwig Schmidt Dimitris Tsipras and Adrian Vladu. 2017. Towards deep learning models resistant to adversarial attacks. arXiv:1706.06083. Retrieved from https:\/\/arxiv.org\/abs\/1706.06083"},{"issue":"15","key":"e_1_3_2_64_2","doi-asserted-by":"crossref","first-page":"3434","DOI":"10.3390\/s19153434","article-title":"On-device deep learning inference for efficient activity data collection","volume":"19","author":"Mairittha Nattaya","year":"2019","unstructured":"Nattaya Mairittha, Tittaya Mairittha, and Sozo Inoue. 2019. On-device deep learning inference for efficient activity data collection. Sensors 19, 15 (2019), 3434.","journal-title":"Sensors"},{"key":"e_1_3_2_65_2","first-page":"255","volume-title":"2020 ACM International Joint Conference on Pervasive and Ubiquitous Computing and the 2020 ACM International Symposium on Wearable Computers","author":"Mairittha Nattaya","year":"2020","unstructured":"Nattaya Mairittha, Tittaya Mairittha, and Sozo Inoue. 2020. Improving activity data collection with on-device personalization using fine-tuning. In 2020 ACM International Joint Conference on Pervasive and Ubiquitous Computing and the 2020 ACM International Symposium on Wearable Computers, 255\u2013260."},{"issue":"1","key":"e_1_3_2_66_2","doi-asserted-by":"crossref","first-page":"41","DOI":"10.3390\/s21010041","article-title":"On-device deep personalization for robust activity data collection","volume":"21","author":"Mairittha Nattaya","year":"2020","unstructured":"Nattaya Mairittha, Tittaya Mairittha, and Sozo Inoue. 2020. On-device deep personalization for robust activity data collection. Sensors 21, 1 (2020), 41.","journal-title":"Sensors"},{"key":"e_1_3_2_67_2","first-page":"503","volume-title":"3rd International Conference on Computational Intelligence and Information Technology (CIIT \u201913)","author":"Malkauthekar M. D.","year":"2013","unstructured":"M. D. Malkauthekar. 2013. Analysis of Euclidean distance and Manhattan distance measure in face recognition. In 3rd International Conference on Computational Intelligence and Information Technology (CIIT \u201913). IET, 503\u2013507."},{"key":"e_1_3_2_68_2","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1016\/j.inffus.2019.12.001","article-title":"A survey on machine learning for data fusion","volume":"57","author":"Meng Tong","year":"2020","unstructured":"Tong Meng, Xuyang Jing, Zheng Yan, and Witold Pedrycz. 2020. A survey on machine learning for data fusion. Information Fusion 57 (2020), 115\u2013129.","journal-title":"Information Fusion"},{"key":"e_1_3_2_69_2","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1109\/IIPHDW.2018.8388338","volume-title":"2018 International Interdisciplinary PhD Workshop (IIPhDW)","author":"Miko\u0142ajczyk Agnieszka","year":"2018","unstructured":"Agnieszka Miko\u0142ajczyk and Micha\u0142 Grochowski. 2018. Data augmentation for improving deep learning in image classification problem. In 2018 International Interdisciplinary PhD Workshop (IIPhDW). IEEE, 117\u2013122."},{"key":"e_1_3_2_70_2","doi-asserted-by":"crossref","first-page":"1419","DOI":"10.3389\/fpls.2016.01419","article-title":"Using deep learning for image-based plant disease detection","volume":"7","author":"Mohanty Sharada P.","year":"2016","unstructured":"Sharada P. Mohanty, David P. Hughes, and Marcel Salath\u00e9. 2016. Using deep learning for image-based plant disease detection. Frontiers in Plant Science 7 (2016), 1419.","journal-title":"Frontiers in Plant Science"},{"key":"e_1_3_2_71_2","first-page":"709","volume-title":"Asian Conference on Computer Vision","author":"Nguyen Hieu V.","year":"2010","unstructured":"Hieu V. Nguyen and Li Bai. 2010. Cosine similarity metric learning for face verification. In Asian Conference on Computer Vision. Springer, 709\u2013720."},{"key":"e_1_3_2_72_2","first-page":"1","article-title":"Influence of data splitting on performance of machine learning models in prediction of shear strength of soil","volume":"2021","author":"Nguyen Quang Hung","year":"2021","unstructured":"Quang Hung Nguyen, Hai-Bang Ly, Lanh Si Ho, Nadhir Al-Ansari, Hiep Van Le, Van Quan Tran, Indra Prakash, and Binh Thai Pham. 2021. Influence of data splitting on performance of machine learning models in prediction of shear strength of soil. Mathematical Problems in Engineering 2021 (2021), 1\u201315.","journal-title":"Mathematical Problems in Engineering"},{"key":"e_1_3_2_73_2","first-page":"4901","volume-title":"International Conference on Machine Learning","author":"Odena Augustus","year":"2019","unstructured":"Augustus Odena, Catherine Olsson, David Andersen, and Ian Goodfellow. 2019. TensorFuzz: Debugging neural networks with coverage-guided fuzzing. In International Conference on Machine Learning. PMLR, 4901\u20134911."},{"issue":"2","key":"e_1_3_2_74_2","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1007\/s10664-021-10066-6","article-title":"Test case selection and prioritization using machine learning: A systematic literature review","volume":"27","author":"Pan Rongqi","year":"2022","unstructured":"Rongqi Pan, Mojtaba Bagherzadeh, Taher A. Ghaleb, and Lionel Briand. 2022. Test case selection and prioritization using machine learning: A systematic literature review. Empirical Software Engineering 27, 2 (2022), 29.","journal-title":"Empirical Software Engineering"},{"key":"e_1_3_2_75_2","doi-asserted-by":"publisher","DOI":"10.1146\/annurev-statistics-030718-104938"},{"key":"e_1_3_2_76_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2017.2663435"},{"key":"e_1_3_2_77_2","doi-asserted-by":"crossref","first-page":"236","DOI":"10.1016\/j.infsof.2018.08.009","article-title":"A large scale empirical comparison of state-of-the-art search-based test case generators","volume":"104","author":"Panichella Annibale","year":"2018","unstructured":"Annibale Panichella, Fitsum Meshesha Kifetew, and Paolo Tonella. 2018. A large scale empirical comparison of state-of-the-art search-based test case generators. Information and Software Technology 104 (2018), 236\u2013256.","journal-title":"Information and Software Technology"},{"key":"e_1_3_2_78_2","article-title":"PyTorch: An imperative style, high-performance deep learning library. In","author":"Paszke Adam","year":"2019","unstructured":"Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, et al. 2019. PyTorch: An imperative style, high-performance deep learning library. In Advances in Neural Information Processing Systems, Vol. 32.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_79_2","first-page":"1","volume-title":"In 26th Symposium on Operating Systems Principles","author":"Pei Kexin","year":"2017","unstructured":"Kexin Pei, Yinzhi Cao, Junfeng Yang, and Suman Jana. 2017. DeepXplore: Automated whitebox testing of deep learning systems. In 26th Symposium on Operating Systems Principles, 1\u201318."},{"key":"e_1_3_2_80_2","unstructured":"Luis Perez and Jason Wang. 2017. The effectiveness of data augmentation in image classification using deep learning. arXiv:1712.04621. Retrieved from https:\/\/arxiv.org\/abs\/1712.04621"},{"issue":"6","key":"e_1_3_2_81_2","doi-asserted-by":"crossref","first-page":"472","DOI":"10.1007\/PL00000428","article-title":"On the sum of squared distances in the Euclidean plane","volume":"74","author":"Pillichshammer Friedrich","year":"2000","unstructured":"Friedrich Pillichshammer. 2000. On the sum of squared distances in the Euclidean plane. Archiv der Mathematik 74, 6 (2000), 472\u2013480.","journal-title":"Archiv der Mathematik"},{"key":"e_1_3_2_82_2","unstructured":"Antonio Polino Razvan Pascanu and Dan Alistarh. 2018. Model compression via distillation and quantization. arXiv:1802.05668. Retrieved from https:\/\/arxiv.org\/abs\/1802.05668"},{"issue":"10","key":"e_1_3_2_83_2","doi-asserted-by":"crossref","first-page":"929","DOI":"10.1109\/32.962562","article-title":"Prioritizing test cases for regression testing","volume":"27","author":"Rothermel Gregg","year":"2001","unstructured":"Gregg Rothermel, Roland H. Untch, Chengyun Chu, and Mary Jean Harrold. 2001. Prioritizing test cases for regression testing. IEEE Transactions on Software Engineering 27, 10 (2001), 929\u2013948.","journal-title":"IEEE Transactions on Software Engineering"},{"key":"e_1_3_2_84_2","doi-asserted-by":"crossref","first-page":"377","DOI":"10.1016\/j.procs.2018.05.198","article-title":"An analysis of convolutional neural networks for image classification","volume":"132","author":"Sharma Neha","year":"2018","unstructured":"Neha Sharma, Vibhor Jain, and Anju Mishra. 2018. An analysis of convolutional neural networks for image classification. Procedia Computer Science 132 (2018), 377\u2013384.","journal-title":"Procedia Computer Science"},{"issue":"1","key":"e_1_3_2_85_2","first-page":"1","article-title":"A survey on image data augmentation for deep learning","volume":"6","author":"Shorten Connor","year":"2019","unstructured":"Connor Shorten and Taghi M. Khoshgoftaar. 2019. A survey on image data augmentation for deep learning. Journal of Big Data 6, 1 (2019), 1\u201348.","journal-title":"Journal of Big Data"},{"key":"e_1_3_2_86_2","unstructured":"Karen Simonyan and Andrew Zisserman. 2014. Very deep convolutional networks for large-scale image recognition. arXiv:1409.1556. Retrieved from https:\/\/arxiv.org\/abs\/1409.1556"},{"key":"e_1_3_2_87_2","first-page":"1955","volume-title":"30th USENIX Security Symposium (USENIX Security \u201921)","author":"Sun Zhichuang","year":"2021","unstructured":"Zhichuang Sun, Ruimin Sun, Long Lu, and Alan Mislove. 2021. Mind your weight (s): A large-scale study on insufficient machine learning model protection in mobile apps. In 30th USENIX Security Symposium (USENIX Security \u201921), 1955\u20131972."},{"key":"e_1_3_2_88_2","first-page":"368","volume-title":"International Conference on Advanced Data Mining and Applications","author":"Tao Yali","year":"2022","unstructured":"Yali Tao, Chuanqi Tao, Hongjing Guo, and Bohan Li. 2022. TPFL: Test input prioritization for deep neural networks based on fault localization. In International Conference on Advanced Data Mining and Applications. Springer, 368\u2013383."},{"key":"e_1_3_2_89_2","doi-asserted-by":"publisher","DOI":"10.1109\/SSCI.2018.8628742"},{"key":"e_1_3_2_90_2","doi-asserted-by":"publisher","DOI":"10.5555\/3350821"},{"key":"e_1_3_2_91_2","first-page":"15","article-title":"Introduction to core ML framework","author":"Thakkar Mohit","year":"2019","unstructured":"Mohit Thakkar and Mohit Thakkar. 2019. Introduction to core ML framework. In Beginning Machine Learning in iOS: CoreML Framework, Springer, 15\u201349.","journal-title":"Beginning Machine Learning in iOS: CoreML Framework"},{"key":"e_1_3_2_92_2","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1145\/3180155.3180220","volume-title":"40th International Conference on Software Engineering","author":"Tian Yuchi","year":"2018","unstructured":"Yuchi Tian, Kexin Pei, Suman Jana, and Baishakhi Ray. 2018. Deeptest: Automated testing of deep-neural-network-driven autonomous cars. In 40th International Conference on Software Engineering, 303\u2013314."},{"issue":"5","key":"e_1_3_2_93_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3583564","article-title":"Finding deviated behaviors of the compressed DNN models for image classifications","volume":"32","author":"Tian Yongqiang","year":"2023","unstructured":"Yongqiang Tian, Wuqi Zhang, Ming Wen, Shing-Chi Cheung, Chengnian Sun, Shiqing Ma, and Yu Jiang. 2023. Finding deviated behaviors of the compressed DNN models for image classifications. ACM Transactions on Software Engineering and Methodology 32, 5 (2023), 1\u201332.","journal-title":"ACM Transactions on Software Engineering and Methodology"},{"key":"e_1_3_2_94_2","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1109\/ICSM.2006.74","volume-title":"2006 22nd IEEE International Conference on Software Maintenance","author":"Tonella Paolo","year":"2006","unstructured":"Paolo Tonella, Paolo Avesani, and Angelo Susi. 2006. Using the case-based ranking methodology for test case prioritization. In 2006 22nd IEEE International Conference on Software Maintenance. IEEE, 123\u2013133."},{"key":"e_1_3_2_95_2","first-page":"1588","volume-title":"IEEE\/CVF International Conference on Computer Vision","author":"Uy Mikaela Angelina","year":"2019","unstructured":"Mikaela Angelina Uy, Quang-Hieu Pham, Binh-Son Hua, Thanh Nguyen, and Sai-Kit Yeung. 2019. Revisiting point cloud classification: A new benchmark dataset and classification model on real-world data. In IEEE\/CVF International Conference on Computer Vision, 1588\u20131597."},{"key":"e_1_3_2_96_2","doi-asserted-by":"crossref","first-page":"112","DOI":"10.1109\/IJCNN.2014.6889457","volume-title":"2014 International Joint Conference on Neural Networks (IJCNN)","author":"Wang Dan","year":"2014","unstructured":"Dan Wang and Yi Shang. 2014. A new active labeling method for deep learning. In 2014 International Joint Conference on Neural Networks (IJCNN). IEEE, 112\u2013119."},{"key":"e_1_3_2_97_2","doi-asserted-by":"crossref","first-page":"397","DOI":"10.1109\/ICSE43902.2021.00046","volume-title":"2021 IEEE\/ACM 43rd International Conference on Software Engineering (ICSE)","author":"Wang Zan","year":"2021","unstructured":"Zan Wang, Hanmo You, Junjie Chen, Yingyi Zhang, Xuyuan Dong, and Wenbin Zhang. 2021. Prioritizing test inputs for deep neural networks via mutation analysis. In 2021 IEEE\/ACM 43rd International Conference on Software Engineering (ICSE). IEEE, 397\u2013409."},{"key":"e_1_3_2_98_2","first-page":"682","volume-title":"2022 IEEE 22nd International Conference on Software Quality, Reliability and Security (QRS)","author":"Wei Zhengyuan","year":"2022","unstructured":"Zhengyuan Wei, Haipeng Wang, Imran Ashraf, and W. K. Chan. 2022. Predictive mutation analysis of test case prioritization for deep neural networks. In 2022 IEEE 22nd International Conference on Software Quality, Reliability and Security (QRS). IEEE, 682\u2013693."},{"key":"e_1_3_2_99_2","doi-asserted-by":"publisher","DOI":"10.1145\/3533767.3534375"},{"key":"e_1_3_2_100_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2023.110955"},{"key":"e_1_3_2_101_2","doi-asserted-by":"crossref","first-page":"107331","DOI":"10.1016\/j.infsof.2023.107331","article-title":"Stratified random sampling for neural network test input selection","volume":"165","author":"Wu Zhuo","year":"2024","unstructured":"Zhuo Wu, Zan Wang, Junjie Chen, Hanmo You, Ming Yan, and Lanjun Wang. 2024. Stratified random sampling for neural network test input selection. Information and Software Technology 165 (2024), 107331.","journal-title":"Information and Software Technology"},{"key":"e_1_3_2_102_2","unstructured":"Han Xiao Kashif Rasul and Roland Vollgraf. 2017. Fashion-MNIST: A novel image dataset for benchmarking machine learning algorithms. arXiv:1708.07747. Retrieved from https:\/\/arxiv.org\/abs\/1708.07747"},{"key":"e_1_3_2_103_2","volume-title":"International Joint Conferences on Artificial Intelligence Organization","author":"Xie Xiaofei","year":"2019","unstructured":"Xiaofei Xie, Lei Ma, Haijun Wang, Yuekang Li, Yang Liu, and Xiaohong Li. 2019. Diffchaser: Detecting disagreements for deep neural networks. In International Joint Conferences on Artificial Intelligence Organization."},{"key":"e_1_3_2_104_2","first-page":"2125","volume-title":"the World Wide Web Conference","author":"Xu Mengwei","year":"2019","unstructured":"Mengwei Xu, Jiawei Liu, Yuanqiang Liu, Felix Xiaozhu Lin, Yunxin Liu, and Xuanzhe Liu. 2019. A first look at deep learning apps on smartphones. In the World Wide Web Conference, 2125\u20132136."},{"issue":"7","key":"e_1_3_2_105_2","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1007\/s10664-022-10202-w","article-title":"DiverGet: A search-based software testing approach for deep neural network quantization assessment","volume":"27","author":"Haj Yahmed Ahmed","year":"2022","unstructured":"Ahmed Haj Yahmed, Houssem Ben Braiek, Foutse Khomh, Sonia Bouzidi, and Rania Zaatour. 2022. DiverGet: A search-based software testing approach for deep neural network quantization assessment. Empirical Software Engineering 27, 7 (2022), 193.","journal-title":"Empirical Software Engineering"},{"issue":"2","key":"e_1_3_2_106_2","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1002\/stv.430","article-title":"Regression testing minimization, selection and prioritization: A survey","volume":"22","author":"Yoo Shin","year":"2012","unstructured":"Shin Yoo and Mark Harman. 2012. Regression testing minimization, selection and prioritization: A survey. Software Testing, Verification and Reliability 22, 2 (2012), 67\u2013120.","journal-title":"Software Testing, Verification and Reliability"},{"key":"e_1_3_2_107_2","first-page":"201","volume-title":"18th International Symposium on Software Testing and Analysis","author":"Yoo Shin","year":"2009","unstructured":"Shin Yoo, Mark Harman, Paolo Tonella, and Angelo Susi. 2009. Clustering test cases to achieve effective and scalable prioritisation incorporating expert knowledge. In 18th International Symposium on Software Testing and Analysis, 201\u2013212."},{"issue":"7","key":"e_1_3_2_108_2","doi-asserted-by":"crossref","first-page":"1235","DOI":"10.1162\/neco_a_01199","article-title":"A review of recurrent neural networks: LSTM cells and network architectures","volume":"31","author":"Yu Yong","year":"2019","unstructured":"Yong Yu, Xiaosheng Si, Changhua Hu, and Jianxun Zhang. 2019. A review of recurrent neural networks: LSTM cells and network architectures. Neural Computation 31, 7 (2019), 1235\u20131270.","journal-title":"Neural Computation"},{"key":"e_1_3_2_109_2","first-page":"458","volume-title":"2018 ACM on International Conference on Multimedia Retrieval","author":"Yue Xiangyu","year":"2018","unstructured":"Xiangyu Yue, Bichen Wu, Sanjit A. Seshia, Kurt Keutzer, and Alberto L. Sangiovanni-Vincentelli. 2018. A lidar point cloud generator: From a virtual world to autonomous driving. In 2018 ACM on International Conference on Multimedia Retrieval, 458\u2013464."},{"key":"e_1_3_2_110_2","unstructured":"Zeroshot. 2023. Twitter Financial News Topic Dataset. Retrieved from https:\/\/huggingface.co\/datasets\/zeroshot\/twitter-financial-news-topic"},{"issue":"1","key":"e_1_3_2_111_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/TSE.2019.2962027","article-title":"Machine learning testing: Survey, landscapes and horizons","volume":"48","author":"Zhang Jie M.","year":"2020","unstructured":"Jie M. Zhang, Mark Harman, Lei Ma, and Yang Liu. 2020. Machine learning testing: Survey, landscapes and horizons. IEEE Transactions on Software Engineering 48, 1 (2020), 1\u201336.","journal-title":"IEEE Transactions on Software Engineering"},{"key":"e_1_3_2_112_2","first-page":"1","volume-title":"2023 38th IEEE\/ACM International Conference on Automated Software Engineering (ASE)","author":"Zheng Haibin","year":"2023","unstructured":"Haibin Zheng, Jinyin Chen, and Haibo Jin. 2023. CertPri: Certifiable prioritization for deep neural networks via movement cost in feature space. In 2023 38th IEEE\/ACM International Conference on Automated Software Engineering (ASE). IEEE, 1\u201313."},{"key":"e_1_3_2_113_2","unstructured":"Aojun Zhou Anbang Yao Yiwen Guo Lin Xu and Yurong Chen. 2017. Incremental network quantization: Towards lossless CNNs with low-precision weights. arXiv:1702.03044. Retrieved from https:\/\/arxiv.org\/abs\/1702.03044"}],"container-title":["ACM Transactions on Software Engineering and Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3730435","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,1,20]],"date-time":"2026-01-20T14:03:28Z","timestamp":1768917808000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3730435"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,1,20]]},"references-count":112,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2026,2,28]]}},"alternative-id":["10.1145\/3730435"],"URL":"https:\/\/doi.org\/10.1145\/3730435","relation":{},"ISSN":["1049-331X","1557-7392"],"issn-type":[{"value":"1049-331X","type":"print"},{"value":"1557-7392","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,1,20]]},"assertion":[{"value":"2024-06-13","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-04-13","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-01-20","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}