{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,23]],"date-time":"2026-08-23T14:30:18Z","timestamp":1787495418601,"version":"build-2736575974"},"reference-count":68,"publisher":"Association for Computing Machinery (ACM)","issue":"ISSTA","license":[{"start":{"date-parts":[[2025,6,22]],"date-time":"2025-06-22T00:00:00Z","timestamp":1750550400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/legalcode"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["U24A20337, 62372228"],"award-info":[{"award-number":["U24A20337, 62372228"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Shenzhen-Hong Kong-Macau Technology Research Programme","award":["SGDX20230821091559018"],"award-info":[{"award-number":["SGDX20230821091559018"]}]},{"name":"Open Project of State Key Laboratory for Novel Software Technology at Nanjing University","award":["KFKT2024B21"],"award-info":[{"award-number":["KFKT2024B21"]}]},{"DOI":"10.13039\/501100012226","name":"Fundamental Research Funds for the Central Universities","doi-asserted-by":"publisher","award":["14380029"],"award-info":[{"award-number":["14380029"]}],"id":[{"id":"10.13039\/501100012226","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. ACM Softw. Eng."],"published-print":{"date-parts":[[2025,6,22]]},"abstract":"<jats:p>Deep learning (DL) frameworks are essential to DL-based software systems, and framework bugs may lead to substantial disasters, thus requiring effective testing. Researchers adopt DL models or single interfaces as test inputs and analyze their execution results to detect bugs. However, floating-point errors, inherent randomness, and the complexity of test inputs make it challenging to analyze execution results effectively, leading to existing methods suffering from a lack of suitable test oracles. Some researchers utilize metamorphic testing to tackle this challenge. They design Metamorphic Relations (MRs) based on input data and parameter settings of a single framework interface to generate equivalent test inputs, ensuring consistent execution results between original and generated test inputs. Despite their promising effectiveness, they still face certain limitations. (1) Existing MRs overlook structural complexity, limiting test input diversity. (2) Existing MRs focus on limited interfaces, which limits generalization and necessitates additional adaptations. (3) Their detected bugs are related to the result consistency of single interfaces and far from those exposed in multi-interface combinations and runtime metrics (e.g., resource usage). To address these limitations, we propose ModelMeta, a model-level metamorphic testing method for DL frameworks with four MRs focused on the structure characteristics of DL models. ModelMeta augments seed models with diverse interface combinations to generate test inputs with consistent outputs, guided by the QR-DQN strategy. It then detects bugs through fine-grained analysis of training loss\/gradients, memory\/GPU usage, and execution time. We evaluate the effectiveness of ModelMeta on three popular DL frameworks (i.e., MindSpore, PyTorch, and ONNX) with 17 DL models from ten real-world tasks ranging from image classification to object detection. Results demonstrate that ModelMeta outperforms state-of-the-art baselines from the perspective of test coverage and diversity of generated test inputs. Regarding bug detection, ModelMeta has identified 31 new bugs, of which 27 have been confirmed, and 11 have been fixed. Among them, seven bugs existing methods cannot detect, i.e., five wrong resource usage bugs and two low-efficiency bugs. These results demonstrate the practicality of our method.<\/jats:p>","DOI":"10.1145\/3728972","type":"journal-article","created":{"date-parts":[[2025,6,22]],"date-time":"2025-06-22T10:52:56Z","timestamp":1750589576000},"page":"2158-2180","source":"Crossref","is-referenced-by-count":4,"title":["Improving Deep Learning Framework Testing with Model-Level Metamorphic Testing"],"prefix":"10.1145","volume":"2","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1816-2246","authenticated-orcid":false,"given":"Yanzhou","family":"Mu","sequence":"first","affiliation":[{"name":"Nanjing University, State Key Laboratory for Novel Software Technology, Nanjing, China"},{"name":"Shenzhen Research Institute of Nanjing University, Shenzhen, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5017-8016","authenticated-orcid":false,"given":"Juan","family":"Zhai","sequence":"additional","affiliation":[{"name":"University of Massachusetts at Amherst, Amherst, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9930-7111","authenticated-orcid":false,"given":"Chunrong","family":"Fang","sequence":"additional","affiliation":[{"name":"Nanjing University, State Key Laboratory for Novel Software Technology, Nanjing, China"},{"name":"Shenzhen Research Institute of Nanjing University, Shenzhen, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1180-3891","authenticated-orcid":false,"given":"Xiang","family":"Chen","sequence":"additional","affiliation":[{"name":"Nantong University, Nantong, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-6810-7608","authenticated-orcid":false,"given":"Zhixiang","family":"Cao","sequence":"additional","affiliation":[{"name":"Nantong University, Nantong, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-8242-9543","authenticated-orcid":false,"given":"Peiran","family":"Yang","sequence":"additional","affiliation":[{"name":"Nanjing University, State Key Laboratory for Novel Software Technology, Nanjing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-7793-2507","authenticated-orcid":false,"given":"Kexin","family":"Zhao","sequence":"additional","affiliation":[{"name":"Nanjing University, State Key Laboratory for Novel Software Technology, Nanjing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-8661-6133","authenticated-orcid":false,"given":"An","family":"Guo","sequence":"additional","affiliation":[{"name":"Nanjing University, State Key Laboratory for Novel Software Technology, Nanjing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9592-7022","authenticated-orcid":false,"given":"Zhenyu","family":"Chen","sequence":"additional","affiliation":[{"name":"Nanjing University, State Key Laboratory for Novel Software Technology, Nanjing, China"},{"name":"Shenzhen Research Institute of Nanjing University, Shenzhen, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2025,6,22]]},"reference":[{"key":"e_1_3_1_2_2","unstructured":"2021. GCOV. https:\/\/gcc.gnu.org\/onlinedocs\/gcc\/Gcov.html.."},{"key":"e_1_3_1_3_2","unstructured":"2025. LCOV - A graphical front-end for gcov. http:\/\/ltp.sourceforge.net\/coverage\/lcov.php."},{"key":"e_1_3_1_4_2","unstructured":"Accessed: 2023. Accuracy bug case. https:\/\/github.com\/pytorch\/pytorch\/issues\/106604."},{"key":"e_1_3_1_5_2","unstructured":"Accessed: 2023. Bug Link in the motivating example. https:\/\/gitee.com\/mindspore\/mindspore\/issues\/I7S7KP."},{"key":"e_1_3_1_6_2","unstructured":"Accessed: 2023. Crash bug case. https:\/\/gitee.com\/mindspore\/mindspore\/issues\/I7N3UY."},{"key":"e_1_3_1_7_2","unstructured":"Accessed: 2023. Resource bug case. https:\/\/e.gitee.com\/mind_spore\/dashboard?issue=I7VVFN."},{"key":"e_1_3_1_8_2","doi-asserted-by":"publisher","DOI":"10.1023\/A:1020281327116"},{"key":"e_1_3_1_9_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2014.2372785"},{"key":"e_1_3_1_10_2","doi-asserted-by":"publisher","DOI":"10.1201\/b10905"},{"issue":"3","key":"e_1_3_1_11_2","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1145\/2070336.2070341","article-title":"Do-178c: the next avionics safety standard","volume":"31","author":"Brosgol Benjamin","year":"2011","unstructured":"Benjamin Brosgol. 2011. Do-178c: the next avionics safety standard. ACM SIGAda Ada Letters 31, 3 (2011), 5\u20136.","journal-title":"ACM SIGAda Ada Letters"},{"key":"e_1_3_1_12_2","unstructured":"BugCase Accessed: 2022. A TensorFlow bug related to multiple interfaces. https:\/\/github.com\/tensorflow\/tensorflow\/issues\/55840."},{"key":"e_1_3_1_13_2","doi-asserted-by":"crossref","unstructured":"Chenyi Chen Ari Seff Alain Kornhauser and Jianxiong Xiao. 2015. Deepdriving: Learning affordance for direct perception in autonomous driving. In Proceedings of the IEEE international conference on computer vision. 2722\u20132730.","DOI":"10.1109\/ICCV.2015.312"},{"key":"e_1_3_1_14_2","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.2019.00042"},{"key":"e_1_3_1_15_2","first-page":"2005","volume-title":"Proceedings of the ACM on Software Engineering","author":"Chen Jinyin","year":"2024","unstructured":"Jinyin Chen, Chengyu Jia, Yunjie Yan, Jie Ge, Haibin Zheng, and Yao Cheng. 2024. A Miss Is as Good as A Mile: Metamorphic Testing for Deep Learning Operators. Proceedings of the ACM on Software Engineering 1, FSE (2024), 2005\u20132027."},{"key":"e_1_3_1_16_2","doi-asserted-by":"publisher","DOI":"10.1145\/3587155"},{"key":"e_1_3_1_17_2","unstructured":"Tsong Yueh Chen Shing Chi Cheung and Shiu Ming Yiu. 1998. Metamorphic testing: a new approach for generating next test cases. Department of Computer Science Hong Kong University of Science and Technology. Technical Report. Tech. Rep. HKUST-CS98-01."},{"key":"e_1_3_1_18_2","doi-asserted-by":"crossref","first-page":"430","DOI":"10.1109\/ASE51524.2021.9678746","volume-title":"2021 36th IEEE\/ACM International Conference on Automated Software Engineering (ASE)","author":"Chen Zhuangbin","year":"2021","unstructured":"Zhuangbin Chen, Jinyang Liu, Yuxin Su, Hongyu Zhang, Xuemin Wen, Xiao Ling, Yongqiang Yang, and Michael R Lyu. 2021. Graph-based incident aggregation for large-scale online service systems. In 2021 36th IEEE\/ACM International Conference on Automated Software Engineering (ASE). IEEE, 430\u2013442."},{"key":"e_1_3_1_19_2","article-title":"Distributional reinforcement learning with quantile regression","volume":"32","author":"Dabney Will","year":"2018","unstructured":"Will Dabney, Mark Rowland, Marc Bellemare, and R\u00e9mi Munos. 2018. Distributional reinforcement learning with quantile regression. In Proceedings of the AAAI conference on artificial intelligence, Vol. 32.","journal-title":"Proceedings of the AAAI conference on artificial intelligence"},{"key":"e_1_3_1_20_2","doi-asserted-by":"crossref","unstructured":"Yinlin Deng Chenyuan Yang Anjiang Wei and Lingming Zhang. 2022. Fuzzing deep-learning libraries via automated relational API inference. Proceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (2022). https:\/\/api.semanticscholar.org\/CorpusID:250451527","DOI":"10.1145\/3540250.3549085"},{"key":"e_1_3_1_21_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-00234-2"},{"key":"e_1_3_1_22_2","doi-asserted-by":"publisher","DOI":"10.1109\/MET.2017.2"},{"key":"e_1_3_1_23_2","doi-asserted-by":"crossref","unstructured":"Fei Gao Jinhua Zhu Lijun Wu Yingce Xia Tao Qin Xueqi Cheng Wengang Zhou and Tie-Yan Liu. 2019. Soft contextual data augmentation for neural machine translation. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics. 5539\u20135544.","DOI":"10.18653\/v1\/P19-1555"},{"key":"e_1_3_1_24_2","doi-asserted-by":"crossref","unstructured":"Jiazhen Gu Xuchuan Luo Yangfan Zhou and Xin Wang. 2022. Muffin: Testing deep learning libraries via neural architecture fuzzing. In Proceedings of the 44th International Conference on Software Engineering. 1418\u20131430.","DOI":"10.1145\/3510003.3510092"},{"key":"e_1_3_1_25_2","doi-asserted-by":"crossref","unstructured":"Qianyu Guo Xiaofei Xie Yi Li Xiaoyu Zhang Yang Liu Xiaohong Li and Chao Shen. 2020. Audee: Automated testing for deep learning frameworks. In Proceedings of the 35th IEEE\/ACM International Conference on Automated Software Engineering. 486\u2013498.","DOI":"10.1145\/3324884.3416571"},{"key":"e_1_3_1_26_2","article-title":"Double Q-learning","volume":"23","author":"Hasselt Hado","year":"2010","unstructured":"Hado Hasselt. 2010. Double Q-learning. Advances in neural information processing systems 23 (2010).","journal-title":"Advances in neural information processing systems"},{"key":"e_1_3_1_27_2","doi-asserted-by":"crossref","unstructured":"Kaiming He Xiangyu Zhang Shaoqing Ren and Jian Sun. 2016. Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition. 770\u2013778.","DOI":"10.1109\/CVPR.2016.90"},{"key":"e_1_3_1_28_2","unstructured":"Intel Corporation. 2021. oneDNN: Deep Neural Network Library. https:\/\/github.com\/oneapi-src\/oneDNN. Version 2.6."},{"key":"e_1_3_1_29_2","unstructured":"Intel Corporation. 2021. oneMKL: Math Kernel Library. https:\/\/github.com\/oneapi-src\/oneMKL. Version 2021.4."},{"key":"e_1_3_1_30_2","first-page":"3050","volume-title":"International Conference on Machine Learning","author":"Jay Nathan","year":"2019","unstructured":"Nathan Jay, Noga Rotman, Brighten Godfrey, Michael Schapira, and Aviv Tamar. 2019. A deep reinforcement learning perspective on internet congestion control. In International Conference on Machine Learning. PMLR, 3050\u20133059."},{"key":"e_1_3_1_31_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSME52107.2021.00011"},{"key":"e_1_3_1_32_2","volume-title":"Continuous Univariate Distributions, Volume 2","author":"Johnson Norman L.","year":"1995","unstructured":"Norman L. Johnson, Samuel Kotz, and N. Balakrishnan. 1995. Continuous Univariate Distributions, Volume 2 (2nd ed.). John Wiley & Sons.","edition":"2"},{"key":"e_1_3_1_33_2","unstructured":"Keras Accessed: 2020. Keras. http:\/\/keras.io\/."},{"key":"e_1_3_1_34_2","doi-asserted-by":"crossref","DOI":"10.1142\/5720","volume-title":"Beyond Beta: Other Continuous Families of Distributions with Bounded Support and Applications","author":"Kotz Samuel","year":"2004","unstructured":"Samuel Kotz and Johan Rene van Dorp. 2004. Beyond Beta: Other Continuous Families of Distributions with Bounded Support and Applications. World Scientific."},{"key":"e_1_3_1_35_2","doi-asserted-by":"crossref","unstructured":"Christian Ledig Lucas Theis Ferenc Husz\u00e1r Jose Caballero Andrew Cunningham Alejandro Acosta Andrew Aitken Alykhan Tejani Johannes Totz Zehan Wang et al. 2017. Photo-realistic single image super-resolution using a generative adversarial network. In Proceedings of the IEEE conference on computer vision and pattern recognition. 4681\u20134690.","DOI":"10.1109\/CVPR.2017.19"},{"key":"e_1_3_1_36_2","doi-asserted-by":"crossref","unstructured":"Owolabi Legunsen Farah Hariri August Shi Yafeng Lu Lingming Zhang and Darko Marinov. 2016. An extensive study of static regression test selection in modern software evolution. In Proceedings of the 2016 24th ACM SIGSOFT International Symposium on Foundations of Software Engineering. 583\u2013594.","DOI":"10.1145\/2950290.2950361"},{"key":"e_1_3_1_37_2","doi-asserted-by":"publisher","DOI":"10.1145\/3583566"},{"key":"e_1_3_1_38_2","doi-asserted-by":"publisher","DOI":"10.1145\/3628159"},{"key":"e_1_3_1_39_2","unstructured":"MindSpore Accessed: 2020. MindSpore. https:\/\/www.mindspore.cn\/."},{"key":"e_1_3_1_40_2","first-page":"1928","article-title":"Asynchronous methods for deep reinforcement learning","volume":"28","author":"Mnih V.","year":"2016","unstructured":"V. Mnih, A. P. Badia, M. Mirza, et al. 2016. Asynchronous methods for deep reinforcement learning. In Proceedings of the 33rd International Conference on Machine Learning (ICML), Vol. 28. 1928\u20131937.","journal-title":"Proceedings of the 33rd International Conference on Machine Learning (ICML)"},{"key":"e_1_3_1_41_2","article-title":"Playing Atari with deep reinforcement learning","author":"Mnih Volodymyr","year":"2013","unstructured":"Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Alex Graves, Ioannis Antonoglou, Daan Wierstra, and Martin Riedmiller. 2013. Playing Atari with deep reinforcement learning. arXiv preprint arXiv:1312.5602 (2013).","journal-title":"arXiv preprint arXiv:1312.5602"},{"key":"e_1_3_1_42_2","doi-asserted-by":"publisher","DOI":"10.1038\/nature14236"},{"key":"e_1_3_1_43_2","doi-asserted-by":"publisher","DOI":"10.1109\/72.935097"},{"key":"e_1_3_1_44_2","doi-asserted-by":"crossref","unstructured":"Yanzhou Mu Juan Zhai Chunrong Fang Xiang Chen Zhixiang Cao Peiran Yang Yinglong Zou Tao Zheng and Zhenyu Chen. 2024. DevMuT: Testing Deep Learning Framework via Developer Expertise-Based Mutation. In Proceedings of the 39th IEEE\/ACM International Conference on Automated Software Engineering. 1533\u20131544.","DOI":"10.1145\/3691620.3695523"},{"key":"e_1_3_1_45_2","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.2019.00078"},{"key":"e_1_3_1_46_2","doi-asserted-by":"publisher","DOI":"10.1056\/NEJMp1606181"},{"key":"e_1_3_1_47_2","unstructured":"ONNX Accessed:2019. ONNX. https:\/\/onnx.ai\/."},{"key":"e_1_3_1_48_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2019.00107"},{"key":"e_1_3_1_49_2","unstructured":"PyTorch Accessed: 2019. Pytorch. https:\/\/pytorch.org\/."},{"key":"e_1_3_1_50_2","unstructured":"Alec Radford Jeffrey Wu Rewon Child David Luan Dario Amodei and Ilya Sutskever. 2019. Language Models are Unsupervised Multitask Learners. OpenAI Blog (2019). https:\/\/cdn.openai.com\/better-language-models\/language_models_are_unsupervised_multitask_learners.pdf"},{"key":"e_1_3_1_51_2","unstructured":"sharelink Accessed: 2024. Data Avaiable. https:\/\/github.com\/anonymous-tai\/ModelMeta."},{"key":"e_1_3_1_52_2","unstructured":"Qingchao Shen Yongqiang Tian Haoyang Ma Junjie Chen Lili Huang Ruifeng Fu Shing-Chi Cheung and Zan Wang. 2024. A Tale of Two DL Cities: When Library Tests Meet Compiler. arXiv preprint arXiv:2407.16626 (2024)."},{"key":"e_1_3_1_53_2","doi-asserted-by":"publisher","DOI":"10.1038\/nature16961"},{"key":"e_1_3_1_54_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10462-022-10228-y"},{"key":"e_1_3_1_55_2","unstructured":"Tensorflow Accessed: 2019. Tensorflow. https:\/\/www.tensorflow.org\/."},{"key":"e_1_3_1_56_2","unstructured":"teslanews Accessed: 2023. teslanews. https:\/\/www.tesladeaths.com\/."},{"key":"e_1_3_1_57_2","unstructured":"TF2ONNX Accessed: 2024. TF2ONNX. https:\/\/pypi.org\/project\/tf2onnx\/."},{"key":"e_1_3_1_58_2","doi-asserted-by":"publisher","DOI":"10.2307\/2332286"},{"key":"e_1_3_1_59_2","doi-asserted-by":"crossref","unstructured":"Jiannan Wang Thibaud Lutellier Shangshu Qian Hung Viet Pham and Lin Tan. 2022. EAGLE: creating equivalent graphs to test deep learning libraries. In Proceedings of the 44th International Conference on Software Engineering. 798\u2013810.","DOI":"10.1145\/3510003.3510165"},{"key":"e_1_3_1_60_2","doi-asserted-by":"crossref","unstructured":"Zan Wang Ming Yan Junjie Chen Shuang Liu and Dongdi Zhang. 2020. Deep learning library testing via effective model generation. In Proceedings of the 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering. 788\u2013799.","DOI":"10.1145\/3368089.3409761"},{"key":"e_1_3_1_61_2","doi-asserted-by":"crossref","unstructured":"Anjiang Wei Yinlin Deng Chenyuan Yang and Lingming Zhang. 2022. Free lunch for testing: Fuzzing deep-learning libraries from open source. In Proceedings of the 44th International Conference on Software Engineering. 995\u20131007.","DOI":"10.1145\/3510003.3510041"},{"key":"e_1_3_1_62_2","doi-asserted-by":"publisher","DOI":"10.1145\/3508035"},{"key":"e_1_3_1_63_2","article-title":"Leveraging documentation to test deep learning library functions","author":"Xie Danning","year":"2021","unstructured":"Danning Xie, Yitong Li, Mijung Kim, Hung Viet Pham, Lin Tan, Xiangyu Zhang, and Michael Godfrey. 2021. Leveraging documentation to test deep learning library functions. arXiv preprint arXiv:2109.01002 (2021).","journal-title":"arXiv preprint arXiv:2109.01002"},{"key":"e_1_3_1_64_2","volume-title":"International Conference on Software Analysis, Evolution, and Reengineering","author":"Xie Danning","year":"2024","unstructured":"Danning Xie, Jiannan Wang, Hung Viet Pham, Lin Tan, Yu Guo, Adnan Aziz, and Erik Meijer. 2024. CEDAR: Continuous Testing of Deep Learning Libraries. In International Conference on Software Analysis, Evolution, and Reengineering,. IEEE."},{"key":"e_1_3_1_65_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2022.107004"},{"key":"e_1_3_1_66_2","doi-asserted-by":"crossref","unstructured":"Lingming Zhang. 2018. Hybrid regression test selection. In Proceedings of the 40th International Conference on Software Engineering. 199\u2013209.","DOI":"10.1145\/3180155.3180198"},{"key":"e_1_3_1_67_2","doi-asserted-by":"publisher","DOI":"10.1109\/TR.2021.3107165"},{"key":"e_1_3_1_68_2","doi-asserted-by":"crossref","unstructured":"Xufan Zhang Ning Sun Chunrong Fang Jiawei Liu Jia Liu Dong Chai Jiang Wang and Zhenyu Chen. 2021. Predoo: precision testing of deep learning operators. In Proceedings of the 30th ACM SIGSOFT International Symposium on Software Testing and Analysis. 400\u2013412.","DOI":"10.1145\/3460319.3464843"},{"key":"e_1_3_1_69_2","first-page":"1309","volume-title":"Proceedings of the ACM on Programming Languages","author":"Zhou Chijin","year":"2024","unstructured":"Chijin Zhou, Bingzhou Qian, Gwihwan Go, Quan Zhang, Shanshan Li, and Yu Jiang. 2024. PolyJuice: Detecting Mis-compilation Bugs in Tensor Compilers with Equality Saturation Based Rewriting. Proceedings of the ACM on Programming Languages 8, OOPSLA2 (2024), 1309\u20131335."}],"container-title":["Proceedings of the ACM on Software Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3728972","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,23]],"date-time":"2026-08-23T13:44:34Z","timestamp":1787492674000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3728972"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,22]]},"references-count":68,"journal-issue":{"issue":"ISSTA","published-print":{"date-parts":[[2025,6,22]]}},"alternative-id":["10.1145\/3728972"],"URL":"https:\/\/doi.org\/10.1145\/3728972","relation":{},"ISSN":["2994-970X"],"issn-type":[{"value":"2994-970X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,6,22]]}}}