{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,17]],"date-time":"2026-06-17T15:51:41Z","timestamp":1781711501303,"version":"3.54.5"},"reference-count":90,"publisher":"Association for Computing Machinery (ACM)","issue":"7","funder":[{"name":"National Key Research and Development Program of China","award":["2023YFE0209800"],"award-info":[{"award-number":["2023YFE0209800"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["U24B20185, T2442014, 62161160337, 62132011, U21B2018"],"award-info":[{"award-number":["U24B20185, T2442014, 62161160337, 62132011, U21B2018"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Shaanxi Province Key Industry Innovation Program","award":["2023-ZDLGY-38, 2021ZDLGY01-02"],"award-info":[{"award-number":["2023-ZDLGY-38, 2021ZDLGY01-02"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Softw. Eng. Methodol."],"published-print":{"date-parts":[[2026,7,31]]},"abstract":"<jats:p>\n                    With the application of Deep Learning (DL) technology, tools of DL framework testing are in high demand. Existing DL framework testing tools have limited coverage of bug types. For example, they lack the capability of effectively finding performance bugs, which are critical for DL models regarding performance, economics, and the environment. Moreover, existing tools are inefficient, generating hundreds of test cases with few trigger bugs. In this article, we propose\n                    <jats:sc>Citadel<\/jats:sc>\n                    , a method that accelerates bug finding in terms of efficiency and effectiveness. We observe that many DL framework bugs are similar due to the similarity of operators and algorithms belonging to the same family. Orthogonal to existing bug-finding tools,\n                    <jats:sc>Citadel<\/jats:sc>\n                    aims to find new bugs that are similar to reported ones that have known test oracles.\n                    <jats:sc>Citadel<\/jats:sc>\n                    defines\n                    <jats:italic toggle=\"yes\">context similarity<\/jats:italic>\n                    to measure the similarity of DL framework API pairs and automatically generates test cases with oracles for APIs that are similar to the problematic APIs in existing bug reports.\n                    <jats:sc>Citadel<\/jats:sc>\n                    effectively detects 58 and 66 API bugs on PyTorch and TensorFlow (excluding those rejected by developers or duplicates of prior reports), many of which, e.g., 13 performance bugs, cannot be detected by existing tools. Moreover, 35.40% of test cases generated by\n                    <jats:sc>Citadel<\/jats:sc>\n                    can trigger bugs significantly transcending the state-of-the-art method (3.90%).\n                  <\/jats:p>","DOI":"10.1145\/3773993","type":"journal-article","created":{"date-parts":[[2025,10,30]],"date-time":"2025-10-30T14:55:08Z","timestamp":1761836108000},"page":"1-29","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["<scp>Citadel<\/scp>\n                    : Context Similarity Based Deep Learning Framework Bug Finding"],"prefix":"10.1145","volume":"35","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7010-6749","authenticated-orcid":false,"given":"Xiaoyu","family":"Zhang","sequence":"first","affiliation":[{"name":"Xi\u2019an Jiaotong University, Xi\u2019an, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5017-8016","authenticated-orcid":false,"given":"Juan","family":"Zhai","sequence":"additional","affiliation":[{"name":"University of Massachusetts Amherst, Amherst, Massachusetts, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1551-8948","authenticated-orcid":false,"given":"Shiqing","family":"Ma","sequence":"additional","affiliation":[{"name":"University of Massachusetts Amherst, Amherst, Massachusetts, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2777-7392","authenticated-orcid":false,"given":"Shiwei","family":"Wang","sequence":"additional","affiliation":[{"name":"Xi\u2019an Jiaotong University, Xi\u2019an, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6959-0569","authenticated-orcid":false,"given":"Chao","family":"Shen","sequence":"additional","affiliation":[{"name":"Xi\u2019an Jiaotong University, Xi\u2019an, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2026,6,17]]},"reference":[{"key":"e_1_3_3_2_2","unstructured":"GitHub. 2020. Raise RuntimeError for Zero Stride Pooling. Retrieved from https:\/\/github.com\/pytorch\/pytorch\/commit\/b0424a895c878cb865947164cb0ce9ce3c2e73ef"},{"key":"e_1_3_3_3_2","unstructured":"GitHub. 2021. Workaround for cuFFT Bug. Retrieved from https:\/\/github.com\/pytorch\/pytorch\/pull\/63327"},{"key":"e_1_3_3_4_2","unstructured":"GitHub. 2022. Commit 32fbeb1 Introduced 7-10x Slowdown for th.inverse on Large Batch Matrices. Retrieved from https:\/\/github.com\/pytorch\/pytorch\/issues\/80735"},{"key":"e_1_3_3_5_2","unstructured":"GitHub. 2022. Fix 64bit Indexing in vol2col. Retrieved from https:\/\/github.com\/pytorch\/pytorch\/pull\/87527"},{"key":"e_1_3_3_6_2","unstructured":"GitHub. 2022. Significant Perf Reduction on Python GIL Contention with Dataloader Pinning Thread. Retrieved from https:\/\/github.com\/pytorch\/pytorch\/issues\/77139"},{"key":"e_1_3_3_7_2","unstructured":"GitHub. 2022. Torch.nn.functional.conv1d\/2d\/3d Crash with Floating Point Exception. Retrieved from https:\/\/github.com\/pytorch\/pytorch\/issues\/85111"},{"key":"e_1_3_3_8_2","unstructured":"GitHub. 2022. Training Grouped Conv2D Is Slow. Retrieved from https:\/\/github.com\/pytorch\/pytorch\/issues\/70954"},{"key":"e_1_3_3_9_2","unstructured":"Pytorch. 2023. Extremal Values in Linalg. Retrieved from https:\/\/pytorch.org\/docs\/master\/notes\/numerical_accuracy.html"},{"key":"e_1_3_3_10_2","unstructured":"GitHub. 2023. GlooBackend Leaks File Descriptors. Retrieved from https:\/\/github.com\/pytorch\/pytorch\/issues\/129868"},{"key":"e_1_3_3_11_2","unstructured":"GitHub. 2023. Inversing a 0-Determinant Matrix Led to No Error. Retrieved from https:\/\/github.com\/pytorch\/pytorch\/issues\/88680"},{"key":"e_1_3_3_12_2","unstructured":"GitHub. 2023. Performance Bugs Exists in Multiple Convolution Operations (e.g. Convtranspose2d) When Useing the Groups Argument. Retrieved from https:\/\/github.com\/pytorch\/pytorch\/issues\/95604"},{"key":"e_1_3_3_13_2","unstructured":"GitHub. 2023. Performance Drops After Running Tensor Multiplication for 15 Seconds on M1 MAX (Pytorch MPS). Retrieved from https:\/\/github.com\/pytorch\/pytorch\/issues\/79402"},{"key":"e_1_3_3_14_2","unstructured":"GitHub. 2023. Process Aborted When Running tf.gather and tf.compat.v1.gather on GPU with Large Parameters and Indices. Retrieved from https:\/\/github.com\/tensorflow\/tensorflow\/issues\/61780"},{"key":"e_1_3_3_15_2","unstructured":"GitHub. 2023. PyTorch Issue Template. Retrieved from https:\/\/github.com\/pytorch\/pytorch\/blob\/main\/.github\/ISSUE_TEMPLATE\/bug-report.yml"},{"key":"e_1_3_3_16_2","unstructured":"GitHub. 2023. Regression Bug in torch.nn.ReLU6 and torch.nn.Hardtanh That inplace=True Doesn\u2019t Work in PyTorch 1.10.0 1.13.1. Retrieved from https:\/\/github.com\/pytorch\/pytorch\/issues\/95432"},{"key":"e_1_3_3_17_2","unstructured":"GitHub. 2023. Reinventing Search with a New AI-Powered Microsoft Bing and Edge Your Copilot for the Web. Retrieved from https:\/\/blogs.microsoft.com\/blog\/2023\/02\/07\/reinventing-search-with-a-new-ai-powered-microsoft-bing-and-edge-your-copilot-for-the-web"},{"key":"e_1_3_3_18_2","unstructured":"GitHub. 2023. Citadel Repository. Retrieved from https:\/\/github.com\/shiningrain\/CITADEL"},{"key":"e_1_3_3_19_2","unstructured":"GitHub. 2023. TensorFlow Issue Template. Retrieved from https:\/\/github.com\/tensorflow\/tensorflow\/blob\/master\/.github\/ISSUE_TEMPLATE\/tensorflow_issue_template.yaml"},{"key":"e_1_3_3_20_2","unstructured":"GitHub. 2023. Torch.nn.Conv2d Will Segfault When the Type of Input Tensor Is float16. Retrieved from https:\/\/github.com\/pytorch\/pytorch\/issues\/83328#issuecomment-1445337447"},{"key":"e_1_3_3_21_2","unstructured":"GitHub. 2024. A PyTorch Extension: Tools for Easy Mixed Precision and Distributed Training in Pytorch. Retrieved from https:\/\/github.com\/NVIDIA\/apex"},{"key":"e_1_3_3_22_2","unstructured":"Precedence Research. 2025. Artificial Intelligence (AI) Software Market Size Share and Trends 2025 to 2034. Retrieved from https:\/\/www.precedenceresearch.com\/artificial-intelligence-software-market"},{"key":"e_1_3_3_23_2","doi-asserted-by":"publisher","DOI":"10.1145\/2610384.2610401"},{"key":"e_1_3_3_24_2","doi-asserted-by":"publisher","DOI":"10.1145\/3721125"},{"key":"e_1_3_3_25_2","unstructured":"Sebastian Blanco. 2023. Report: Tesla Autopilot Involved in 736 Crashes since 2019. Retrieved from https:\/\/www.caranddriver.com\/news\/a44185487\/report-tesla-autopilot-crashes-since-2019\/"},{"key":"e_1_3_3_26_2","volume-title":"Computer Systems: A Programmer\u2019s Perspective","author":"Bryant Randal E.","year":"2003","unstructured":"Randal E. Bryant, O\u2019Hallaron David Richard, and O\u2019Hallaron David Richard. 2003. Computer Systems: A Programmer\u2019s Perspective, Vol. 2. Prentice Hall Upper Saddle River."},{"key":"e_1_3_3_27_2","first-page":"1577","volume-title":"Proceedings of the 22nd ACM International Conference on Information and Knowledge Management","author":"Chae Dong-Kyu","year":"2013","unstructured":"Dong-Kyu Chae, Jiwoon Ha, Sang-Wook Kim, BooJoong Kang, and Eul Gyu Im. 2013. Software plagiarism detection: A graph-based approach. In Proceedings of the 22nd ACM International Conference on Information and Knowledge Management, 1577\u20131580."},{"key":"e_1_3_3_28_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3587155","article-title":"Toward understanding deep learning framework bugs","volume":"32","author":"Chen Junjie","year":"2022","unstructured":"Junjie Chen, Yihua Liang, Qingchao Shen, Jiajun Jiang, and Shuochuan Li. 2022. Toward understanding deep learning framework bugs. ACM Transactions on Software Engineering and Methodology 32 (2022), 1\u201331.","journal-title":"ACM Transactions on Software Engineering and Methodology"},{"key":"e_1_3_3_29_2","doi-asserted-by":"crossref","first-page":"238","DOI":"10.1109\/ITSC.2003.1251955","volume-title":"Proceedings of the 2003 IEEE International Conference on Intelligent Transportation Systems","volume":"1","author":"Cheu Ruey Long","year":"2003","unstructured":"Ruey Long Cheu, Dipti Srinivasan, and Eng Tian Teh. 2003. Support vector machine models for freeway incident detection. In Proceedings of the 2003 IEEE International Conference on Intelligent Transportation Systems, Vol. 1. IEEE, 238\u2013243."},{"key":"e_1_3_3_30_2","first-page":"2383","volume-title":"Proceedings of the 32nd USENIX Security Symposium (USENIX Security \u201923)","author":"Christou Neophytos","year":"2023","unstructured":"Neophytos Christou, Di Jin, Vaggelis Atlidakis, Baishakhi Ray, and Vasileios P. Kemerlis. 2023. IvySyn: Automated vulnerability discovery in deep learning frameworks. In Proceedings of the 32nd USENIX Security Symposium (USENIX Security \u201923), 2383\u20132400."},{"key":"e_1_3_3_31_2","first-page":"37","volume-title":"Proceedings of the 17th European Symposium on Research in Computer Security (ESORICS \u201912)","author":"Crussell Jonathan","year":"2012","unstructured":"Jonathan Crussell, Clint Gibler, and Hao Chen. 2012. Attack of the clones: Detecting cloned applications on android markets. In Proceedings of the 17th European Symposium on Research in Computer Security (ESORICS \u201912). Springer, 37\u201354."},{"key":"e_1_3_3_32_2","doi-asserted-by":"publisher","DOI":"10.1145\/3597926.3598067"},{"key":"e_1_3_3_33_2","first-page":"1","volume-title":"Proceedings of the 46th IEEE\/ACM International Conference on Software Engineering","author":"Deng Yinlin","year":"2024","unstructured":"Yinlin Deng, Chunqiu Steven Xia, Chenyuan Yang, Shizhuo Dylan Zhang, Shujing Yang, and Lingming Zhang. 2024. Large language models are edge-case generators: Crafting unusual programs for fuzzing deep learning libraries. In Proceedings of the 46th IEEE\/ACM International Conference on Software Engineering, 1\u201313."},{"key":"e_1_3_3_34_2","doi-asserted-by":"publisher","DOI":"10.1145\/3540250.3549085"},{"key":"e_1_3_3_35_2","first-page":"28","volume-title":"Proceedings of the 2017 IEEE\/ACM 2nd International Workshop on Metamorphic Testing (MET)","author":"Ding Junhua","year":"2017","unstructured":"Junhua Ding, Xiaojun Kang, and Xin-Hua Hu. 2017. Validating a deep learning framework by metamorphic testing. In Proceedings of the 2017 IEEE\/ACM 2nd International Workshop on Metamorphic Testing (MET). IEEE, 28\u201334."},{"key":"e_1_3_3_36_2","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1109\/IWSC.2012.6227874","volume-title":"Proceedings of the 2012 6th International Workshop on Software Clones (IWSC)","author":"Elva Rochelle","year":"2012","unstructured":"Rochelle Elva and Gary T. Leavens. 2012. Semantic clone detection using method IOE-behavior. In Proceedings of the 2012 6th International Workshop on Software Clones (IWSC). IEEE, 80\u201381."},{"key":"e_1_3_3_37_2","doi-asserted-by":"publisher","DOI":"10.1016\/0360-1315(87)90042-X"},{"key":"e_1_3_3_38_2","first-page":"45","volume-title":"Proceedings of the 2021 International Symposium on Advanced Technologies and Applications in the Internet of Things (ATAIT \u201921)","author":"Gong Jianhao","year":"2021","unstructured":"Jianhao Gong, Hengyi Li, Qi Li, and Lin Meng. 2021. A deep analysis of grouped convolution schemes for improving deep learning performance. In Proceedings of the 2021 International Symposium on Advanced Technologies and Applications in the Internet of Things (ATAIT \u201921), 45\u201352."},{"key":"e_1_3_3_39_2","doi-asserted-by":"publisher","DOI":"10.1002\/rob.21918"},{"key":"e_1_3_3_40_2","doi-asserted-by":"publisher","DOI":"10.1145\/3510003.3510092"},{"key":"e_1_3_3_41_2","doi-asserted-by":"publisher","DOI":"10.1145\/3324884.3416571"},{"key":"e_1_3_3_42_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90"},{"key":"e_1_3_3_43_2","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1109\/SANER.2016.78","volume-title":"2016 IEEE 23rd International Conference on Software Analysis, Evolution, and Reengineering (SANER)","volume":"1","author":"Islam Judith F.","year":"2016","unstructured":"Judith F. Islam, Manishankar Mondal, and Chanchal K. Roy. 2016. Bug replication in code clones: An empirical study. In 2016 IEEE 23rd International Conference on Software Analysis, Evolution, and Reengineering (SANER), Vol. 1. IEEE, 68\u201378."},{"key":"e_1_3_3_44_2","doi-asserted-by":"publisher","DOI":"10.1145\/1287624.1287634"},{"key":"e_1_3_3_45_2","unstructured":"Weipeng Jiang Xiaoyu Zhang Xiaofei Xie Jiongchi Yu Yuhan Zhi Shiqing Ma and Chao Shen. 2025. The foundation cracks: A comprehensive study on bugs and testing practices in LLM libraries. arXiv:2506.12320. Retrieved from https:\/\/arxiv.org\/abs\/2506.12320"},{"key":"e_1_3_3_46_2","doi-asserted-by":"publisher","DOI":"10.1145\/2345156.2254075"},{"key":"e_1_3_3_47_2","unstructured":"Hong Jin Kang Pattarakrit Rattanukul Stefanus Agus Haryono Truong Giang Nguyen Chaiyong Ragkhitwetsagul Corina Pasareanu and David Lo. 2022. SkipFuzz: Active learning-based input selection for fuzzing deep learning libraries. arXiv:2212.04038. Retrieved from https:\/\/arxiv.org\/abs\/2212.04038"},{"key":"e_1_3_3_48_2","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1007\/978-1-4842-2766-4_7","volume-title":"Deep Learning with Python: A Hands-on Introduction","author":"Ketkar Nikhil","year":"2017","unstructured":"Nikhil Ketkar. 2017. Introduction to Keras. Deep Learning with Python: A Hands-on Introduction. Apress, 97\u2013111."},{"key":"e_1_3_3_49_2","first-page":"301","volume-title":"Proceedings of the 33rd International Conference on Software Engineering","author":"Kim Heejung","year":"2011","unstructured":"Heejung Kim, Yungbum Jung, Sunghun Kim, and Kwankeun Yi. 2011. MeCC: Memory comparison-based clone detector. In Proceedings of the 33rd International Conference on Software Engineering, 301\u2013310."},{"key":"e_1_3_3_50_2","doi-asserted-by":"publisher","DOI":"10.1145\/3065386"},{"key":"e_1_3_3_51_2","unstructured":"Alexandre Lacoste Alexandra Luccioni Victor Schmidt and Thomas Dandres. 2019. Quantifying the carbon emissions of machine learning. arXiv:1910.09700. Retrieved from https:\/\/arxiv.org\/abs\/1910.09700"},{"key":"e_1_3_3_52_2","doi-asserted-by":"publisher","DOI":"10.1093\/nsr\/nwx110"},{"key":"e_1_3_3_53_2","doi-asserted-by":"publisher","DOI":"10.1145\/3527317"},{"key":"e_1_3_3_54_2","doi-asserted-by":"publisher","DOI":"10.1145\/2635868.2635900"},{"key":"e_1_3_3_55_2","doi-asserted-by":"publisher","DOI":"10.1111\/jcal.12662"},{"key":"e_1_3_3_56_2","doi-asserted-by":"crossref","first-page":"364","DOI":"10.1109\/ICSE.2012.6227178","volume-title":"Proceedings of the 2012 34th International Conference on Software Engineering (ICSE)","author":"McMillan Collin","year":"2012","unstructured":"Collin McMillan, Mark Grechanik, and Denys Poshyvanyk. 2012. Detecting similar software applications. In Proceedings of the 2012 34th International Conference on Software Engineering (ICSE). IEEE, 364\u2013374."},{"key":"e_1_3_3_57_2","doi-asserted-by":"crossref","first-page":"747","DOI":"10.1109\/APSEC.2017.97","volume-title":"Proceedings of the 2017 24th Asia-Pacific Software Engineering Conference (APSEC)","author":"Misu Md Rakib Hossain","year":"2017","unstructured":"Md Rakib Hossain Misu and Kazi Sakib. 2017. Interface driven code clone detection. In Proceedings of the 2017 24th Asia-Pacific Software Engineering Conference (APSEC). IEEE, 747\u2013748."},{"key":"e_1_3_3_58_2","unstructured":"Yanzhou Mu Rong Wang Juan Zhai Chunrong Fang Xiang Chen Jiacong Wu An Guo Jiawei Shen Bingzhuo Li and Zhenyu Chen. 2025. Designing deep learning frameworks for LLMs: Challenges expectations and opportunities. arXiv:2506.13114. Retrieved from https:\/\/arxiv.org\/abs\/2506.13114"},{"key":"e_1_3_3_59_2","doi-asserted-by":"publisher","DOI":"10.1145\/3728972"},{"key":"e_1_3_3_60_2","doi-asserted-by":"publisher","DOI":"10.1175\/1520-0434(1996)011<0003:TFAASE>2.0.CO;2"},{"key":"e_1_3_3_61_2","first-page":"902","volume-title":"Proceedings of the 2015 IEEE\/ACM 37th IEEE International Conference on Software Engineering","volume":"1","author":"Nistor Adrian","year":"2015","unstructured":"Adrian Nistor, Po-Chun Chang, Cosmin Radoi, and Shan Lu. 2015. Caramel: Detecting and fixing performance problems that have non-intrusive fixes. In Proceedings of the 2015 IEEE\/ACM 37th IEEE International Conference on Software Engineering, Vol. 1. IEEE, 902\u2013912."},{"issue":"3","key":"e_1_3_3_62_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3313290","article-title":"Source-code similarity detection and detection tools used in academia: A systematic review","volume":"19","author":"Novak Matija","year":"2019","unstructured":"Matija Novak, Mike Joy, and Dragutin Kermek. 2019. Source-code similarity detection and detection tools used in academia: A systematic review. ACM Transactions on Computing Education 19, 3 (2019), 1\u201337.","journal-title":"ACM Transactions on Computing Education"},{"key":"e_1_3_3_63_2","first-page":"4901","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Odena Augustus","year":"2019","unstructured":"Augustus Odena, Catherine Olsson, David Andersen, and Ian Goodfellow. 2019. TensorFuzz: Debugging neural networks with coverage-guided fuzzing. In Proceedings of the International Conference on Machine Learning, 4901\u20134911."},{"key":"e_1_3_3_64_2","doi-asserted-by":"publisher","DOI":"10.1145\/382222.382462"},{"key":"e_1_3_3_65_2","first-page":"8026","article-title":"Pytorch: An imperative style, high-performance deep learning library","volume":"32","author":"Paszke Adam","year":"2019","unstructured":"Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, et al. 2019. Pytorch: An imperative style, high-performance deep learning library. In Advances in Neural Information Processing Systems, Vol. 32 (2019), 8026\u20138037.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_3_66_2","unstructured":"David Patterson Joseph Gonzalez Quoc Le Chen Liang Lluis-Miquel Munguia Daniel Rothchild David So Maud Texier and Jeff Dean. 2021. Carbon emissions and large neural network training. arXiv:2104.10350. Retrieved from https:\/\/arxiv.org\/abs\/2104.10350"},{"key":"e_1_3_3_67_2","first-page":"1027","volume-title":"Proceedings of the 2019 IEEE\/ACM 41st International Conference on Software Engineering (ICSE)","author":"Viet Pham Hung","year":"2019","unstructured":"Hung Viet Pham, Thibaud Lutellier, Weizhen Qi, and Lin Tan. 2019. CRADLE: Cross-backend validation to detect and localize bugs in deep learning libraries. In Proceedings of the 2019 IEEE\/ACM 41st International Conference on Software Engineering (ICSE). IEEE, 1027\u20131038."},{"key":"e_1_3_3_68_2","first-page":"44","volume-title":"Proceedings of the 2018 IEEE 12th International Workshop on Software Clones (IWSC)","author":"Ragkhitwetsagul Chaiyong","year":"2018","unstructured":"Chaiyong Ragkhitwetsagul, Jens Krinke, and Bruno Marnette. 2018. A picture is worth a thousand words: Code clone detection based on image similarity. In Proceedings of the 2018 IEEE 12th International Workshop on Software Clones (IWSC). IEEE, 44\u201350."},{"key":"e_1_3_3_69_2","first-page":"172","volume-title":"Proceedings of the 2008 16th IEEE International Conference on Program Comprehension","author":"Roy Chanchal K.","year":"2008","unstructured":"Chanchal K. Roy and James R. Cordy. 2008. NICAD: Accurate detection of near-miss intentional clones using flexible pretty-printing and code normalization. In Proceedings of the 2008 16th IEEE International Conference on Program Comprehension. IEEE, 172\u2013181."},{"key":"e_1_3_3_70_2","doi-asserted-by":"publisher","DOI":"10.1145\/2884781.2884877"},{"key":"e_1_3_3_71_2","first-page":"305","volume-title":"Proceedings of the 2025 IEEE\/ACM 47th International Conference on Software Engineering (ICSE)","author":"Shen Qingchao","year":"2024","unstructured":"Qingchao Shen, Yongqiang Tian, Haoyang Ma, Junjie Chen, Lili Huang, Ruifeng Fu, Shing-Chi Cheung, and Zan Wang. 2024. A tale of two DL cities: When library tests meet compiler. In Proceedings of the 2025 IEEE\/ACM 47th International Conference on Software Engineering (ICSE). IEEE Computer Society, 305\u2013316."},{"key":"e_1_3_3_72_2","doi-asserted-by":"publisher","DOI":"10.1145\/3688838"},{"key":"e_1_3_3_73_2","first-page":"1","volume-title":"Proceedings of the 2016 IEEE 24th International Conference on Program Comprehension (ICPC)","author":"Su Hsiang-Fang","year":"2016","unstructured":"Hsiang-Fang Su, Jonathan Bell, Gail Kaiser, and Simha Sethumadhavan. 2016. Identifying functionally similar code in complex codebases. In Proceedings of the 2016 IEEE 24th International Conference on Program Comprehension (ICPC). IEEE, 1\u201310."},{"key":"e_1_3_3_74_2","first-page":"27","volume-title":"Proceedings of the 2017 IEEE\/ACM 39th International Conference on Software Engineering Companion (ICSE-C)","author":"Svajlenko Jeffrey","year":"2017","unstructured":"Jeffrey Svajlenko and Chanchal Kumar Roy. 2017. Fast and flexible large-scale clone detection with CloneWorks. In Proceedings of the 2017 IEEE\/ACM 39th International Conference on Software Engineering Companion (ICSE-C), 27\u201330."},{"key":"e_1_3_3_75_2","doi-asserted-by":"publisher","DOI":"10.1093\/comjnl\/bxs018"},{"key":"e_1_3_3_76_2","first-page":"55","volume-title":"Proceedings of the 2020 IEEE International Conference on Artificial Intelligence Testing (AITest)","author":"Wang Chaojin","year":"2020","unstructured":"Chaojin Wang, Jian Shen, Chunrong Fang, Xiangsheng Guan, Kaitao Wu, and Jiang Wang. 2020. Accuracy measurement of deep neural network accelerator via metamorphic testing. In Proceedings of the 2020 IEEE International Conference on Artificial Intelligence Testing (AITest). IEEE, 55\u201361."},{"key":"e_1_3_3_77_2","doi-asserted-by":"publisher","DOI":"10.1145\/3510003.3510165"},{"key":"e_1_3_3_78_2","doi-asserted-by":"crossref","first-page":"38","DOI":"10.1109\/TSE.2024.3461657","article-title":"D3: Differential testing of distributed deep learning with model generation","volume":"51","author":"Wang Jiannan","year":"2024","unstructured":"Jiannan Wang, Hung Viet Pham, Qi Li, Lin Tan, Yu Guo, Adnan Aziz, and Erik Meijer. 2024. D3: Differential testing of distributed deep learning with model generation. IEEE Transactions on Software Engineering 51 (2024), 38\u201352.","journal-title":"IEEE Transactions on Software Engineering"},{"key":"e_1_3_3_79_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2023.111618"},{"key":"e_1_3_3_80_2","doi-asserted-by":"publisher","DOI":"10.1145\/3368089.3409761"},{"key":"e_1_3_3_81_2","doi-asserted-by":"publisher","DOI":"10.1145\/3510003.3510041"},{"key":"e_1_3_3_82_2","doi-asserted-by":"publisher","DOI":"10.1145\/3533767.3534220"},{"key":"e_1_3_3_83_2","first-page":"371","volume-title":"Proceedings of the 2024 IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER)","author":"Xie Danning","year":"2024","unstructured":"Danning Xie, Jiannan Wang, Hung Viet Pham, Lin Tan, Yu Guo, Adnan Aziz, and Erik Meijer. 2024. CEDAR: Continuous testing of deep learning libraries. In Proceedings of the 2024 IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER). IEEE, 371\u2013382."},{"key":"e_1_3_3_84_2","unstructured":"Chenyuan Yang Yinlin Deng Jiayi Yao Yuxing Tu Hanchi Li and Lingming Zhang. 2023. Fuzzing automatic differentiation in deep-learning libraries. arXiv:2302.04351. Retrieved from https:\/\/arxiv.org\/abs\/2302.04351"},{"key":"e_1_3_3_85_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2023.111796"},{"key":"e_1_3_3_86_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2019.00086"},{"key":"e_1_3_3_87_2","unstructured":"Susan Zhang Stephen Roller Naman Goyal Mikel Artetxe Moya Chen Shuohui Chen Christopher Dewan Mona Diab Xian Li Xi Victoria Lin et al. 2022. OPT: Open pre-trained transformer language models. arXiv:2205.01068. Retrieved from https:\/\/arxiv.org\/abs\/2205.01068"},{"key":"e_1_3_3_88_2","doi-asserted-by":"publisher","DOI":"10.1145\/3716497"},{"key":"e_1_3_3_89_2","doi-asserted-by":"publisher","DOI":"10.1145\/3460319.3464843"},{"key":"e_1_3_3_90_2","unstructured":"Yifan Zhang Junwen Yang Haoyu Dong Qingchen Wang Huajie Shao Kevin Leach and Yu Huang. 2022. ASTRO: An AST-assisted approach for generalizable neural clone detection. arXiv:2208.08067. Retrieved from https:\/\/arxiv.org\/abs\/2208.08067"},{"key":"e_1_3_3_91_2","doi-asserted-by":"publisher","DOI":"10.1145\/3468264.3468543"}],"container-title":["ACM Transactions on Software Engineering and Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3773993","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,17]],"date-time":"2026-06-17T14:55:13Z","timestamp":1781708113000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3773993"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,6,17]]},"references-count":90,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2026,7,31]]}},"alternative-id":["10.1145\/3773993"],"URL":"https:\/\/doi.org\/10.1145\/3773993","relation":{},"ISSN":["1049-331X","1557-7392"],"issn-type":[{"value":"1049-331X","type":"print"},{"value":"1557-7392","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,6,17]]},"assertion":[{"value":"2025-03-13","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-10-23","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-06-17","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}