{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,5]],"date-time":"2026-04-05T05:15:12Z","timestamp":1775366112570,"version":"3.50.1"},"reference-count":68,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2023,9,28]],"date-time":"2023-09-28T00:00:00Z","timestamp":1695859200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["62002129"],"award-info":[{"award-number":["62002129"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Natural Science Foundation of Hubei Province of China","award":["2021CFB577"],"award-info":[{"award-number":["2021CFB577"]}]},{"name":"Knowledge Innovation Program of Wuhan-Shuguang Project","award":["2022010801020280"],"award-info":[{"award-number":["2022010801020280"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Softw. Eng. Methodol."],"published-print":{"date-parts":[[2023,11,30]]},"abstract":"<jats:p>\n            Deep learning (DL) is a really active topic in recent years. Code cloning is a common code implementation that could negatively impact software maintenance. For DL software, developers rely heavily on frameworks to implement DL features. Meanwhile, to guarantee efficiency, developers often reuse the steps and configuration settings for building DL models. These may bring code copy-pastes or reuses inducing code clones. However, there is little work exploring code clones\u2019 impact on DL software. In this article, we conduct an empirical study and show that: (1) code clones are prevalent in DL projects, about 16.3% of code fragments encounter clones, which is almost twice larger than the traditional projects; (2) 75.6% of DL projects contain co-changed clones, meaning changes are propagated among cloned fragments, which can bring maintenance difficulties; (3)\u00a0\n            <jats:italic>Percentage of the clones<\/jats:italic>\n            and\n            <jats:italic>Number of clone lines<\/jats:italic>\n            are associated with the emergence of co-changes; (4) the prevalence of Code clones varies in DL projects with different frameworks, but the difference is not significant; (5) Type 1 co-changed clones often spread over different folders, but Types 2 and 3 co-changed clones mainly occur within the same files or folders; (6) 57.1% of all co-changed clones are involved in bugs.\n          <\/jats:p>","DOI":"10.1145\/3607181","type":"journal-article","created":{"date-parts":[[2023,7,3]],"date-time":"2023-07-03T12:13:28Z","timestamp":1688386408000},"page":"1-34","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":9,"title":["Exploring the Impact of Code Clones on Deep Learning Software"],"prefix":"10.1145","volume":"32","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7556-153X","authenticated-orcid":false,"given":"Ran","family":"Mo","sequence":"first","affiliation":[{"name":"Central China Normal University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3466-5102","authenticated-orcid":false,"given":"Yao","family":"Zhang","sequence":"additional","affiliation":[{"name":"Central China Normal University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9364-0992","authenticated-orcid":false,"given":"Yushuo","family":"Wang","sequence":"additional","affiliation":[{"name":"Central China Normal University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0220-1423","authenticated-orcid":false,"given":"Siyuan","family":"Zhang","sequence":"additional","affiliation":[{"name":"Central China Normal University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-4546-4335","authenticated-orcid":false,"given":"Pu","family":"Xiong","sequence":"additional","affiliation":[{"name":"Central China Normal University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7258-993X","authenticated-orcid":false,"given":"Zengyang","family":"Li","sequence":"additional","affiliation":[{"name":"Central China Normal University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4279-0111","authenticated-orcid":false,"given":"Yang","family":"Zhao","sequence":"additional","affiliation":[{"name":"Central China Normal University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2023,9,28]]},"reference":[{"key":"e_1_3_1_2_2","first-page":"265","volume-title":"Proceedings of the 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI\u201916)","author":"Abadi Mart\u00edn","year":"2016","unstructured":"Mart\u00edn Abadi, Paul Barham, Jianmin Chen, Zhifeng Chen, Andy Davis, Jeffrey Dean, Matthieu Devin, Sanjay Ghemawat, Geoffrey Irving, Michael Isard, Manjunath Kudlur, Josh Levenberg, Rajat Monga, Sherry Moore, Derek Gordon Murray, Benoit Steiner, Paul A. Tucker, Vijay Vasudevan, Pete Warden, Martin Wicke, Yuan Yu, and Xiaoqiang Zheng. 2016. TensorFlow: A system for large-scale machine learning. In Proceedings of the 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI\u201916), Kimberly Keeton and Timothy Roscoe (Eds.). USENIX Association, 265\u2013283. Retrieved from https:\/\/www.usenix.org\/conference\/osdi16\/technical-sessions\/presentation\/abadi."},{"key":"e_1_3_1_3_2","first-page":"81","volume-title":"Proceedings of the 11th European Conference on Software Maintenance and Reengineering, Software Evolution in Complex Software Intensive Systems (CSMR\u201907)","author":"Aversano Lerina","year":"2007","unstructured":"Lerina Aversano, Luigi Cerulo, and Massimiliano Di Penta. 2007. How clones are maintained: An empirical study. In Proceedings of the 11th European Conference on Software Maintenance and Reengineering, Software Evolution in Complex Software Intensive Systems (CSMR\u201907), Ren\u00e9 L. Krikhaar, Chris Verhoef, and Giuseppe A. Di Lucca (Eds.). IEEE Computer Society, 81\u201390. DOI:10.1109\/CSMR.2007.26"},{"key":"e_1_3_1_4_2","doi-asserted-by":"crossref","first-page":"496","DOI":"10.1145\/2901739.2903496","volume-title":"Proceedings of the 13th International Conference on Mining Software Repositories (MSR\u201916)","author":"Barnett Jacob G.","year":"2016","unstructured":"Jacob G. Barnett, Charles K. Gathuru, Luke S. Soldano, and Shane McIntosh. 2016. The relationship between commit message detail and defect proneness in Java projects on GitHub. In Proceedings of the 13th International Conference on Mining Software Repositories (MSR\u201916), Miryung Kim, Romain Robbes, and Christian Bird (Eds.). ACM, 496\u2013499. DOI:10.1145\/2901739.2903496"},{"key":"e_1_3_1_5_2","unstructured":"Jean Carletta. 1996. Assessing agreement on classification tasks: The kappa statistic. Retrieved from http:\/\/arxiv.org\/abs\/cmp-lg\/9602004."},{"key":"e_1_3_1_6_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2017.09.011"},{"key":"e_1_3_1_7_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE43902.2021.00068"},{"key":"e_1_3_1_8_2","first-page":"1","volume-title":"Proceedings of the 13th International Conference on Electronics, Computers and Artificial Intelligence (ECAI\u201921)","author":"Chirodea Mihai Cristian","year":"2021","unstructured":"Mihai Cristian Chirodea, Ovidiu-Constantin Novac, Cornelia Mihaela Novac, Nicu Bizon, Mihai Oproescu, and Cornelia Emilia Gordan. 2021. Comparison of tensorflow and PyTorch in convolutional neural network-based applications. In Proceedings of the 13th International Conference on Electronics, Computers and Artificial Intelligence (ECAI\u201921). IEEE, 1\u20136. DOI:10.1109\/ECAI52376.2021.9515098"},{"key":"e_1_3_1_9_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11432-020-3182-1"},{"key":"e_1_3_1_10_2","first-page":"219","article-title":"The development of a software clone detector","author":"Davey Neil","year":"1995","unstructured":"Neil Davey, Paul Barson, Simon Field, Ray Frank, and D. Tansley. 1995. The development of a software clone detector. Int. J. Appl. Softw. Technol. 1, 3\/4 (1995), 219-236.","journal-title":"Int. J. Appl. Softw. Technol."},{"key":"e_1_3_1_11_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2018.2880977"},{"key":"e_1_3_1_12_2","series-title":"Proceedings of the Extreme Programming and Agile Methods-XP\/Agile Universe 2002, 2nd XP Universe and 1st Agile Universe Conference","first-page":"256","volume":"2418","author":"Fowler Martin","year":"2002","unstructured":"Martin Fowler. 2002. Refactoring: Improving the design of existing code. In Proceedings of the Extreme Programming and Agile Methods-XP\/Agile Universe 2002, 2nd XP Universe and 1st Agile Universe Conference(Lecture Notes in Computer Science, Vol. 2418), Don Wells and Laurie A. Williams (Eds.). Springer, 256. DOI:10.1007\/3-540-45672-4_31"},{"key":"e_1_3_1_13_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2021.106566"},{"key":"e_1_3_1_14_2","first-page":"842","volume-title":"Proceedings of the IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW\u201919)","author":"Heghedus Cristina","year":"2019","unstructured":"Cristina Heghedus, Antorweep Chakravorty, and Chunming Rong. 2019. Neural network frameworks. Comparison on public transportation prediction. In Proceedings of the IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW\u201919). IEEE, 842\u2013849. DOI:10.1109\/IPDPSW.2019.00138"},{"key":"e_1_3_1_15_2","first-page":"99","volume-title":"Proceedings of the International Working Conference on Mining Software Repositories (MSR\u201908) (Co-located with ICSE)","author":"Hindle Abram","year":"2008","unstructured":"Abram Hindle, Daniel M. Germ\u00e1n, and Richard C. Holt. 2008. What do large commits tell us?: A taxonomical study of large commits. In Proceedings of the International Working Conference on Mining Software Repositories (MSR\u201908) (Co-located with ICSE), Ahmed E. Hassan, Michele Lanza, and Michael W. Godfrey (Eds.). ACM, 99\u2013108. DOI:10.1145\/1370750.1370773"},{"key":"e_1_3_1_16_2","first-page":"68","volume-title":"Proceedings of the IEEE 23rd International Conference on Software Analysis, Evolution, and Reengineering (SANER\u201916)","author":"Islam Judith F.","year":"2016","unstructured":"Judith F. Islam, Manishankar Mondal, and Chanchal K. Roy. 2016. Bug replication in code clones: An empirical study. In Proceedings of the IEEE 23rd International Conference on Software Analysis, Evolution, and Reengineering (SANER\u201916). IEEE Computer Society, 68\u201378. DOI:10.1109\/SANER.2016.78"},{"key":"e_1_3_1_17_2","first-page":"73","volume-title":"Proceedings of the 26th IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER\u201919)","author":"Islam Judith F.","year":"2019","unstructured":"Judith F. Islam, Manishankar Mondal, and Chanchal K. Roy. 2019. A comparative study of software bugs in micro-clones and regular code clones. In Proceedings of the 26th IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER\u201919), Xinyu Wang, David Lo, and Emad Shihab (Eds.). IEEE, 73\u201383. DOI:10.1109\/SANER.2019.8667993"},{"key":"e_1_3_1_18_2","first-page":"81","volume-title":"Proceedings of the 27th International Conference on Program Comprehension (ICPC\u201919)","author":"Islam Judith F.","year":"2019","unstructured":"Judith F. Islam, Manishankar Mondal, Chanchal K. Roy, and Kevin A. Schneider. 2019. Comparing bug replication in regular and micro code clones. In Proceedings of the 27th International Conference on Program Comprehension (ICPC\u201919), Yann-Ga\u00ebl Gu\u00e9h\u00e9neuc, Foutse Khomh, and Federica Sarro (Eds.). IEEE\/ACM, 81\u201392. DOI:10.1109\/ICPC.2019.00022"},{"key":"e_1_3_1_19_2","first-page":"510","volume-title":"Proceedings of the ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC\/SIGSOFT FSE\u201919)","author":"Islam Md. Johirul","year":"2019","unstructured":"Md. Johirul Islam, Giang Nguyen, Rangeet Pan, and Hridesh Rajan. 2019. A comprehensive study on deep learning bug characteristics. In Proceedings of the ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC\/SIGSOFT FSE\u201919), Marlon Dumas, Dietmar Pfahl, Sven Apel, and Alessandra Russo (Eds.). ACM, 510\u2013520. DOI:10.1145\/3338906.3338955"},{"key":"e_1_3_1_20_2","doi-asserted-by":"publisher","DOI":"10.1145\/3379597.3387479"},{"key":"e_1_3_1_21_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-021-10099-x"},{"key":"e_1_3_1_22_2","doi-asserted-by":"crossref","first-page":"604","DOI":"10.1007\/978-3-030-59410-7_40","volume-title":"Proceedings of the 25th International Conference on Database Systems for Advanced Applications","author":"Jia Li","year":"2020","unstructured":"Li Jia, Hao Zhong, Xiaoyin Wang, Linpeng Huang, and Xuansheng Lu. 2020. An empirical study on bugs inside TensorFlow. In Proceedings of the 25th International Conference on Database Systems for Advanced Applications. Springer-Verlag, Berlin, 604\u2013620. DOI:10.1007\/978-3-030-59410-7_40"},{"key":"e_1_3_1_23_2","first-page":"96","volume-title":"Proceedings of the 29th International Conference on Software Engineering (ICSE\u201907)","author":"Jiang Lingxiao","year":"2007","unstructured":"Lingxiao Jiang, Ghassan Misherghi, Zhendong Su, and St\u00e9phane Glondu. 2007. DECKARD: Scalable and accurate tree-based detection of code clones. In Proceedings of the 29th International Conference on Software Engineering (ICSE\u201907). IEEE Computer Society, 96\u2013105. DOI:10.1109\/ICSE.2007.30"},{"key":"e_1_3_1_24_2","first-page":"55","volume-title":"Proceedings of the 6th joint meeting of the European Software Engineering Conference and the ACM SIGSOFT International Symposium on Foundations of Software Engineering","author":"Jiang Lingxiao","year":"2007","unstructured":"Lingxiao Jiang, Zhendong Su, and Edwin Chiu. 2007. Context-based detection of clone-related bugs. In Proceedings of the 6th joint meeting of the European Software Engineering Conference and the ACM SIGSOFT International Symposium on Foundations of Software Engineering, Ivica Crnkovic and Antonia Bertolino (Eds.). ACM, 55\u201364. DOI:10.1145\/1287624.1287634"},{"key":"e_1_3_1_25_2","volume-title":"Why and how to control cloning in software artifacts","author":"J\u00fcrgens Elmar","year":"2011","unstructured":"Elmar J\u00fcrgens. 2011. Why and how to control cloning in software artifacts. Ph.D. Dissertation. Technical University Munich. Retrieved from http:\/\/mediatum.ub.tum.de\/node?id=997705."},{"key":"e_1_3_1_26_2","first-page":"485","volume-title":"Proceedings of the 31st International Conference on Software Engineering (ICSE\u201909)","author":"J\u00fcrgens Elmar","year":"2009","unstructured":"Elmar J\u00fcrgens, Florian Deissenboeck, Benjamin Hummel, and Stefan Wagner. 2009. Do code clones matter? In Proceedings of the 31st International Conference on Software Engineering (ICSE\u201909). IEEE, 485\u2013495. DOI:10.1109\/ICSE.2009.5070547"},{"key":"e_1_3_1_27_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2002.1019480"},{"key":"e_1_3_1_28_2","first-page":"107","article-title":"Toward a taxonomy of clones in source code: A case study","volume":"16","author":"Kapser Cory","year":"2003","unstructured":"Cory Kapser and Michael W. Godfrey. 2003. Toward a taxonomy of clones in source code: A case study. Evol. Large Scale Industr. Softw. Architect. 16 (2003), 107\u2013113.","journal-title":"Evol. Large Scale Industr. Softw. Architect."},{"issue":"6","key":"e_1_3_1_29_2","doi-asserted-by":"crossref","first-page":"645","DOI":"10.1007\/s10664-008-9076-6","article-title":"\u201cCloning considered harmful\u201d considered harmful: Patterns of cloning in software","volume":"13","author":"Kapser Cory J.","year":"2008","unstructured":"Cory J. Kapser and Michael W. Godfrey. 2008. \u201cCloning considered harmful\u201d considered harmful: Patterns of cloning in software. Empir. Softw. Eng. 13, 6 (2008), 645\u2013692.","journal-title":"Empir. Softw. Eng."},{"key":"e_1_3_1_30_2","first-page":"187","volume-title":"Proceedings of the 10th European Software Engineering Conference held jointly with 13th ACM SIGSOFT International Symposium on Foundations of Software Engineering","author":"Kim Miryung","year":"2005","unstructured":"Miryung Kim, Vibha Sazawal, David Notkin, and Gail C. Murphy. 2005. An empirical study of code clone genealogies. In Proceedings of the 10th European Software Engineering Conference held jointly with 13th ACM SIGSOFT International Symposium on Foundations of Software Engineering, Michel Wermelinger and Harald C. Gall (Eds.). ACM, 187\u2013196. DOI:10.1145\/1081706.1081737"},{"key":"e_1_3_1_31_2","first-page":"595","volume-title":"Proceedings of the IEEE Symposium on Security and Privacy (SP\u201917)","author":"Kim Seulbae","year":"2017","unstructured":"Seulbae Kim, Seunghoon Woo, Heejo Lee, and Hakjoo Oh. 2017. VUDDY: A scalable approach for vulnerable code clone discovery. In Proceedings of the IEEE Symposium on Security and Privacy (SP\u201917). IEEE Computer Society, 595\u2013614. DOI:10.1109\/SP.2017.62"},{"key":"e_1_3_1_32_2","doi-asserted-by":"publisher","DOI":"10.1145\/2560537"},{"key":"e_1_3_1_33_2","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1145\/1629575.1629596","volume-title":"Proceedings of the 22nd ACM Symposium on Operating Systems Principles (SOSP\u201909)","author":"Klein Gerwin","year":"2009","unstructured":"Gerwin Klein, Kevin Elphinstone, Gernot Heiser, June Andronick, David Cock, Philip Derrin, Dhammika Elkaduwe, Kai Engelhardt, Rafal Kolanski, Michael Norrish, Thomas Sewell, Harvey Tuch, and Simon Winwood. 2009. seL4: Formal verification of an OS kernel. In Proceedings of the 22nd ACM Symposium on Operating Systems Principles (SOSP\u201909), Jeanna Neefe Matthews and Thomas E. Anderson (Eds.). ACM, 207\u2013220. DOI:10.1145\/1629575.1629596"},{"key":"e_1_3_1_34_2","series-title":"Proceedings of the 8th International Symposium on Statistical Analysis (SAS\u201901)","first-page":"40","volume":"2126","author":"Komondoor Raghavan","year":"2001","unstructured":"Raghavan Komondoor and Susan Horwitz. 2001. Using slicing to identify duplication in source code. In Proceedings of the 8th International Symposium on Statistical Analysis (SAS\u201901) (Lecture Notes in Computer Science, Vol. 2126), Patrick Cousot (Ed.). Springer, 40\u201356. DOI:10.1007\/3-540-47764-0_3"},{"key":"e_1_3_1_35_2","doi-asserted-by":"crossref","first-page":"301","DOI":"10.1109\/WCRE.2001.957835","volume-title":"Proceedings of the 8th Working Conference on Reverse Engineering (WCRE\u201901)","author":"Krinke Jens","year":"2001","unstructured":"Jens Krinke. 2001. Identifying similar code with program dependence graphs. In Proceedings of the 8th Working Conference on Reverse Engineering (WCRE\u201901), Elizabeth Burd, Peter Aiken, and Rainer Koschke (Eds.). IEEE Computer Society, 301\u2013309. DOI:10.1109\/WCRE.2001.957835"},{"key":"e_1_3_1_36_2","first-page":"249","volume-title":"Proceedings of the IEEE International Conference on Software Maintenance and Evolution (ICSME\u201917)","author":"Li Liuqing","year":"2017","unstructured":"Liuqing Li, He Feng, Wenjie Zhuang, Na Meng, and Barbara G. Ryder. 2017. CCLearner: A deep learning-based clone detection approach. In Proceedings of the IEEE International Conference on Software Maintenance and Evolution (ICSME\u201917). IEEE Computer Society, 249\u2013260. DOI:10.1109\/ICSME.2017.46"},{"key":"e_1_3_1_37_2","first-page":"936","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201917)","author":"Lin Tsung-Yi","year":"2017","unstructured":"Tsung-Yi Lin, Piotr Doll\u00e1r, Ross B. Girshick, Kaiming He, Bharath Hariharan, and Serge J. Belongie. 2017. Feature pyramid networks for object detection. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201917). IEEE Computer Society, 936\u2013944. DOI:10.1109\/CVPR.2017.106"},{"key":"e_1_3_1_38_2","first-page":"106","volume-title":"Proceedings of the 29th International Conference on Software Engineering (ICSE\u201907)","author":"Livieri Simone","year":"2007","unstructured":"Simone Livieri, Yoshiki Higo, Makoto Matsushita, and Katsuro Inoue. 2007. Very-large scale code clone analysis and visualization of open source programs using distributed CCFinder: D-CCFinder. In Proceedings of the 29th International Conference on Software Engineering (ICSE\u201907). IEEE Computer Society, 106\u2013115. DOI:10.1109\/ICSE.2007.97"},{"key":"e_1_3_1_39_2","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1109\/ICSM.2008.4658071","volume-title":"Proceedings of the 24th IEEE International Conference on Software Maintenance (ICSM\u201908)","author":"Lozano Angela","year":"2008","unstructured":"Angela Lozano and Michel Wermelinger. 2008. Assessing the effect of clones on changeability. In Proceedings of the 24th IEEE International Conference on Software Maintenance (ICSM\u201908). IEEE Computer Society, 227\u2013236. DOI:10.1109\/ICSM.2008.4658071"},{"key":"e_1_3_1_40_2","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1145\/1808901.1808910","volume-title":"Proceeding of the 4th ICSE International Workshop on Software Clones (IWSC\u201910)","author":"Lozano Angela","year":"2010","unstructured":"Angela Lozano and Michel Wermelinger. 2010. Tracking clones\u2019 imprint. In Proceeding of the 4th ICSE International Workshop on Software Clones (IWSC\u201910), Katsuro Inoue, Stanislaw Jarzabek, Rainer Koschke, and James R. Cordy (Eds.). ACM, 65\u201372. DOI:10.1145\/1808901.1808910"},{"key":"e_1_3_1_41_2","unstructured":"Aleksander Madry Aleksandar Makelov Ludwig Schmidt Dimitris Tsipras and Adrian Vladu. 2017. Towards deep learning models resistant to adversarial attacks. Retrieved from http:\/\/arxiv.org\/abs\/1706.06083."},{"key":"e_1_3_1_42_2","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2006.246"},{"key":"e_1_3_1_43_2","volume-title":"Proceedings of the ACM\/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM\u201921)","author":"Mo Ran","year":"2021","unstructured":"Ran Mo, Yang Zhao, Qiong Feng, and Zengyang Li. 2021. The existence and co-modifications of code clones within or across microservices. In Proceedings of the ACM\/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM\u201921), Filippo Lanubile, Marcos Kalinowski, and Maria Teresa Baldassarre (Eds.). ACM, 22:1\u201322:11. DOI:10.1145\/3475716.3475784"},{"key":"e_1_3_1_44_2","first-page":"157","volume-title":"Proceedings of the IEEE International Conference on Software Maintenance and Evolution (ICSME\u201919)","author":"Mondal Manishankar","year":"2019","unstructured":"Manishankar Mondal, Banani Roy, Chanchal K. Roy, and Kevin A. Schneider. 2019. Investigating context adaptation bugs in code clones. In Proceedings of the IEEE International Conference on Software Maintenance and Evolution (ICSME\u201919). IEEE, 157\u2013168. DOI:10.1109\/ICSME.2019.00026"},{"key":"e_1_3_1_45_2","first-page":"93","volume-title":"Proceedings of the 27th IEEE International Conference on Software Analysis, Evolution, and Reengineering (SANER\u201920)","author":"Mondal Manishankar","year":"2020","unstructured":"Manishankar Mondal, Banani Roy, Chanchal K. Roy, and Kevin A. Schneider. 2020. Associating code clones with association rules for change impact analysis. In Proceedings of the 27th IEEE International Conference on Software Analysis, Evolution, and Reengineering (SANER\u201920), Kostas Kontogiannis, Foutse Khomh, Alexander Chatzigeorgiou, Marios-Eleftherios Fokaefs, and Minghui Zhou (Eds.). IEEE, 93\u2013103. DOI:10.1109\/SANER48275.2020.9054846"},{"key":"e_1_3_1_46_2","doi-asserted-by":"crossref","first-page":"1227","DOI":"10.1145\/2245276.2231969","volume-title":"Proceedings of the ACM Symposium on Applied Computing (SAC\u201912)","author":"Mondal Manishankar","year":"2012","unstructured":"Manishankar Mondal, Chanchal K. Roy, Md. Saidur Rahman, Ripon K. Saha, Jens Krinke, and Kevin A. Schneider. 2012. Comparative stability of cloned and non-cloned code: An empirical study. In Proceedings of the ACM Symposium on Applied Computing (SAC\u201912), Sascha Ossowski and Paola Lecca (Eds.). ACM, 1227\u20131234. DOI:10.1145\/2245276.2231969"},{"key":"e_1_3_1_47_2","first-page":"91","volume-title":"Proceedings of the IEEE International Conference on Software Maintenance and Evolution (ICSME\u201915)","author":"Mondal Manishankar","year":"2015","unstructured":"Manishankar Mondal, Chanchal K. Roy, and Kevin A. Schneider. 2015. A comparative study on the bug-proneness of different types of code clones. In Proceedings of the IEEE International Conference on Software Maintenance and Evolution (ICSME\u201915), Rainer Koschke, Jens Krinke, and Martin P. Robillard (Eds.). IEEE Computer Society, 91\u2013100. DOI:10.1109\/ICSM.2015.7332455"},{"key":"e_1_3_1_48_2","first-page":"38","volume-title":"Proceedings of the 11th IEEE International Workshop on Software Clones (IWSC\u201917)","author":"Mondal Manishankar","year":"2017","unstructured":"Manishankar Mondal, Chanchal K. Roy, and Kevin A. Schneider. 2017. Does cloned code increase maintenance effort? In Proceedings of the 11th IEEE International Workshop on Software Clones (IWSC\u201917), Nicholas A. Kraft, Michael W. Godfrey, and Hitesh Sajnani (Eds.). IEEE Computer Society, 38\u201344. DOI:10.1109\/IWSC.2017.7880507"},{"key":"e_1_3_1_49_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2017.11.039"},{"key":"e_1_3_1_50_2","first-page":"305","volume-title":"Proceedings of the 16th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS\u201911)","author":"Palix Nicolas","year":"2011","unstructured":"Nicolas Palix, Ga\u00ebl Thomas, Suman Saha, Christophe Calv\u00e8s, Julia Lawall, and Gilles Muller. 2011. Faults in linux: Ten years later. In Proceedings of the 16th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS\u201911), Rajiv Gupta and Todd C. Mowry (Eds.). ACM, 305\u2013318. DOI:10.1145\/1950365.1950401"},{"key":"e_1_3_1_51_2","first-page":"8024","volume-title":"Proceedings of the Annual Conference on Neural Information Processing Systems: Advances in Neural Information Processing Systems 32 (NeurIPS\u201919)","author":"Paszke Adam","year":"2019","unstructured":"Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, Alban Desmaison, Andreas K\u00f6pf, Edward Z. Yang, Zachary DeVito, Martin Raison, Alykhan Tejani, Sasank Chilamkurthy, Benoit Steiner, Lu Fang, Junjie Bai, and Soumith Chintala. 2019. PyTorch: An imperative style, high-performance deep learning library. In Proceedings of the Annual Conference on Neural Information Processing Systems: Advances in Neural Information Processing Systems 32 (NeurIPS\u201919), Hanna M. Wallach, Hugo Larochelle, Alina Beygelzimer, Florence d\u2019Alch\u00e9-Buc, Emily B. Fox, and Roman Garnett (Eds.). 8024\u20138035. Retrieved from https:\/\/proceedings.neurips.cc\/paper\/2019\/hash\/bdbca288fee7f92f2bfa9f7012727740-Abstract.html."},{"key":"e_1_3_1_52_2","first-page":"31","volume-title":"Proceedings of the 14th IEEE International Working Conference on Source Code Analysis and Manipulation (SCAM\u201914)","author":"Rahman Md. Saidur","year":"2014","unstructured":"Md. Saidur Rahman and Chanchal K. Roy. 2014. A change-type-based empirical study on the stability of cloned code. In Proceedings of the 14th IEEE International Working Conference on Source Code Analysis and Manipulation (SCAM\u201914). IEEE Computer Society, 31\u201340. DOI:10.1109\/SCAM.2014.13"},{"key":"e_1_3_1_53_2","first-page":"131","volume-title":"Proceedings of the 17th IEEE International Working Conference on Source Code Analysis and Manipulation (SCAM\u201917)","author":"Rahman Md. Saidur","year":"2017","unstructured":"Md. Saidur Rahman and Chanchal K. Roy. 2017. On the relationships between stability and bug-proneness of code clones: An empirical study. In Proceedings of the 17th IEEE International Working Conference on Source Code Analysis and Manipulation (SCAM\u201917). IEEE Computer Society, 131\u2013140. DOI:10.1109\/SCAM.2017.26"},{"key":"e_1_3_1_54_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcp.2018.10.045"},{"key":"e_1_3_1_55_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2013.01.008"},{"key":"e_1_3_1_56_2","doi-asserted-by":"crossref","first-page":"966","DOI":"10.1145\/2786805.2803183","volume-title":"Proceedings of the 10th Joint Meeting on Foundations of Software Engineering (ESEC\/FSE\u201915)","author":"Rosen Christoffer","year":"2015","unstructured":"Christoffer Rosen, Ben Grawi, and Emad Shihab. 2015. Commit guru: Analytics and risk prediction of software commits. In Proceedings of the 10th Joint Meeting on Foundations of Software Engineering (ESEC\/FSE\u201915), Elisabetta Di Nitto, Mark Harman, and Patrick Heymans (Eds.). ACM, 966\u2013969. DOI:10.1145\/2786805.2803183"},{"key":"e_1_3_1_57_2","first-page":"172","volume-title":"Proceedings of the 16th IEEE International Conference on Program Comprehension (ICPC\u201908)","author":"Roy Chanchal Kumar","year":"2008","unstructured":"Chanchal Kumar Roy and James R. Cordy. 2008. NICAD: Accurate detection of near-miss intentional clones using flexible pretty-printing and code normalization. In Proceedings of the 16th IEEE International Conference on Program Comprehension (ICPC\u201908), Ren\u00e9 L. Krikhaar, Ralf L\u00e4mmel, and Chris Verhoef (Eds.). IEEE Computer Society, 172\u2013181. DOI:10.1109\/ICPC.2008.41"},{"key":"e_1_3_1_58_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.scico.2009.02.007"},{"key":"e_1_3_1_59_2","first-page":"354","volume-title":"Proceedings of the ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC\/SIGSOFT FSE\u201918)","author":"Saini Vaibhav","year":"2018","unstructured":"Vaibhav Saini, Farima Farmahinifarahani, Yadong Lu, Pierre Baldi, and Cristina V. Lopes. 2018. Oreo: Detection of clones in the twilight zone. In Proceedings of the ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC\/SIGSOFT FSE\u201918), Gary T. Leavens, Alessandro Garcia, and Corina S. Pasareanu (Eds.). ACM, 354\u2013365. DOI:10.1145\/3236024.3236026"},{"key":"e_1_3_1_60_2","first-page":"1157","volume-title":"Proceedings of the 38th International Conference on Software Engineering (ICSE\u201916)","author":"Sajnani Hitesh","year":"2016","unstructured":"Hitesh Sajnani, Vaibhav Saini, Jeffrey Svajlenko, Chanchal K. Roy, and Cristina V. Lopes. 2016. SourcererCC: Scaling code clone detection to big-code. In Proceedings of the 38th International Conference on Software Engineering (ICSE\u201916), Laura K. Dillon, Willem Visser, and Laurie A. Williams (Eds.). ACM, 1157\u20131168. DOI:10.1145\/2884781.2884877"},{"key":"e_1_3_1_61_2","first-page":"2503","volume-title":"Proceedings of the Annual Conference on Neural Information Processing Systems: Advances in Neural Information Processing Systems 28","author":"Sculley D.","year":"2015","unstructured":"D. Sculley, Gary Holt, Daniel Golovin, Eugene Davydov, Todd Phillips, Dietmar Ebner, Vinay Chaudhary, Michael Young, Jean-Fran\u00e7ois Crespo, and Dan Dennison. 2015. Hidden technical debt in machine learning systems. In Proceedings of the Annual Conference on Neural Information Processing Systems: Advances in Neural Information Processing Systems 28, Corinna Cortes, Neil D. Lawrence, Daniel D. Lee, Masashi Sugiyama, and Roman Garnett (Eds.). 2503\u20132511. Retrieved from https:\/\/proceedings.neurips.cc\/paper\/2015\/hash\/86df7dcfd896fcaf2674f757a2463eba-Abstract.html."},{"key":"e_1_3_1_62_2","doi-asserted-by":"crossref","first-page":"2135","DOI":"10.1145\/2939672.2945397","volume-title":"Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining","author":"Seide Frank","year":"2016","unstructured":"Frank Seide and Amit Agarwal. 2016. CNTK: Microsoft\u2019s open-source deep-learning toolkit. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Balaji Krishnapuram, Mohak Shah, Alexander J. Smola, Charu C. Aggarwal, Dou Shen, and Rajeev Rastogi (Eds.). ACM, 2135. DOI:10.1145\/2939672.2945397"},{"key":"e_1_3_1_63_2","first-page":"321","volume-title":"Proceedings of the IEEE International Conference on Software Maintenance and Evolution","author":"Svajlenko Jeffrey","year":"2014","unstructured":"Jeffrey Svajlenko and Chanchal K. Roy. 2014. Evaluating modern clone detection tools. In Proceedings of the IEEE International Conference on Software Maintenance and Evolution. IEEE, 321\u2013330."},{"key":"e_1_3_1_64_2","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1109\/ICSME.2014.54","volume-title":"Proceedings of the 30th IEEE International Conference on Software Maintenance and Evolution (ICSME\u201914)","author":"Svajlenko Jeffrey","year":"2014","unstructured":"Jeffrey Svajlenko and Chanchal Kumar Roy. 2014. Evaluating modern clone detection tools. In Proceedings of the 30th IEEE International Conference on Software Maintenance and Evolution (ICSME\u201914). IEEE Computer Society, 321\u2013330. DOI:10.1109\/ICSME.2014.54"},{"key":"e_1_3_1_65_2","first-page":"1122","volume-title":"Proceedings of the 42nd International Conference on Software Engineering (ICSE\u201920)","author":"Tian Yuchi","year":"2020","unstructured":"Yuchi Tian, Ziyuan Zhong, Vicente Ordonez, Gail E. Kaiser, and Baishakhi Ray. 2020. Testing DNN image classifiers for confusion & bias errors. In Proceedings of the 42nd International Conference on Software Engineering (ICSE\u201920), Gregg Rothermel and Doo-Hwan Bae (Eds.). ACM, 1122\u20131134. DOI:10.1145\/3377811.3380400"},{"key":"e_1_3_1_66_2","first-page":"30","volume-title":"Proceedings of the 7th International Workshop on Software Clones (IWSC\u201913)","author":"Venkatasubramanyam Radhika D.","year":"2013","unstructured":"Radhika D. Venkatasubramanyam, Shrinath Gupta, and Himanshu Kumar Singh. 2013. Prioritizing code clone detection results for clone management. In Proceedings of the 7th International Workshop on Software Clones (IWSC\u201913). IEEE, 30\u201336."},{"key":"e_1_3_1_67_2","doi-asserted-by":"crossref","first-page":"1066","DOI":"10.1145\/3180155.3180179","volume-title":"Proceedings of the 40th International Conference on Software Engineering (ICSE\u201918)","author":"Wang Pengcheng","year":"2018","unstructured":"Pengcheng Wang, Jeffrey Svajlenko, Yanzhao Wu, Yun Xu, and Chanchal K. Roy. 2018. CCAligner: A token-based large-gap clone detector. In Proceedings of the 40th International Conference on Software Engineering (ICSE\u201918), Michel Chaudron, Ivica Crnkovic, Marsha Chechik, and Mark Harman (Eds.). ACM, 1066\u20131077. DOI:10.1145\/3180155.3180179"},{"key":"e_1_3_1_68_2","unstructured":"David Wheeler. 2001. SLOCCount. Retrieved from http:\/\/www.dwheeler.com\/sloccount\/."},{"key":"e_1_3_1_69_2","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1145\/3213846.3213866","volume-title":"Proceedings of the 27th ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA\u201918)","author":"Zhang Yuhao","year":"2018","unstructured":"Yuhao Zhang, Yifan Chen, Shing-Chi Cheung, Yingfei Xiong, and Lu Zhang. 2018. An empirical study on TensorFlow program bugs. In Proceedings of the 27th ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA\u201918), Frank Tip and Eric Bodden (Eds.). ACM, 129\u2013140. DOI:10.1145\/3213846.3213866"}],"container-title":["ACM Transactions on Software Engineering and Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3607181","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3607181","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:37:34Z","timestamp":1750178254000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3607181"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,28]]},"references-count":68,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2023,11,30]]}},"alternative-id":["10.1145\/3607181"],"URL":"https:\/\/doi.org\/10.1145\/3607181","relation":{},"ISSN":["1049-331X","1557-7392"],"issn-type":[{"value":"1049-331X","type":"print"},{"value":"1557-7392","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,28]]},"assertion":[{"value":"2022-07-27","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-06-20","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-09-28","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}