{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,5]],"date-time":"2026-04-05T05:15:36Z","timestamp":1775366136928,"version":"3.50.1"},"reference-count":89,"publisher":"Association for Computing Machinery (ACM)","issue":"8","funder":[{"name":"NSERC Vanier Canada Graduate Scholarships"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Softw. Eng. Methodol."],"published-print":{"date-parts":[[2025,11,30]]},"abstract":"<jats:p>\n            <jats:italic toggle=\"yes\">Deep Learning (DL)<\/jats:italic>\n            frameworks play a critical role in advancing AI, and their rapid growth underscores the need for a comprehensive understanding of software quality and maintainability. DL frameworks, like other systems, are prone to code clones. Code clones refer to identical or highly similar source code fragments within the same project or even across different projects. Code cloning can have positive and negative implications for software development, influencing maintenance, readability, and bug propagation. While the existing studies focus on studying clones in DL-based applications, to our knowledge, no work has been done investigating clones, their evolution, and their impact on the maintenance of DL frameworks. In this article, we aim to address the knowledge gap concerning the evolutionary dimension of code clones in DL frameworks and the extent of code reuse across these frameworks. We empirically analyze code clones in nine popular DL frameworks, i.e.,\n            <jats:italic toggle=\"yes\">TensorFlow<\/jats:italic>\n            ,\n            <jats:italic toggle=\"yes\">Paddle<\/jats:italic>\n            ,\n            <jats:italic toggle=\"yes\">PyTorch<\/jats:italic>\n            ,\n            <jats:italic toggle=\"yes\">Aesara<\/jats:italic>\n            ,\n            <jats:italic toggle=\"yes\">Ray<\/jats:italic>\n            ,\n            <jats:italic toggle=\"yes\">MXNet<\/jats:italic>\n            ,\n            <jats:italic toggle=\"yes\">Keras<\/jats:italic>\n            ,\n            <jats:italic toggle=\"yes\">Jax<\/jats:italic>\n            , and\n            <jats:italic toggle=\"yes\">BentoML<\/jats:italic>\n            , to investigate (1) the characteristics of the long-term code cloning evolution over releases in each framework, (2) the short-term, i.e., within-release, code cloning patterns and their influence on the long-term trends, and (3) the file-level code clones within the DL frameworks. Our findings reveal that DL frameworks adopt four distinct cloning trends: \u201cSerpentine,\u201d \u201cRise and Fall,\u201d \u201cDecreasing,\u201d and \u201cStable\u201d and that these trends present some common and distinct characteristics. For instance, bug-fixing activities persistently happen in clones irrespective of the clone evolutionary trend but occur more in the \u201cSerpentine\u201d trend. Moreover, the within-release level investigation demonstrates that short-term code cloning practices impact long-term cloning trends. The cross-framework code clone investigation reveals the presence of\n            <jats:italic toggle=\"yes\">functional<\/jats:italic>\n            and\n            <jats:italic toggle=\"yes\">architectural adaptation<\/jats:italic>\n            file-level cross-framework code clones across the nine studied frameworks. We provide insights that foster robust clone practices and collaborative maintenance in the development of DL frameworks.\n          <\/jats:p>","DOI":"10.1145\/3721125","type":"journal-article","created":{"date-parts":[[2025,2,28]],"date-time":"2025-02-28T10:31:29Z","timestamp":1740738689000},"page":"1-39","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Unraveling Code Clone Dynamics in Deep Learning Frameworks"],"prefix":"10.1145","volume":"34","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1274-7550","authenticated-orcid":false,"given":"Maram","family":"Assi","sequence":"first","affiliation":[{"name":"Computer Science, Universit\u00e9 du Qu\u00e9bec \u00e0 Montr\u00e9al, Montr\u00e9al, Quebec, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7090-0475","authenticated-orcid":false,"given":"Safwat","family":"Hassan","sequence":"additional","affiliation":[{"name":"Faculty of Information, University of Toronto, Toronto, Ontario, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5335-0261","authenticated-orcid":false,"given":"Ying","family":"Zou","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, Queen\u2019s University, Kingston, Ontario, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2025,10,4]]},"reference":[{"key":"e_1_3_2_2_2","unstructured":"Github. 2024. Github Ranking. Retrieved from https:\/\/github.com\/evanli\/github-ranking#moststars"},{"key":"e_1_3_2_3_2","first-page":"291","volume-title":"Proceedings of the IEEE\/ACM 41st International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP \u201919)","author":"Amershi Saleema","year":"2019","unstructured":"Saleema Amershi, Andrew Begel, Christian Bird, Robert DeLine, Harald Gall, Ece Kamar, Nachiappan Nagappan, Besmira Nushi, and Thomas Zimmermann. 2019. Software engineering for machine learning: A case study. In Proceedings of the IEEE\/ACM 41st International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP \u201919), 291\u2013300. DOI: 10.1109\/ICSE-SEIP.2019.00042"},{"key":"e_1_3_2_4_2","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1109\/CSMR.2007.26","volume-title":"Proceedings of the 11th European Conference on Software Maintenance and Reengineering (CSMR \u201907)","author":"Aversano Lerina","year":"2007","unstructured":"Lerina Aversano, Luigi Cerulo, and Massimiliano Di Penta. 2007. How clones are maintained: An empirical study. In Proceedings of the 11th European Conference on Software Maintenance and Reengineering (CSMR \u201907), 81\u201390. DOI: 10.1109\/CSMR.2007.26"},{"key":"e_1_3_2_5_2","doi-asserted-by":"crossref","first-page":"1187","DOI":"10.1007\/s11219-017-9375-5","article-title":"An investigation of the fault-proneness of clone evolutionary patterns","volume":"26","author":"Barbour Liliane","year":"2018","unstructured":"Liliane Barbour, Le An, Foutse Khomh, Ying Zou, and Shaohua Wang. 2018. An investigation of the fault-proneness of clone evolutionary patterns. Software Quality Journal 26 (2018), 1187\u20131222.","journal-title":"Software Quality Journal"},{"key":"e_1_3_2_6_2","first-page":"273","volume-title":"Proceedings of the 27th IEEE International Conference on Software Maintenance (ICSM \u201911)","author":"Barbour Liliane","year":"2011","unstructured":"Liliane Barbour, Foutse Khomh, and Ying Zou. 2011. Late propagation in software clones. In Proceedings of the 27th IEEE International Conference on Software Maintenance (ICSM \u201911), 273\u2013282. DOI: 10.1109\/ICSM.2011.6080794"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1002\/smr.1597"},{"key":"e_1_3_2_8_2","doi-asserted-by":"crossref","first-page":"353","DOI":"10.1145\/3196398.3196445","volume-title":"Proceedings of the IEEE\/ACM 15th International Conference on Mining Software Repositories (MSR \u201918)","author":"Braiek Houssem Ben","year":"2018","unstructured":"Houssem Ben Braiek, Foutse Khomh, and Bram Adams. 2018. The open-closed principle of modern machine learning frameworks. In Proceedings of the IEEE\/ACM 15th International Conference on Mining Software Repositories (MSR \u201918), 353\u2013363."},{"key":"e_1_3_2_9_2","first-page":"359","volume-title":"Proceedings of the 3rd International Conference on Knowledge Discovery and Data Mining (AAAIWS \u201994)","author":"Berndt Donald J.","year":"1994","unstructured":"Donald J. Berndt and James Clifford. 1994. Using dynamic time warping to find patterns in time series. In Proceedings of the 3rd International Conference on Knowledge Discovery and Data Mining (AAAIWS \u201994). AAAI Press, 359\u2013370."},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1145\/3587155"},{"key":"e_1_3_2_11_2","first-page":"582","volume-title":"Proceedings of the IEEE International Conference on Software Maintenance and Evolution (ICSME \u201922)","author":"Chochlov Muslim","year":"2022","unstructured":"Muslim Chochlov, Gul Aftab Ahmed, James Vincent Patten, Guoxian Lu, Wei Hou, David Gregg, and Jim Buckley. 2022. Using a nearest-neighbour, BERT-based approach for scalable clone detection. In Proceedings of the IEEE International Conference on Software Maintenance and Evolution (ICSME \u201922), 582\u2013591. DOI: 10.1109\/ICSME55016.2022.00080"},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.4324\/9780203774441"},{"key":"e_1_3_2_13_2","first-page":"22","volume-title":"Proceedings of the 13th International Conference on Predictive Models and Data Analytics in Software EngineeringPROMISE)","author":"Coppola Riccardo","year":"2017","unstructured":"Riccardo Coppola, Maurizio Morisio, and Marco Torchiano. 2017. Scripted GUI testing of android apps: A study on diffusion, evolution and fragility. In Proceedings of the 13th International Conference on Predictive Models and Data Analytics in Software Engineering (PROMISE). ACM, New York, NY, 22\u201332. DOI: 10.1145\/3127005.3127008"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1109\/TDSC.2022.3152239"},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-023-10292-0"},{"key":"e_1_3_2_16_2","volume-title":"Proceedings of the IEEE\/ACM 46th International Conference on Software Engineering (ICSE","author":"Feng Siyue","year":"2024","unstructured":"Siyue Feng, Wenqi Suo, Yueming Wu, Deqing Zou, Yang Liu, and Hai Jin. 2024. Machine learning is all you need: A simple token-based approach for effective code clone detection. In Proceedings of the IEEE\/ACM 46th International Conference on Software Engineering (ICSE \u201924). ACM, New York, NY, Article 222, 13 pages. DOI: 10.1145\/3597503.3639114"},{"key":"e_1_3_2_17_2","first-page":"22","volume-title":"Proceedings of the IEEE 15th International Workshop on Software Clones (IWSC \u201921","author":"Golubev Y.","year":"2021","unstructured":"Y. Golubev and T. Bryksin. 2021. On the nature of code cloning in open-source java projects. In Proceedings of the IEEE 15th International Workshop on Software Clones (IWSC \u201921). IEEE Computer Society, Los Alamitos, CA, 22\u201328. DOI: 10.1109\/IWSC53727.2021.00010"},{"key":"e_1_3_2_18_2","doi-asserted-by":"crossref","unstructured":"Florin Gorunescu. 2011. Data Mining: Concepts Models and Techniques. Springer: Intelligent Systems Reference Library Vol. 12.","DOI":"10.1007\/978-3-642-19721-5"},{"key":"e_1_3_2_19_2","first-page":"147","volume-title":"Proceedings of the IEEE\/ACM 45th International Conference on Software Engineering (ICSE \u201923)","author":"Guan Hao","year":"2023","unstructured":"Hao Guan, Ying Xiao, Jiaying Li, Yepang Liu, and Guangdong Bai. 2023. A comprehensive study of real-world bugs in machine learning model optimization. In Proceedings of the IEEE\/ACM 45th International Conference on Software Engineering (ICSE \u201923), 147\u2013158. DOI: 10.1109\/ICSE48619.2023.00024"},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1148\/radiology.143.1.7063747"},{"key":"e_1_3_2_21_2","first-page":"37","volume-title":"Proceedings of the IEEE 12th International Workshop on Software Clones (IWSC \u201918)","author":"Higo Yoshiki","year":"2018","unstructured":"Yoshiki Higo, Shinsuke Matsumoto, Shinji Kusumoto, Takashi Fujinami, and Takashi Hoshino. 2018. Correlation analysis between code clone metrics and project data on the same specification projects. In Proceedings of the IEEE 12th International Workshop on Software Clones (IWSC \u201918), 37\u201343. DOI: 10.1109\/IWSC.2018.8327317"},{"key":"e_1_3_2_22_2","doi-asserted-by":"crossref","unstructured":"Sharon Chee Yin Ho Vahid Majdinasab Mohayeminul Islam Diego Elias Costa Emad Shihab Foutse Khomh Sarah Nadi and Muhammad Raza. 2023. An empirical study on bugs inside PyTorch: A replication study. arXiv:2307.13777. Retrieved from https:\/\/arxiv.org\/abs\/2307.13777","DOI":"10.1109\/ICSME58846.2023.00031"},{"key":"e_1_3_2_23_2","doi-asserted-by":"crossref","first-page":"1110","DOI":"10.1145\/3377811.3380395","volume-title":"Proceedings of the ACM\/IEEE 42nd International Conference on Software Engineering (ICSE \u201920)","author":"Humbatova Nargiz","year":"2020","unstructured":"Nargiz Humbatova, Gunel Jahangirova, Gabriele Bavota, Vincenzo Riccio, Andrea Stocco, and Paolo Tonella. 2020. Taxonomy of real faults in deep learning systems. In Proceedings of the ACM\/IEEE 42nd International Conference on Software Engineering (ICSE \u201920). ACM, New York, NY, 1110\u20131121. DOI: 10.1145\/3377811.3380395"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-981-16-1927-4_1"},{"key":"e_1_3_2_25_2","first-page":"73","volume-title":"Proceedings of the IEEE 26th International Conference on Software Analysis, Evolution and Reengineering (SANER \u201919)","author":"Islam Judith F.","year":"2019","unstructured":"Judith F. Islam, Manishankar Mondal, and Chanchal K. Roy. 2019. A comparative study of software bugs in micro-clones and regular code clones. In Proceedings of the IEEE 26th International Conference on Software Analysis, Evolution and Reengineering (SANER \u201919), 73\u201383. DOI: 10.1109\/SANER.2019.8667993"},{"key":"e_1_3_2_26_2","volume-title":"Proceedings of the International Conference on Software Engineering and Knowledge Engineering","author":"Islam Judith F.","year":"2017","unstructured":"Judith F. Islam, Manishankar Mondal, Chanchal Kumar Roy, and Kevin A. Schneider. 2017. A comparative study of software bugs in clone and non-clone code. In Proceedings of the International Conference on Software Engineering and Knowledge Engineering. Retrieved from https:\/\/api.semanticscholar.org\/CorpusID:34980604"},{"key":"e_1_3_2_27_2","first-page":"510","volume-title":"Proceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC\/FSE \u201919)","author":"Islam Md Johirul","year":"2019","unstructured":"Md Johirul Islam, Giang Nguyen, Rangeet Pan, and Hridesh Rajan. 2019. A comprehensive study on deep learning bug characteristics. In Proceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC\/FSE \u201919). ACM, New York, NY, 510\u2013520. DOI: 10.1145\/3338906.3338955"},{"key":"e_1_3_2_28_2","doi-asserted-by":"crossref","first-page":"1135","DOI":"10.1145\/3377811.3380378","volume-title":"Proceedings of the ACM\/IEEE 42nd International Conference on Software Engineering (ICSE \u201920)","author":"Islam Md Johirul","year":"2020","unstructured":"Md Johirul Islam, Rangeet Pan, Giang Nguyen, and Hridesh Rajan. 2020. Repairing deep neural networks: Fix patterns and challenges. In Proceedings of the ACM\/IEEE 42nd International Conference on Software Engineering (ICSE \u201920). ACM, New York, NY, 1135\u20131146. DOI: 10.1145\/3377811.3380378"},{"key":"e_1_3_2_29_2","first-page":"23","volume-title":"Proceedings of the IEEE 12th International Workshop on Software Clones (IWSC \u201918)","author":"Islam Md Rakibul","year":"2018","unstructured":"Md Rakibul Islam and Minhaz F. Zibran. 2018. On the characteristics of buggy code clones: A code quality perspective. In Proceedings of the IEEE 12th International Workshop on Software Clones (IWSC \u201918), 23\u201329. DOI: 10.1109\/IWSC.2018.8327315"},{"key":"e_1_3_2_30_2","doi-asserted-by":"crossref","first-page":"420","DOI":"10.1145\/3379597.3387479","volume-title":"Proceedings of the 17th International Conference on Mining Software Repositories (MSR \u201920)","author":"Jebnoun Hadhemi","year":"2020","unstructured":"Hadhemi Jebnoun, Houssem Ben Braiek, Mohammad Masudur Rahman, and Foutse Khomh. 2020. The scent of deep learning code: An empirical study. In Proceedings of the 17th International Conference on Mining Software Repositories (MSR \u201920). ACM, New York, NY, 420\u2013430. DOI: 10.1145\/3379597.3387479"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-021-10099-x"},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2021.110935"},{"key":"e_1_3_2_33_2","first-page":"55","volume-title":"Proceedings of the 6th Joint Meeting of the European Software Engineering Conference and the ACM SIGSOFT Symposium on the Foundations of Software Engineering (ESEC-FSE \u201907)","author":"Jiang Lingxiao","year":"2007","unstructured":"Lingxiao Jiang, Zhendong Su, and Edwin Chiu. 2007. Context-based detection of clone-related bugs. In Proceedings of the 6th Joint Meeting of the European Software Engineering Conference and the ACM SIGSOFT Symposium on the Foundations of Software Engineering (ESEC-FSE \u201907). ACM, New York, NY, 55\u201364. DOI: 10.1145\/1287624.1287634"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-020-09848-1"},{"key":"e_1_3_2_35_2","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1109\/WCRE.2006.1","volume-title":"Proceedings of the 2006 13th Working Conference on Reverse Engineering","author":"Kapser Cory","year":"2006","unstructured":"Cory Kapser and Michael W. Godfrey. 2006. \u201cCloning considered harmful\u201d Considered harmful. In Proceedings of the 2006 13th Working Conference on Reverse Engineering, 19\u201328. DOI: 10.1109\/WCRE.2006.1"},{"key":"e_1_3_2_36_2","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1142\/S0218539399000292","article-title":"Logistic regression modeling of software quality","volume":"6","author":"Khoshgoftaar Taghi M.","year":"1999","unstructured":"Taghi M. Khoshgoftaar and Edward B. Allen. 1999. Logistic regression modeling of software quality. International Journal of Reliability, Quality and Safety Engineering 6 (1999), 303\u2013317. DOI: https:\/\/api.semanticscholar.org\/corpusid:61246258","journal-title":"International Journal of Reliability, Quality and Safety Engineering"},{"key":"e_1_3_2_37_2","first-page":"540","volume-title":"Proceedings of the IEEE\/ACM 18th International Conference on Mining Software Repositories (MSR \u201921)","author":"Kim Misoo","year":"2021","unstructured":"Misoo Kim, Youngkyoung Kim, and Eunseok Lee. 2021. Denchmark: A bug benchmark of deep learning-related software. In Proceedings of the IEEE\/ACM 18th International Conference on Mining Software Repositories (MSR \u201921), 540\u2013544. DOI: 10.1109\/MSR52588.2021.00070"},{"key":"e_1_3_2_38_2","doi-asserted-by":"crossref","first-page":"385","DOI":"10.1145\/3514094.3534167","volume-title":"Proceedings of the AAAI\/ACM Conference on AI, Ethics, and Society (AIES \u201922)","author":"Langenkamp Max","year":"2022","unstructured":"Max Langenkamp and Daniel N. Yue. 2022. How open source machine learning software shapes AI. In Proceedings of the AAAI\/ACM Conference on AI, Ethics, and Society (AIES \u201922). ACM, New York, NY, 385\u2013395. DOI: 10.1145\/3514094.3534167"},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2006.28"},{"key":"e_1_3_2_40_2","unstructured":"Zengyang Li Sicheng Wang Wenshuo Wang Peng Liang Ran Mo and Bing Li. 2023. Understanding bugs in multi-language deep learning frameworks. arXiv:2303.02695. Retrieved https:\/\/arxiv.org\/abs\/2303.02695"},{"key":"e_1_3_2_41_2","volume-title":"Proceedings of the Canadian Conference on AI","author":"Ling Charles X.","year":"2003","unstructured":"Charles X. Ling, Jin Huang, and Harry Zhang. 2003. AUC: A better measure than accuracy in comparing learning algorithms. In Proceedings of the Canadian Conference on AI. Retrieved from https:\/\/api.semanticscholar.org\/CorpusID:18614857"},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-020-09917-5"},{"key":"e_1_3_2_43_2","first-page":"90","volume-title":"Proceedings of the 26th International Conference on Evaluation and Assessment in Software Engineering (EASE \u201922)","author":"Long Guoming","year":"2022","unstructured":"Guoming Long and Tao Chen. 2022. On reporting performance and accuracy bugs for deep learning frameworks: An exploratory study from GitHub. In Proceedings of the 26th International Conference on Evaluation and Assessment in Software Engineering (EASE \u201922). ACM, New York, NY, 90\u201399. DOI: 10.1145\/3530019.3530029"},{"key":"e_1_3_2_44_2","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1109\/ICSM.2008.4658071","volume-title":"Proceedings of the 2008 IEEE International Conference on Software Maintenance","author":"Lozano Angela","year":"2008","unstructured":"Angela Lozano and Michel Wermelinger. 2008. Assessing the effect of clones on changeability. In Proceedings of the 2008 IEEE International Conference on Software Maintenance, 227\u2013236. DOI: 10.1109\/ICSM.2008.4658071"},{"key":"e_1_3_2_45_2","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1145\/1808901.1808910","volume-title":"Proceedings of the 4th International Workshop on Software Clones (IWSC \u201910)","author":"Lozano Angela","year":"2010","unstructured":"Angela Lozano and Michel Wermelinger. 2010. Tracking clones\u2019 imprint. In Proceedings of the 4th International Workshop on Software Clones (IWSC \u201910). ACM, New York, NY, 65\u201372. DOI: 10.1145\/1808901.1808910"},{"key":"e_1_3_2_46_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-015-9381-9"},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.1145\/3607181"},{"key":"e_1_3_2_48_2","first-page":"120","volume-title":"Proceedings of the 2000 International Conference on Software Maintenance","author":"Mockus","year":"2000","unstructured":"Mockus and Votta. 2000. Identifying reasons for software changes using historic databases. In Proceedings of the 2000 International Conference on Software Maintenance, 120\u2013130. DOI: 10.1109\/ICSM.2000.883028"},{"key":"e_1_3_2_49_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-017-9528-y"},{"key":"e_1_3_2_50_2","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1109\/ICSME.2019.00026","volume-title":"Proceedings of the 2019 IEEE International Conference on Software Maintenance and Evolution (ICSME)","author":"Mondal Manishankar","year":"2019","unstructured":"Manishankar Mondal, Banani Roy, Chanchal K. Roy, and Kevin A. Schneider. 2019. Investigating context adaptation bugs in code clones. In Proceedings of the 2019 IEEE International Conference on Software Maintenance and Evolution (ICSME), 157\u2013168. DOI: 10.1109\/ICSME.2019.00026"},{"key":"e_1_3_2_51_2","doi-asserted-by":"crossref","first-page":"1227","DOI":"10.1145\/2245276.2231969","volume-title":"Proceedings of the ACM Symposium on Applied Computing","author":"Mondal Manishankar","year":"2012","unstructured":"Manishankar Mondal, Chanchal Roy, Md Saidur Rahman, Ripon Saha, Jens Krinke, and Kevin Schneider. 2012. Comparative stability of cloned and non-cloned code: An empirical study. In Proceedings of the ACM Symposium on Applied Computing, 1227\u20131234. DOI: 10.1145\/2245276.2231969"},{"key":"e_1_3_2_52_2","first-page":"1","volume-title":"Proceedings of the IEEE 11th International Workshop on Software Clones (IWSC \u201917)","author":"Mondal Manishankar","year":"2017","unstructured":"Manishankar Mondal, Chanchal K. Roy, and Kevin A. Schneider. 2017. Does cloned code increase maintenance effort? In Proceedings of the IEEE 11th International Workshop on Software Clones (IWSC \u201917), 1\u20137. DOI: 10.1109\/IWSC.2017.7880507"},{"key":"e_1_3_2_53_2","first-page":"220","volume-title":"Proceedings of the IEEE International Conference on Software Maintenance and Evolution (ICSME \u201920)","author":"Mondal Manishankar","year":"2020","unstructured":"Manishankar Mondal, Chanchal K. Roy, and Kevin A. Schneider. 2020. A fine-grained analysis on the inconsistent changes in code clones. In Proceedings of the IEEE International Conference on Software Maintenance and Evolution (ICSME \u201920). IEEE, 220\u2013231."},{"key":"e_1_3_2_54_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-981-16-1927-4_12"},{"key":"e_1_3_2_55_2","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1109\/METRIC.2002.1011328","volume-title":"Proceedings of the 8th IEEE Symposium on Software Metrics","author":"Monden A.","year":"2002","unstructured":"A. Monden, D. Nakae, T. Kamiya, S. Sato, and K. Matsumoto. 2002. Software quality analysis by code clones in industrial legacy software. In Proceedings of the 8th IEEE Symposium on Software Metrics, 87\u201394. DOI: 10.1109\/METRIC.2002.1011328"},{"key":"e_1_3_2_56_2","doi-asserted-by":"crossref","unstructured":"Mohammad Mehdi Morovati Florian Tambon Mina Taraghi Amin Nikanjam and Foutse Khomh. 2023. Common challenges of deep reinforcement learning applications development: An empirical study. arXiv:2310.09575. Retrieved from https:\/\/arxiv.org\/abs\/2310.09575","DOI":"10.1007\/s10664-024-10500-5"},{"key":"e_1_3_2_57_2","doi-asserted-by":"publisher","unstructured":"M. Monzur Morshed Md Rahman and Salah Ahmed. 2012. A literature review of code clone analysis to improve software maintenance process. In Proceedings of the International Conference on Informatics Electronics & Vision (ICIEV 2012) 516\u2013521. DOI: 10.1109\/ICIEV.2012.6317478.","DOI":"10.1109\/ICIEV.2012.6317478"},{"key":"e_1_3_2_58_2","first-page":"20","volume-title":"Proceedings of the IEEE 13th International Workshop on Software Clones (IWSC \u201919)","author":"Mostafa Md. Jubair Ibna","year":"2019","unstructured":"Md. Jubair Ibna Mostafa. 2019. An empirical study on clone evolution by analyzing clone lifetime. In Proceedings of the IEEE 13th International Workshop on Software Clones (IWSC \u201919), 20\u201326. DOI: 10.1109\/IWSC.2019.8665850"},{"key":"e_1_3_2_59_2","first-page":"521","volume-title":"Proceedings of the 30th International Conference on Software Engineering (ICSE \u201908)","author":"Nagappan Nachiappan","year":"2008","unstructured":"Nachiappan Nagappan, Brendan Murphy, and Victor Basili. 2008. The influence of organizational structure on software quality: An empirical case study. In Proceedings of the 30th International Conference on Software Engineering (ICSE \u201908). ACM, New York, NY, 521\u2013530. DOI: 10.1145\/1368088.1368160"},{"key":"e_1_3_2_60_2","first-page":"830","volume-title":"Proceedings of the 29th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC\/FSE \u201921)","author":"Nakagawa Tasuku","year":"2021","unstructured":"Tasuku Nakagawa, Yoshiki Higo, and Shinji Kusumoto. 2021. NIL: Large-scale detection of large-variance clones. In Proceedings of the 29th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC\/FSE \u201921). ACM, New York, NY, 830\u2013841. DOI: 10.1145\/3468264.3468564"},{"key":"e_1_3_2_61_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2023.3326775"},{"key":"e_1_3_2_62_2","unstructured":"P. Pinheiro. 2010. Linear and Nonlinear Mixed Effects Models: Theory and Applications. Retrieved from https:\/\/cran.r-project.org\/web\/packages\/nlme\/nlme.pdf"},{"key":"e_1_3_2_63_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-019-09697-7"},{"key":"e_1_3_2_64_2","first-page":"131","volume-title":"Proceedings of the IEEE 17th International Working Conference on Source Code Analysis and Manipulation (SCAM \u201917)","author":"Rahman Md Saidur","year":"2017","unstructured":"Md Saidur Rahman and Chanchal K. Roy. 2017. On the relationships between stability and bug-proneness of code clones: An empirical study. In Proceedings of the IEEE 17th International Working Conference on Source Code Analysis and Manipulation (SCAM \u201917), 131\u2013140. DOI: 10.1109\/SCAM.2017.26"},{"key":"e_1_3_2_65_2","first-page":"38","volume-title":"Proceedings of the IEEE 14th International Workshop on Software Clones (IWSC \u201920)","author":"Rahman W.","year":"2020","unstructured":"W. Rahman, Y. Xu, F. Pu, J. Xuan, X. Jia, M. Basios, L. Kanthan, L. Li, F. Wu, and B. Xu. 2020. Clone detection on large scala codebases. In Proceedings of the IEEE 14th International Workshop on Software Clones (IWSC \u201920). IEEE Computer Society, Los Alamitos, CA, 38\u201344. DOI: 10.1109\/IWSC50091.2020.9047640"},{"key":"e_1_3_2_66_2","unstructured":"Stephen Romansky Cheng Chen Baljeet Malhotra and Abram Hindle. 2018. Sourcerer\u2019s apprentice and the study of code snippet migration. arXiv:1808.00106. Retrieved from http:\/\/arxiv.org\/abs\/1808.00106"},{"key":"e_1_3_2_67_2","doi-asserted-by":"publisher","DOI":"10.1016\/0377-0427(87)90125-7"},{"key":"e_1_3_2_68_2","unstructured":"Chanchal Roy and James Cordy. 2007. A survey on software clone detection research. Technical Report 2007-541 School of Computing Queen\u2019s University Kingston Ontario Canada (January 2007)."},{"key":"e_1_3_2_69_2","first-page":"172","volume-title":"Proceedings of the 2008 16th IEEE International Conference on Program Comprehension","author":"Roy Chanchal K.","year":"2008","unstructured":"Chanchal K. Roy and James R. Cordy. 2008. NICAD: Accurate detection of near-miss intentional clones using flexible pretty-printing and code normalization. In Proceedings of the 2008 16th IEEE International Conference on Program Comprehension, 172\u2013181. DOI: 10.1109\/ICPC.2008.41"},{"key":"e_1_3_2_70_2","first-page":"157","volume-title":"Proceedings of the 2009 International Conference on Software Testing, Verification, and Validation Workshops","author":"Roy Chanchal K.","year":"2009","unstructured":"Chanchal K. Roy and James R. Cordy. 2009. A mutation\/injection-based automatic framework for evaluating code clone detection tools. In Proceedings of the 2009 International Conference on Software Testing, Verification, and Validation Workshops, 157\u2013166. DOI: 10.1109\/ICSTW.2009.18"},{"key":"e_1_3_2_71_2","first-page":"1157","volume-title":"Proceedings of the 38th International Conference on Software Engineering (ICSE \u201916)","author":"Sajnani Hitesh","year":"2016","unstructured":"Hitesh Sajnani, Vaibhav Saini, Jeffrey Svajlenko, Chanchal K. Roy, and Cristina V. Lopes. 2016. SourcererCC: Scaling code clone detection to big-code. In Proceedings of the 38th International Conference on Software Engineering (ICSE \u201916). ACM, New York, NY, 1157\u20131168. DOI: 10.1145\/2884781.2884877"},{"key":"e_1_3_2_72_2","first-page":"72","volume-title":"Proceedings of the 9th International Conference on Information and Communication Systems (ICICS \u201918)","author":"Shatnawi Ali","year":"2018","unstructured":"Ali Shatnawi, Ghadeer Al-Bdour, Raffi Al-Qurran, and Mahmoud Al-Ayyoub. 2018. A comparative study of open source deep learning frameworks. In Proceedings of the 9th International Conference on Information and Communication Systems (ICICS \u201918), 72\u201377. DOI: 10.1109\/IACS.2018.8355444"},{"key":"e_1_3_2_73_2","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1109\/ICSME.2014.54","volume-title":"Proceedings of the 2014 IEEE International Conference on Software Maintenance and Evolution","author":"Svajlenko Jeffrey","year":"2014","unstructured":"Jeffrey Svajlenko and Chanchal K. Roy. 2014. Evaluating modern clone detection tools. In Proceedings of the 2014 IEEE International Conference on Software Maintenance and Evolution, 321\u2013330. DOI: 10.1109\/ICSME.2014.54"},{"key":"e_1_3_2_74_2","unstructured":"Florian Tambon Amin Nikanjam Le An Foutse Khomh and Giuliano Antoniol. 2021. Silent bugs in deep learning frameworks: An empirical study of Keras and TensorFlow. arXiv:2112.13314. Retrieved from https:\/\/arxiv.org\/abs\/2112.13314"},{"key":"e_1_3_2_75_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-018-9645-2"},{"key":"e_1_3_2_76_2","first-page":"913","volume-title":"Proceedings of the IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER \u201923)","author":"van Bladel Brent","year":"2023","unstructured":"Brent van Bladel and Serge Demeyer. 2023. A comparative study of code clone genealogies in test code and production code. In Proceedings of the IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER \u201923), 913\u2013920. DOI: 10.1109\/SANER56733.2023.00110"},{"key":"e_1_3_2_77_2","first-page":"79","volume-title":"Proceedings of the IEEE 23rd International Conference on Software Analysis, Evolution, and Reengineering (SANER \u201916), Vol. 1","author":"Wagner Stefan","year":"2016","unstructured":"Stefan Wagner, Asim Abdulkhaleq, Kamer Kaya, and Alexander Paar. 2016. On the relationship of inconsistent software clones and faults: An empirical study. In Proceedings of the IEEE 23rd International Conference on Software Analysis, Evolution, and Reengineering (SANER \u201916), Vol. 1, 79\u201389. DOI: 10.1109\/SANER.2016.94"},{"key":"e_1_3_2_78_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2019.2937083"},{"key":"e_1_3_2_79_2","first-page":"332","volume-title":"Proceedings of the 45th International Conference on Software Engineering (ICSE \u201923)","author":"Wang Yuekun","year":"2023","unstructured":"Yuekun Wang, Yuhang Ye, Yueming Wu, Weiwei Zhang, Yinxing Xue, and Yang Liu. 2023. Comparison and evaluation of clone detection techniques with different code representations. In Proceedings of the 45th International Conference on Software Engineering (ICSE \u201923). IEEE Press, 332\u2013344. DOI: 10.1109\/ICSE48619.2023.00039"},{"key":"e_1_3_2_80_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11831-018-09312-w"},{"key":"e_1_3_2_81_2","first-page":"788","volume-title":"Proceedings of the 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC\/FSE \u201920)","author":"Wang Zan","year":"2020","unstructured":"Zan Wang, Ming Yan, Junjie Chen, Shuang Liu, and Dongdi Zhang. 2020. Deep learning library testing via effective model generation. In Proceedings of the 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC\/FSE \u201920). ACM, New York, NY, 788\u2013799. DOI: 10.1145\/3368089.3409761"},{"key":"e_1_3_2_82_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2005.01.025"},{"key":"e_1_3_2_83_2","doi-asserted-by":"crossref","DOI":"10.1002\/0471704091","volume-title":"Applied Linear Regression","author":"Weisberg S.","year":"2005","unstructured":"S. Weisberg. 2005. Applied Linear Regression, Vol. 528, John Wiley & Sons."},{"key":"e_1_3_2_84_2","first-page":"1","article-title":"2022. An empirical study on release notes patterns of popular apps in the Google Play Store","volume":"27","author":"Yang Aidan Z. H.","year":"2022","unstructured":"Aidan Z. H. Yang, Safwat Hassan, Ying Zou, and A. Hassan. 2022. An empirical study on release notes patterns of popular apps in the Google Play Store. Empirical Software Engineering 27 (2022), 1\u201338. DOI: https:\/\/api.semanticscholar.org\/corpusid:238863459","journal-title":"Empirical Software Engineering"},{"key":"e_1_3_2_85_2","first-page":"115","volume-title":"Proceedings of the IEEE International Conference on Software Maintenance and Evolution (ICSME \u201918)","author":"Yue Ruru","year":"2018","unstructured":"Ruru Yue, Zhe Gao, Na Meng, Yingfei Xiong, Xiaoyin Wang, and J. David Morgenthaler. 2018. Automatic clone recommendation for refactoring based on the present and the past. In Proceedings of the IEEE International Conference on Software Maintenance and Evolution (ICSME \u201918), 115\u2013126. DOI: 10.1109\/ICSME.2018.00021"},{"key":"e_1_3_2_86_2","doi-asserted-by":"crossref","unstructured":"Morteza Zakeri-Nasrabadi Saeed Parsa Mohammad Ramezani Chanchal Roy and Masoud Ekhtiarzadeh. 2023. A systematic literature review on source code similarity measurement and clone detection: Techniques applications and challenges. arXiv:2306.16171. Retrieved from https:\/\/arxiv.org\/abs\/2306.16171","DOI":"10.1016\/j.jss.2023.111796"},{"key":"e_1_3_2_87_2","first-page":"783","volume-title":"Proceedings of the IEEE\/ACM 41st International Conference on Software Engineering (ICSE \u201919)","author":"Zhang Jian","year":"2019","unstructured":"Jian Zhang, Xu Wang, Hongyu Zhang, Hailong Sun, Kaixuan Wang, and Xudong Liu. 2019. A novel neural source code representation based on abstract syntax tree. In Proceedings of the IEEE\/ACM 41st International Conference on Software Engineering (ICSE \u201919), 783\u2013794. DOI: 10.1109\/ICSE.2019.00086"},{"key":"e_1_3_2_88_2","first-page":"104","volume-title":"Proceedings of the IEEE 30th International Symposium on Software Reliability Engineering (ISSRE \u201919)","author":"Zhang Tianyi","year":"2019","unstructured":"Tianyi Zhang, Cuiyun Gao, Lei Ma, Michael Lyu, and Miryung Kim. 2019. An empirical study of common challenges in developing deep learning applications. In Proceedings of the IEEE 30th International Symposium on Software Reliability Engineering (ISSRE \u201919), 104\u2013115. DOI: 10.1109\/ISSRE.2019.00020"},{"key":"e_1_3_2_89_2","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1145\/3213846.3213866","volume-title":"Proceedings of the 27th ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA \u201918)","author":"Zhang Yuhao","year":"2018","unstructured":"Yuhao Zhang, Yifan Chen, Shing-Chi Cheung, Yingfei Xiong, and Lu Zhang. 2018. An empirical study on TensorFlow program bugs. In Proceedings of the 27th ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA \u201918). ACM, New York, NY, 129\u2013140. DOI: 10.1145\/3213846.3213866"},{"key":"e_1_3_2_90_2","doi-asserted-by":"crossref","first-page":"461","DOI":"10.1145\/3569966.3570091","volume-title":"Proceedings of the 5th International Conference on Computer Science and Software Engineering (CSSE \u201922)","author":"Zhong Yan","year":"2022","unstructured":"Yan Zhong, Xunhui Zhang, Wang Tao, and Yanzhi Zhang. 2022. A systematic literature review of clone evolution. In Proceedings of the 5th International Conference on Computer Science and Software Engineering (CSSE \u201922). ACM, New York, NY, 461\u2013473. DOI: 10.1145\/3569966.3570091"}],"container-title":["ACM Transactions on Software Engineering and Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3721125","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,4]],"date-time":"2025-10-04T13:46:31Z","timestamp":1759585591000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3721125"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,10,4]]},"references-count":89,"journal-issue":{"issue":"8","published-print":{"date-parts":[[2025,11,30]]}},"alternative-id":["10.1145\/3721125"],"URL":"https:\/\/doi.org\/10.1145\/3721125","relation":{},"ISSN":["1049-331X","1557-7392"],"issn-type":[{"value":"1049-331X","type":"print"},{"value":"1557-7392","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,10,4]]},"assertion":[{"value":"2024-02-21","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-02-22","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-10-04","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}