{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,25]],"date-time":"2026-02-25T17:12:05Z","timestamp":1772039525147,"version":"3.50.1"},"reference-count":83,"publisher":"Association for Computing Machinery (ACM)","issue":"ISSTA","funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["Grant Nos. U24B20149 and 62272271"],"award-info":[{"award-number":["Grant Nos. U24B20149 and 62272271"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"the Natural Science Foundation of Shandong Province","award":["Grant No. ZR2024QF093"],"award-info":[{"award-number":["Grant No. ZR2024QF093"]}]},{"name":"the Taishan Scholars Program","award":["Grant No. tsqn202408009"],"award-info":[{"award-number":["Grant No. tsqn202408009"]}]},{"name":"the Research Grants Council of Hong Kong, and the Industry Research Project funds","award":["Grant Nos. 6000871, 6000796, 9229109, 9229098, 9220103, and 9229029"],"award-info":[{"award-number":["Grant Nos. 6000871, 6000796, 9229109, 9229098, 9220103, and 9229029"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. ACM Softw. Eng."],"published-print":{"date-parts":[[2025,6,22]]},"abstract":"<jats:p>In recent years, Large Language Models (LLMs) have dramatically advanced the performance of automated code translation, making their computational accuracy score reach up to over 80% on many previous benchmarks. However, most code samples in these benchmarks are short, standalone, statement\/method-level, and algorithmic, which is not aligned with practical coding tasks. Therefore, it is still unknown the actual capability of LLMs in translating code samples written for daily development.<\/jats:p>\n          <jats:p>To achieve this, we construct a class-level code translation benchmark, ClassEval-T, and make the first attempt to extensively assess recent LLMs' performance on class-level code translation. ClassEval-T is extended from ClassEval, a well-known class-level Python code generation benchmark consisting of multiple practical coding topics, such as database operation and game design, and diverse contextual dependencies (e.g., fields, methods, and libraries). It cost us 360 person-hours to accomplish the manual migration to Java and C++ with complete code samples and associated test suites. Subsequently, we design three translation strategies (i.e., holistic, min-dependency, and standalone) for class-level code translations and evaluate eight recent LLMs of commercial, general, and code kinds in diverse families and sizes on ClassEval-T. Experimental results demonstrate a remarkable performance drop compared with the most widely studied method-level code translation benchmark, and obvious discrepancies among LLMs appear, showing the effectiveness of ClassEval-T in measuring recent LLMs. Afterwards, we further discuss the usage scenarios for diverse translation strategies and LLMs' ability to dependency awareness when translating class samples. Finally, 1,243 failure cases made by the best-performing LLM under test are thoroughly analyzed and categorized in this paper for practical guidance and future enlightenment.<\/jats:p>","DOI":"10.1145\/3728940","type":"journal-article","created":{"date-parts":[[2025,6,22]],"date-time":"2025-06-22T10:52:56Z","timestamp":1750589576000},"page":"1421-1444","source":"Crossref","is-referenced-by-count":5,"title":["ClassEval-T: Evaluating Large Language Models in Class-Level Code Translation"],"prefix":"10.1145","volume":"2","author":[{"ORCID":"https:\/\/orcid.org\/0009-0007-3395-9575","authenticated-orcid":false,"given":"Pengyu","family":"Xue","sequence":"first","affiliation":[{"name":"Shandong University, Qingdao, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-7624-156X","authenticated-orcid":false,"given":"Linhao","family":"Wu","sequence":"additional","affiliation":[{"name":"Shandong University, Qingdao, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0670-4538","authenticated-orcid":false,"given":"Zhen","family":"Yang","sequence":"additional","affiliation":[{"name":"Shandong University, Qingdao, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-4153-6774","authenticated-orcid":false,"given":"Chengyi","family":"Wang","sequence":"additional","affiliation":[{"name":"Shandong University, Qingdao, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-3473-8221","authenticated-orcid":false,"given":"Xiang","family":"Li","sequence":"additional","affiliation":[{"name":"Shandong University, Qingdao, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-5366-9140","authenticated-orcid":false,"given":"Yuxiang","family":"Zhang","sequence":"additional","affiliation":[{"name":"Shandong University, Qingdao, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5579-8852","authenticated-orcid":false,"given":"Jia","family":"Li","sequence":"additional","affiliation":[{"name":"Tsinghua University, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-9253-7906","authenticated-orcid":false,"given":"Ruikai","family":"Jin","sequence":"additional","affiliation":[{"name":"Shandong University, Qingdao, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-1351-0565","authenticated-orcid":false,"given":"Yifei","family":"Pei","sequence":"additional","affiliation":[{"name":"Shandong University, Qingdao, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9526-6634","authenticated-orcid":false,"given":"Zhaoyan","family":"Shen","sequence":"additional","affiliation":[{"name":"Shandong University, Qingdao, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-8861-8907","authenticated-orcid":false,"given":"Xiran","family":"Lyu","sequence":"additional","affiliation":[{"name":"Shandong University, Qingdao, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3803-9600","authenticated-orcid":false,"given":"Jacky Wai","family":"Keung","sequence":"additional","affiliation":[{"name":"City University of Hong Kong, Hong Kong, Hong Kong"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2025,6,22]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Anthropic. https:\/\/www.anthropic.com\/claude\/sonnet [Online","year":"2025","unstructured":"[n. d.]. Claude 3.5 Sonnet, Anthropic. https:\/\/www.anthropic.com\/claude\/sonnet [Online; accessed 2025-02-17]"},{"key":"e_1_2_1_2_1","volume-title":"d.]. Codeforces. https:\/\/codeforces.com\/ [Online","year":"2025","unstructured":"[n. d.]. Codeforces. https:\/\/codeforces.com\/ [Online; accessed 2025-02-21]"},{"key":"e_1_2_1_3_1","volume-title":"d.]. wLinHoo\/ClassEval-T. https:\/\/github.com\/wLinHoo\/ClassEval-T [Online","year":"2025","unstructured":"[n. d.]. wLinHoo\/ClassEval-T. https:\/\/github.com\/wLinHoo\/ClassEval-T [Online; accessed 2025-04-09]"},{"key":"e_1_2_1_4_1","volume-title":"https:\/\/openai.com\/ [Online","author":"AI.","year":"2025","unstructured":"2025. OpenAI. https:\/\/openai.com\/ [Online; accessed 2025-02-17]"},{"key":"e_1_2_1_5_1","volume-title":"Medec: A benchmark for medical error detection and correction in clinical notes. arXiv preprint arXiv:2412.19260.","author":"Abacha Asma Ben","year":"2024","unstructured":"Asma Ben Abacha, Wen-wai Yim, Yujuan Fu, Zhaoyi Sun, Meliha Yetisgen, Fei Xia, and Thomas Lin. 2024. Medec: A benchmark for medical error detection and correction in clinical notes. arXiv preprint arXiv:2412.19260."},{"key":"e_1_2_1_6_1","volume-title":"Saikat Chakraborty, and Kai-Wei Chang.","author":"Ahmad Wasi","year":"2023","unstructured":"Wasi Ahmad, Md Golam Rahman Tushar, Saikat Chakraborty, and Kai-Wei Chang. 2023. AVATAR: A Parallel Corpus for Java-Python Program Translation. In Findings of the Association for Computational Linguistics: ACL 2023. 2268\u20132281."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3551349.3559555"},{"key":"e_1_2_1_8_1","unstructured":"Apache Maven. 2024. Maven - Java Project Management and Comprehension Tool. https:\/\/maven.apache.org\/ (Accessed on 10\/31\/2024)"},{"key":"e_1_2_1_9_1","unstructured":"Baidu Qianfan. 2024. Baidu Qianfan Platform - Open API Interface. https:\/\/qianfan.cloud.baidu.com\/ (Accessed on 10\/31\/2024)"},{"key":"e_1_2_1_10_1","volume-title":"Jared Kaplan, Harri Edwards, Yuri Burda, Nicholas Joseph, and Greg Brockman.","author":"Chen Mark","year":"2021","unstructured":"Mark Chen, Jerry Tworek, Heewoo Jun, Qiming Yuan, Henrique Ponde De Oliveira Pinto, Jared Kaplan, Harri Edwards, Yuri Burda, Nicholas Joseph, and Greg Brockman. 2021. Evaluating large language models trained on code. arXiv preprint arXiv:2107.03374."},{"key":"e_1_2_1_11_1","unstructured":"Cplusplus.com. 2024. C++ Reference - Standard C++ Library Reference. https:\/\/cplusplus.com\/reference\/ (Accessed on 10\/31\/2024)"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/ESEM.2011.36"},{"key":"e_1_2_1_13_1","unstructured":"Deepseek. 2024. Deepseek - Official API Interface. https:\/\/www.deepseek.com\/zh (Accessed on 10\/31\/2024)"},{"key":"e_1_2_1_14_1","unstructured":"DeepSeek Team. 2024. DeepSeek. https:\/\/www.deepseek.com\/ (Accessed on 10\/27\/2024)"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2024.107584"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3597503.3639219"},{"key":"e_1_2_1_17_1","unstructured":"Abhimanyu Dubey Abhinav Jauhri Abhinav Pandey Abhishek Kadian Ahmad Al-Dahle Aiesha Letman Akhil Mathur Alan Schelten Amy Yang and Angela Fan. 2024. The llama 3 herd of models. arXiv preprint arXiv:2407.21783."},{"key":"e_1_2_1_18_1","unstructured":"Hasan Ferit Eniser Hanliang Zhang Cristina David Meng Wang Brandon Paulsen Joey Dodds and Daniel Kroening. 2024. Towards Translating Real-World Code with LLMs: A Study of Translating to Rust. arXiv preprint arXiv:2405.11514."},{"key":"e_1_2_1_19_1","volume-title":"Proc. European Workshop on Software Maintenance.","year":"1995","unstructured":"Favre, Jean-Marie. 1995. The CPP Paradox. In Proc. European Workshop on Software Maintenance."},{"key":"e_1_2_1_20_1","unstructured":"Geeks for Geeks. 2024. Geeks for Geeks - A Computer Science Portal for Geeks. https:\/\/www.geeksforgeeks.org\/ (Accessed on 10\/31\/2024)"},{"key":"e_1_2_1_21_1","unstructured":"GitHub Octoverse. 2024. The top programming languages | The State of the Octoverse. https:\/\/octoverse.github.com\/2022\/top-programming-languages?src_trk=em6690b43a717440.491810831822941226 (Accessed on 10\/27\/2024)"},{"key":"e_1_2_1_22_1","unstructured":"Google. 2024. GoogleTest - C++ Testing Framework. https:\/\/google.github.io\/googletest\/ (Accessed on 10\/31\/2024)"},{"key":"e_1_2_1_23_1","volume-title":"Rangeet Pan, Saurabh Sinha, and Reyhaneh Jabbarvand.","author":"Ibrahimzada Ali Reza","year":"2024","unstructured":"Ali Reza Ibrahimzada, Kaiyao Ke, Mrigank Pawagi, Muhammad Salman Abid, Rangeet Pan, Saurabh Sinha, and Reyhaneh Jabbarvand. 2024. Repository-level compositional code translation and validation. arXiv preprint arXiv:2410.24117."},{"key":"e_1_2_1_24_1","volume-title":"d.]. AtCoder. https:\/\/atcoder.jp\/ [Online","author":"AtCoder Inc.","year":"2025","unstructured":"AtCoder Inc.. [n. d.]. AtCoder. https:\/\/atcoder.jp\/ [Online; accessed 2025-02-22]"},{"key":"e_1_2_1_25_1","doi-asserted-by":"crossref","unstructured":"Siyuan Jiang Jia Li He Zong Huanyu Liu Hao Zhu Shukai Hu Erlu Li Jiazheng Ding Yu Han and Wei Ning. 2024. aiXcoder-7B: A Lightweight and Effective Large Language Model for Code Completion. arXiv preprint arXiv:2410.13187.","DOI":"10.32388\/ATAHD0"},{"key":"e_1_2_1_26_1","volume-title":"2023 38th IEEE\/ACM International Conference on Automated Software Engineering (ASE). 1529\u20131541","author":"Jiao Mingsheng","year":"2023","unstructured":"Mingsheng Jiao, Tingrui Yu, Xuan Li, Guanjie Qiu, Xiaodong Gu, and Beijun Shen. 2023. On the evaluation of neural code translation: Taxonomy and benchmark. In 2023 38th IEEE\/ACM International Conference on Automated Software Engineering (ASE). 1529\u20131541."},{"key":"e_1_2_1_27_1","unstructured":"JUnit 5. 2024. JUnit 5 - Testing Framework for Java. https:\/\/junit.org\/junit5\/ (Accessed on 10\/31\/2024)"},{"key":"e_1_2_1_28_1","volume-title":"Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 6766\u20136805","author":"Matin Khan Mohammad Abdullah","year":"2024","unstructured":"Mohammad Abdullah Matin Khan, M Saiful Bari, Do Long, Weishi Wang, Md Rizwan Parvez, and Shafiq Joty. 2024. Xcodeeval: An execution-based large scale multilingual multitask benchmark for code understanding, generation, translation and retrieval. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 6766\u20136805."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3690635"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.48550\/ARXIV.2404.00599"},{"key":"e_1_2_1_31_1","doi-asserted-by":"crossref","unstructured":"Jia Li Ge Li Yunfei Zhao Yongmin Li Huanyu Liu Hao Zhu Lecheng Wang Kaibo Liu Zheng Fang and Lanshen Wang. 2024. DevEval: A Manually-Annotated Code Generation Benchmark Aligned with Real-World Code Repositories. arXiv preprint arXiv:2405.19856.","DOI":"10.18653\/v1\/2024.findings-acl.214"},{"key":"e_1_2_1_32_1","volume-title":"Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics","author":"Li Jia","year":"2024","unstructured":"Jia Li, Ge Li, Yunfei Zhao, Yongmin Li, Huanyu Liu, Hao Zhu, Lecheng Wang, Kaibo Liu, Zheng Fang, Lanshen Wang, Jiazheng Ding, Xuanming Zhang, Yuqi Zhu, Yihong Dong, Zhi Jin, Binhua Li, Fei Huang, and Yongbin Li. 2024. DevEval: A Manually-Annotated Code Generation Benchmark Aligned with Real-World Code Repositories. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, Bangkok, Thailand."},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3675395"},{"key":"e_1_2_1_34_1","article-title":"StarCoder: May the Source be With You!","author":"Li R","year":"2023","unstructured":"R Li, LB Allal, Y Zi, N Muennighoff, D Kocetkov, C Mou, M Marone, C Akiki, J Li, and J Chim. 2023. StarCoder: May the Source be With You!. Transactions on machine learning research.","journal-title":"Transactions on machine learning research."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3510003.3510181"},{"key":"e_1_2_1_36_1","unstructured":"Aixin Liu Bei Feng Bin Wang Bingxuan Wang Bo Liu Chenggang Zhao Chengqi Dengr Chong Ruan Damai Dai and Daya Guo. 2024. Deepseek-v2: A strong economical and efficient mixture-of-experts language model. arXiv preprint arXiv:2405.04434."},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE48619.2023.00072"},{"key":"e_1_2_1_38_1","unstructured":"Fang Liu Yang Liu Lin Shi Houkun Huang Ruifeng Wang Zhen Yang and Li Zhang. 2024. Exploring and evaluating hallucinations in llm-powered code generation. arXiv preprint arXiv:2404.00971."},{"key":"e_1_2_1_39_1","volume-title":"Yuyao Wang, and Lingming Zhang.","author":"Liu Jiawei","year":"2024","unstructured":"Jiawei Liu, Chunqiu Steven Xia, Yuyao Wang, and Lingming Zhang. 2024. Is your code generated by chatgpt really correct? rigorous evaluation of large language models for code generation. Advances in Neural Information Processing Systems, 36 (2024)."},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00638"},{"key":"e_1_2_1_41_1","unstructured":"Llama Team. 2024. Llama 3. https:\/\/www.llama.com\/ (Accessed on 10\/27\/2024)"},{"key":"e_1_2_1_42_1","unstructured":"Natural Language Toolkit (NLTK). 2024. NLTK :: Natural Language Toolkit. https:\/\/www.nltk.org\/ (Accessed on 10\/31\/2024)"},{"key":"e_1_2_1_43_1","volume-title":"2015 30th IEEE\/ACM International Conference on Automated Software Engineering (ASE). 585\u2013596","author":"Nguyen Anh Tuan","year":"2015","unstructured":"Anh Tuan Nguyen, Tung Thanh Nguyen, and Tien N Nguyen. 2015. Divide-and-conquer approach for multi-phase statistical migration for source code (t). In 2015 30th IEEE\/ACM International Conference on Automated Software Engineering (ASE). 585\u2013596."},{"key":"e_1_2_1_44_1","unstructured":"Vikram Nitin and Baishakhi Ray. 2024. SpecTra: Enhancing the Code Translation Ability of Language Models by Generating Multi-Modal Specifications. arXiv preprint arXiv:2405.18574."},{"key":"e_1_2_1_45_1","unstructured":"NuGet. 2024. NuGet - Package Manager for .NET. https:\/\/www.nuget.org\/ (Accessed on 10\/31\/2024)"},{"key":"e_1_2_1_46_1","unstructured":"NVIDIA. 2024. NVIDIA Open API Interface. https:\/\/build.nvidia.com\/explore\/discover (Accessed on 10\/31\/2024)"},{"key":"e_1_2_1_47_1","unstructured":"OpenAI. 2024. ChatGPT - AI Chatbot by OpenAI. https:\/\/openai.com\/index\/chatgpt\/ (Accessed on 10\/31\/2024)"},{"key":"e_1_2_1_48_1","unstructured":"Oracle. 2024. Java SE 8 Documentation. https:\/\/docs.oracle.com\/javase\/8\/docs\/ (Accessed on 10\/31\/2024)"},{"key":"e_1_2_1_49_1","unstructured":"Guangsheng Ou Mingwei Liu Yuxuan Chen Xing Peng and Zibin Zheng. 2024. Repository-level Code Translation Benchmark Targeting Rust. arXiv preprint arXiv:2411.13990."},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/3650212.3652140"},{"key":"e_1_2_1_51_1","unstructured":"Jialing Pan Adrien Sad\u00e9 Jin Kim Eric Soriano Guillem Sole and Sylvain Flamant. 2023. SteloCoder: a Decoder-Only LLM for Multi-Language to Python Code Translation. arXiv preprint arXiv:2310.15539."},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/3597503.3639226"},{"key":"e_1_2_1_53_1","unstructured":"Ruchir Puri David S Kung Geert Janssen Wei Zhang Giacomo Domeniconi Vladimir Zolotov Julian Dolby Jie Chen Mihir Choudhury and Lindsey Decker. [n. d.]. CodeNet: A Large-Scale AI for Code Dataset for Learning a Diversity of Coding Tasks."},{"key":"e_1_2_1_54_1","unstructured":"PyPDF2 Documentation. 2024. Welcome to PyPDF2 \u2014 PyPDF2 documentation. https:\/\/pypdf2.readthedocs.io\/en\/3.x\/ (Accessed on 10\/31\/2024)"},{"key":"e_1_2_1_55_1","unstructured":"Python Documentation. 2024. Python Documentation - Official Python Language Reference. https:\/\/docs.python.org (Accessed on 10\/31\/2024)"},{"key":"e_1_2_1_56_1","unstructured":"Python Documentation. 2024. tkinter \u2014 Python interface to Tcl\/Tk \u2014 Python 3.13.0 documentation. https:\/\/docs.python.org\/3\/library\/tkinter.html (Accessed on 10\/31\/2024)"},{"key":"e_1_2_1_57_1","unstructured":"Python Documentation. 2024. unittest - Python\u2019s Unit Testing Framework. https:\/\/docs.python.org\/3\/library\/unittest.html (Accessed on 10\/31\/2024)"},{"key":"e_1_2_1_58_1","unstructured":"Quora. 2024. Quora - Q&A Platform. https:\/\/www.quora.com\/ (Accessed on 10\/31\/2024)"},{"key":"e_1_2_1_59_1","unstructured":"Achut Reddy. 2000. Java\u2122 coding style guide. Sun MicroSystems."},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2006.03511"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2110.06773"},{"key":"e_1_2_1_62_1","volume-title":"Xiaoqing Ellen and Adi, Yossi and Liu, Jingyu and Sauvestre, Romain and Remez, Tal and others","author":"Gehring Baptiste","year":"2023","unstructured":"Roziere, Baptiste and Gehring, Jonas and Gloeckle, Fabian and Sootla, Sten and Gat, Itai and Tan, Xiaoqing Ellen and Adi, Yossi and Liu, Jingyu and Sauvestre, Romain and Remez, Tal and others. 2023. Code Llama: Open Foundation Models for Code. arXiv preprint arXiv:2308.12950."},{"key":"e_1_2_1_63_1","unstructured":"Stack Overflow. 2024. Stack Overflow - Programming Q&A Site. https:\/\/stackoverflow.com\/ (Accessed on 10\/31\/2024)"},{"key":"e_1_2_1_64_1","unstructured":"Herb Sutter and Andrei Alexandrescu. 2004. C++ coding standards: 101 rules guidelines and best practices. Pearson Education."},{"key":"e_1_2_1_65_1","volume-title":"Code Translation with Compiler Representations. In The Eleventh International Conference on Learning Representations. https:\/\/openreview.net\/forum?id=XomEU3eNeSQ","author":"Szafraniec Marc","year":"2023","unstructured":"Marc Szafraniec, Baptiste Roziere, Hugh James Leather, Patrick Labatut, Francois Charton, and Gabriel Synnaeve. 2023. Code Translation with Compiler Representations. In The Eleventh International Conference on Learning Representations. https:\/\/openreview.net\/forum?id=XomEU3eNeSQ"},{"key":"e_1_2_1_66_1","unstructured":"Qingxiao Tao Tingrui Yu Xiaodong Gu and Beijun Shen. 2024. Unraveling the Potential of Large Language Models in Code Translation: How Far Are We? arXiv preprint arXiv:2410.09812."},{"key":"e_1_2_1_67_1","volume-title":"Codegemma: Open code models based on gemma. arXiv preprint arXiv:2406.11409.","author":"Team CodeGemma","year":"2024","unstructured":"CodeGemma Team. 2024. Codegemma: Open code models based on gemma. arXiv preprint arXiv:2406.11409."},{"key":"e_1_2_1_68_1","volume-title":"Mihir Sanjay Kale, and Juliette Love","author":"Team Gemma","year":"2024","unstructured":"Gemma Team, Thomas Mesnard, Cassidy Hardin, Robert Dadashi, Surya Bhupatiraju, Shreya Pathak, Laurent Sifre, Morgane Rivi\u00e8re, Mihir Sanjay Kale, and Juliette Love. 2024. Gemma: Open models based on gemini research and technology. arXiv preprint arXiv:2403.08295."},{"key":"e_1_2_1_69_1","unstructured":"Hugo Touvron Louis Martin Kevin Stone Peter Albert Amjad Almahairi Yasmine Babaei Nikolay Bashlykov Soumya Batra Prajjwal Bhargava and Shruti Bhosale. 2023. Llama 2: Open foundation and fine-tuned chat models. arXiv preprint arXiv:2307.09288."},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1145\/1806799.1806848"},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE48619.2023.00129"},{"key":"e_1_2_1_72_1","unstructured":"Pengyu Xue Linhao Wu Zhen Yang Xinyi Li Zhongxing Yu Zhi Jin Ge Li Yan Xiao and Jingwen Wu. 2024. Exploring and Lifting the Robustness of LLM-powered Automated Program Repair with Metamorphic Testing. arXiv preprint arXiv:2410.07516."},{"key":"e_1_2_1_73_1","unstructured":"Pengyu Xue Linhao Wu Zhongxing Yu Zhi Jin Zhen Yang Xinyi Li Zhenyu Yang and Yue Tan. 2024. Automated Commit Message Generation with Large Language Models: An Empirical Study and Beyond. arXiv preprint arXiv:2404.14824."},{"key":"e_1_2_1_74_1","volume-title":"Codescope: An execution-based multilingual multitask multidimensional benchmark for evaluating llms on code understanding and generation. arXiv preprint arXiv:2311.08588.","author":"Yan Weixiang","year":"2023","unstructured":"Weixiang Yan, Haitian Liu, Yunkun Wang, Yunzhe Li, Qian Chen, Wen Wang, Tingyu Lin, Weishan Zhao, Li Zhu, and Hari Sundaram. 2023. Codescope: An execution-based multilingual multitask multidimensional benchmark for evaluating llms on code understanding and generation. arXiv preprint arXiv:2311.08588."},{"key":"e_1_2_1_75_1","volume-title":"Codetransocean: A comprehensive multilingual benchmark for code translation. arXiv preprint arXiv:2310.04951.","author":"Yan Weixiang","year":"2023","unstructured":"Weixiang Yan, Yuchen Tian, Yunzhe Li, Qian Chen, and Wen Wang. 2023. Codetransocean: A comprehensive multilingual benchmark for code translation. arXiv preprint arXiv:2310.04951."},{"key":"e_1_2_1_76_1","volume-title":"Vert: Verified equivalent rust transpilation with few-shot learning. arXiv preprint arXiv:2404.18852.","author":"Yang Aidan ZH","year":"2024","unstructured":"Aidan ZH Yang, Yoshiki Takashima, Brandon Paulsen, Josiah Dodds, and Daniel Kroening. 2024. Vert: Verified equivalent rust transpilation with few-shot learning. arXiv preprint arXiv:2404.18852."},{"key":"e_1_2_1_77_1","volume-title":"2021 IEEE\/ACM 29th International Conference on Program Comprehension (ICPC). 1\u201312","author":"Yang Zhen","year":"2021","unstructured":"Zhen Yang, Jacky Keung, Xiao Yu, Xiaodong Gu, Zhengyuan Wei, Xiaoxue Ma, and Miao Zhang. 2021. A multi-modal transformer-based code summarization approach for smart contracts. In 2021 IEEE\/ACM 29th International Conference on Program Comprehension (ICPC). 1\u201312."},{"key":"e_1_2_1_78_1","volume-title":"Proceedings of the ACM on Software Engineering, 1, FSE","author":"Yang Zhen","year":"2024","unstructured":"Zhen Yang, Fang Liu, Zhongxing Yu, Jacky Wai Keung, Jia Li, Shuo Liu, Yifan Hong, Xiaoxue Ma, Zhi Jin, and Ge Li. 2024. Exploring and unleashing the power of large language models in automated code translation. Proceedings of the ACM on Software Engineering, 1, FSE (2024), 1585\u20131608."},{"key":"e_1_2_1_79_1","volume-title":"Rectifier: Code translation with corrector via llms. arXiv preprint arXiv:2407.07472.","author":"Yin Xin","year":"2024","unstructured":"Xin Yin, Chao Ni, Tien N Nguyen, Shaohua Wang, and Xiaohu Yang. 2024. Rectifier: Code translation with corrector via llms. arXiv preprint arXiv:2407.07472."},{"key":"e_1_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.1145\/3597503.3623316"},{"key":"e_1_2_1_81_1","volume-title":"TRANSAGENT: An LLM-Based Multi-Agent System for Code Translation. arXiv preprint arXiv:2409.19894.","author":"Yuan Zhiqiang","year":"2024","unstructured":"Zhiqiang Yuan, Weitong Chen, Hanlin Wang, Kai Yu, Xin Peng, and Yiling Lou. 2024. TRANSAGENT: An LLM-Based Multi-Agent System for Code Translation. arXiv preprint arXiv:2409.19894."},{"key":"e_1_2_1_82_1","volume-title":"Proceedings of the IEEE\/ACM 46th International Conference on Software Engineering. 1\u201312","author":"Zhang Zejun","year":"2024","unstructured":"Zejun Zhang, Zhenchang Xing, Dehai Zhao, Qinghua Lu, Xiwei Xu, and Liming Zhu. 2024. Hard to Read and Understand Pythonic Idioms? DeIdiom and Explain Them in Non-Idiomatic Equivalent Code. In Proceedings of the IEEE\/ACM 46th International Conference on Software Engineering. 1\u201312."},{"key":"e_1_2_1_83_1","doi-asserted-by":"crossref","unstructured":"Yang Zhao Li Du Xiao Ding Kai Xiong Zhouhao Sun Jun Shi Ting Liu and Bing Qin. 2024. Deciphering the lmpact of Pretraining Data on Large Language Models through Machine Unlearning. arXiv preprint arXiv:2402.11537.","DOI":"10.18653\/v1\/2024.findings-acl.559"}],"container-title":["Proceedings of the ACM on Software Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3728940","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,16]],"date-time":"2025-07-16T16:49:40Z","timestamp":1752684580000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3728940"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,22]]},"references-count":83,"journal-issue":{"issue":"ISSTA","published-print":{"date-parts":[[2025,6,22]]}},"alternative-id":["10.1145\/3728940"],"URL":"https:\/\/doi.org\/10.1145\/3728940","relation":{},"ISSN":["2994-970X"],"issn-type":[{"value":"2994-970X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,6,22]]}}}