{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,2]],"date-time":"2026-09-02T03:22:10Z","timestamp":1788319330650,"version":"build-2803163510"},"reference-count":80,"publisher":"Association for Computing Machinery (ACM)","issue":"7","license":[{"start":{"date-parts":[[2026,7,10]],"date-time":"2026-07-10T00:00:00Z","timestamp":1783641600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/legalcode"}],"funder":[{"name":"Research Council of Norway through the secureIT project","award":["IKTPLUSS #288787"],"award-info":[{"award-number":["IKTPLUSS #288787"]}]},{"name":"European Union the Horizon Europe Marie Sk\u0142odowska-Curie Actions","award":["#101151798"],"award-info":[{"award-number":["#101151798"]}]},{"name":"Research Council of Norway under contract","award":["#270053"],"award-info":[{"award-number":["#270053"]}]},{"name":"EuroHPC Joint Undertaking, hosted by CSC (Finland) and the LUMI consortium through the Research Council of Norway."}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Softw. Eng. Methodol."],"published-print":{"date-parts":[[2026,7,31]]},"abstract":"<jats:p>\n                    Research shows that errors in natural language can be corrected by translating texts to another language and back using language models. We explore to what extent this\n                    <jats:italic toggle=\"yes\">latent<\/jats:italic>\n                    correction capability extends to Automated Program Repair (APR) by investigating Round-Trip Translation (RTT): translating code from one programming language into another programming or natural language and back, using Large Language Models (LLMs). We hypothesize that RTT restores patterns most commonly seen in the LLM\u2019s training corpora through\n                    <jats:italic toggle=\"yes\">regression toward the mean<\/jats:italic>\n                    , replacing infrequent bugs with more frequent,\n                    <jats:italic toggle=\"yes\">natural<\/jats:italic>\n                    , bug-free code. To test this hypothesis, we employ nine LLMs and four common APR benchmarks in Java and perform a detailed quantitative and qualitative analysis of RTT-generated patches. We find that RTT through English generates plausible patches for 100 of 164 bugs with GPT-4 on the HumanEval-Java benchmark, and 97 are found to be correct in our manual assessment. Moreover, RTT uniquely generates plausible patches for 46 bugs that were missed by LLMs specifically fine-tuned for APR. While this demonstrates the viability of RTT for APR, we also observe limitations, such as a lower overall bug fix rate than the state-of-the-art and diluting the original coding style. We analyze the impact of these limitations and discuss the potential of using RTT as a complementary component in APR frameworks.\n                  <\/jats:p>","DOI":"10.1145\/3771922","type":"journal-article","created":{"date-parts":[[2025,10,16]],"date-time":"2025-10-16T14:45:01Z","timestamp":1760625901000},"page":"1-37","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Assessing the Latent Automated Program Repair Capabilities of Large Language Models Using Round-Trip Translation"],"prefix":"10.1145","volume":"35","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7213-3732","authenticated-orcid":false,"given":"Fernando","family":"Vallecillos-Ruiz","sequence":"first","affiliation":[{"name":"Simula Research Laboratory, Oslo, Norway"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3139-0200","authenticated-orcid":false,"given":"Anastasiia","family":"Grishina","sequence":"additional","affiliation":[{"name":"Simula Research Laboratory, Oslo, Norway"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8684-5909","authenticated-orcid":false,"given":"Max","family":"Hort","sequence":"additional","affiliation":[{"name":"Simula Research Laboratory, Oslo, Norway"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1761-6771","authenticated-orcid":false,"given":"Leon","family":"Moonen","sequence":"additional","affiliation":[{"name":"Simula Research Laboratory, Oslo, Norway"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2026,7,10]]},"reference":[{"key":"e_1_3_3_2_2","unstructured":"Armen Aghajanyan Bernie Huang Candace Ross Vladimir Karpukhin Hu Xu Naman Goyal Dmytro Okhonko Mandar Joshi Gargi Ghosh Mike Lewis et al. 2022. CM3: A causal masked multimodal model of the internet. arXiv:2201.07520. Retrieved from https:\/\/arxiv.org\/abs\/2201.07520"},{"key":"e_1_3_3_3_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.naacl-main.211"},{"key":"e_1_3_3_4_2","first-page":"1528","volume-title":"17th Conference of the European Chapter of the Association for Computational Linguistics","author":"Ahmad Wasi Uddin","year":"2023","unstructured":"Wasi Uddin Ahmad, Saikat Chakraborty, Baishakhi Ray, and Kai-Wei Chang. 2023. Summarize and generate to back-translate: Unsupervised translation of programming languages. In 17th Conference of the European Chapter of the Association for Computational Linguistics. Association for Computational Linguistics, 1528\u20131542."},{"key":"e_1_3_3_5_2","doi-asserted-by":"publisher","DOI":"10.1145\/3510003.3510049"},{"key":"e_1_3_3_6_2","unstructured":"Loubna Ben Allal Raymond Li Denis Kocetkov Chenghao Mou Christopher Akiki Carlos Munoz Ferrandis Niklas Muennighoff Mayank Mishra Alex Gu Manan Dey et al. 2023. SantaCoder: Don\u2019t reach for the stars! arXiv:2301.03988. Retrieved from https:\/\/arxiv.org\/abs\/2301.03988"},{"key":"e_1_3_3_7_2","doi-asserted-by":"publisher","DOI":"10.1145\/3212695"},{"key":"e_1_3_3_8_2","unstructured":"Miltiadis Allamanis Sheena Panthaplackel and Pengcheng Yin. 2024. Unsupervised evaluation of code LLMs with round-trip correctness. arXiv:2402.08699. Retrieved from https:\/\/arxiv.org\/abs\/2402.08699"},{"key":"e_1_3_3_9_2","doi-asserted-by":"crossref","unstructured":"Mikel Artetxe Shruti Bhosale Naman Goyal Todor Mihaylov Myle Ott Sam Shleifer Xi Victoria Lin Jingfei Du Srinivasan Iyer Ramakanth Pasunuru et al. 2022. Efficient large scale language modeling with mixtures of experts. arXiv:2112.10684. Retrieved from https:\/\/arxiv.org\/abs\/2112.10684","DOI":"10.18653\/v1\/2022.emnlp-main.804"},{"key":"e_1_3_3_10_2","doi-asserted-by":"publisher","DOI":"10.1145\/3106237.3106255"},{"key":"e_1_3_3_11_2","first-page":"1877","volume-title":"Advances in Neural Information Processing Systems (NeurIPS)","author":"Brown Tom","year":"2020","unstructured":"Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D. Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al. 2020. Language models are few-shot learners. In Advances in Neural Information Processing Systems (NeurIPS), Vol. 33. Curran Associates, Inc., 1877\u20131901."},{"key":"e_1_3_3_12_2","unstructured":"S\u00e9bastien Bubeck Varun Chandrasekaran Ronen Eldan Johannes Gehrke Eric Horvitz Ece Kamar Peter Lee Yin Tat Lee Yuanzhi Li Scott Lundberg et al. 2023. Sparks of artificial general intelligence: early experiments with GPT-4. arXiv:2303.12712. Retrieved from https:\/\/arxiv.org\/abs\/2303.12712"},{"key":"e_1_3_3_13_2","unstructured":"Luca Buratti Saurabh Pujar Mihaela Bornea Scott McCarley Yunhui Zheng Gaetano Rossiello Alessandro Morari Jim Laredo Veronika Thost Yufan Zhuang et al. 2020. Exploring software naturalness through neural language models. arXiv:2006.12641. Retrieved from https:\/\/arxiv.org\/abs\/2006.12641"},{"key":"e_1_3_3_14_2","unstructured":"Mark Chen Jerry Tworek Heewoo Jun Qiming Yuan Henrique Ponde de Oliveira Pinto Jared Kaplan Harri Edwards Yuri Burda Nicholas Joseph Greg Brockman et al. 2021. Evaluating large language models trained on code. arXiv:2107.03374. Retrieved from https:\/\/arxiv.org\/abs\/2107.03374"},{"key":"e_1_3_3_15_2","unstructured":"Xinyun Chen Maxwell Lin Nathanael Sch\u00e4rli and Denny Zhou. 2023. Teaching large language models to self-debug. arXiv:2304.05128. Retrieved from https:\/\/arxiv.org\/abs\/2304.05128"},{"key":"e_1_3_3_16_2","doi-asserted-by":"publisher","DOI":"10.1109\/tse.2019.2940179"},{"key":"e_1_3_3_17_2","volume-title":"Proceedings of Machine Translation Summit XII","author":"D\u00e9silets Alain","year":"2009","unstructured":"Alain D\u00e9silets and Matthieu Hermet. 2009. Using automatic roundtrip translation to repair general errors in second language writing. In Proceedings of Machine Translation Summit XII."},{"key":"e_1_3_3_18_2","unstructured":"Aryaz Eghbali and Michael Pradel. 2024. De-hallucinator: Mitigating LLM hallucinations in code generation tasks via iterative grounding. arXiv:2401.01701. Retrieved from https:\/\/arxiv.org\/abs\/2401.01701"},{"key":"e_1_3_3_19_2","doi-asserted-by":"publisher","DOI":"10.1109\/icse48619.2023.00128"},{"key":"e_1_3_3_20_2","first-page":"1","volume-title":"11th International Conference on Learning Representations (ICLR)","author":"Fried Daniel","year":"2023","unstructured":"Daniel Fried, Armen Aghajanyan, Jessy Lin, Sida Wang, Eric Wallace, Freda Shi, Ruiqi Zhong, Scott Yih, Luke Zettlemoyer, and Mike Lewis. 2023. InCoder: A generative model for code infilling and synthesis. In 11th International Conference on Learning Representations (ICLR), 1\u201326."},{"key":"e_1_3_3_21_2","doi-asserted-by":"publisher","DOI":"10.1021\/acsenergylett.2c02828"},{"key":"e_1_3_3_22_2","doi-asserted-by":"publisher","DOI":"10.1145\/3719351"},{"key":"e_1_3_3_23_2","unstructured":"Daya Guo Shuo Ren Shuai Lu Zhangyin Feng Duyu Tang Shujie Liu Long Zhou Nan Duan Alexey Svyatkovskiy Shengyu Fu et al. 2021. GraphCodeBERT: Pre-training code representations with data flow. arXiv:2009.08366. Retrieved from https:\/\/arxiv.org\/abs\/2009.08366"},{"key":"e_1_3_3_24_2","doi-asserted-by":"publisher","DOI":"10.5555\/2337223.2337322"},{"key":"e_1_3_3_25_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.emnlp-main.482"},{"key":"e_1_3_3_26_2","doi-asserted-by":"publisher","DOI":"10.1109\/icse48619.2023.00125"},{"key":"e_1_3_3_27_2","doi-asserted-by":"publisher","DOI":"10.1109\/icse43902.2021.00107"},{"key":"e_1_3_3_28_2","doi-asserted-by":"publisher","DOI":"10.1145\/2610384.2628055"},{"key":"e_1_3_3_29_2","doi-asserted-by":"publisher","DOI":"10.1145\/3524459.3527343"},{"key":"e_1_3_3_30_2","unstructured":"Jared Kaplan Sam McCandlish Tom Henighan Tom B. Brown Benjamin Chess Rewon Child Scott Gray Alec Radford Jeffrey Wu and Dario Amodei. 2020. Scaling laws for neural language models. arXiv:2001.08361. Retrieved from https:\/\/arxiv.org\/abs\/2001.08361"},{"key":"e_1_3_3_31_2","article-title":"The stack: 3 TB of permissively licensed source code","author":"Kocetkov Denis","year":"2023","unstructured":"Denis Kocetkov, Raymond Li, Loubna Ben Allal, Jia Li, Chenghao Mou, Yacine Jernite, Margaret Mitchell, Carlos Mu\u00f1oz Ferrandis, Sean Hughes, Thomas Wolf, et al. 2023. The stack: 3 TB of permissively licensed source code. Transactions on Machine Learning Research (2023). Retrieved from https:\/\/openreview.net\/forum?id=pxpbTdUEpD","journal-title":"Transactions on Machine Learning Research"},{"key":"e_1_3_3_32_2","first-page":"1","volume-title":"Deep Learning for Code Workshop @ ICLR 2022","author":"Kolak Sophia D.","year":"2022","unstructured":"Sophia D. Kolak, Ruben Martins, Claire Le Goues, and Vincent Josua Hellendoorn. 2022. Patch generation with language models: Feasibility and scaling behavior. In Deep Learning for Code Workshop @ ICLR 2022, 1\u201311."},{"key":"e_1_3_3_33_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/d18-1549"},{"key":"e_1_3_3_34_2","unstructured":"Hung Le Yue Wang Akhilesh Deepak Gotmare Silvio Savarese and Steven C. H. Hoi. 2022. CodeRL: Mastering code generation through pretrained models and deep reinforcement learning. arXiv:2207.01780. Retrieved from https:\/\/arxiv.org\/abs\/2207.01780"},{"key":"e_1_3_3_35_2","doi-asserted-by":"publisher","DOI":"10.1145\/3318162"},{"key":"e_1_3_3_36_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.acl-main.703"},{"key":"e_1_3_3_37_2","unstructured":"Raymond Li Loubna Ben Allal Yangtian Zi Niklas Muennighoff Denis Kocetkov Chenghao Mou Marc Marone Christopher Akiki Jia Li Jenny Chim et al. 2023. StarCoder: May the source be with you! arXiv:2305.06161. Retrieved from https:\/\/arxiv.org\/abs\/2305.06161"},{"key":"e_1_3_3_38_2","doi-asserted-by":"publisher","DOI":"10.1145\/3135932.3135941"},{"key":"e_1_3_3_39_2","unstructured":"Fang Liu Yang Liu Lin Shi Houkun Huang Ruifeng Wang Zhen Yang Li Zhang Zhongqi Li and Yuchi Ma. 2024. Exploring and evaluating hallucinations in LLM-powered code generation. arXiv:2404.00971. Retrieved from https:\/\/arxiv.org\/abs\/2404.00971"},{"key":"e_1_3_3_40_2","doi-asserted-by":"publisher","DOI":"10.1145\/3583131.3590481"},{"key":"e_1_3_3_41_2","first-page":"1","article-title":"CodeXGLUE: A machine learning benchmark dataset for code understanding and generation","author":"Lu Shuai","year":"2021","unstructured":"Shuai Lu, Daya Guo, Shuo Ren, Junjie Huang, Alexey Svyatkovskiy, Ambrosio Blanco, Colin Clement, Dawn Drain, Daxin Jiang, Duyu Tang, et al. 2021. CodeXGLUE: A machine learning benchmark dataset for code understanding and generation. In Neural Information Processing Systems Track on Datasets and Benchmarks, 1\u201316.","journal-title":"Neural Information Processing Systems Track on Datasets and Benchmarks"},{"key":"e_1_3_3_42_2","doi-asserted-by":"publisher","DOI":"10.1145\/3395363.3397369"},{"key":"e_1_3_3_43_2","doi-asserted-by":"crossref","unstructured":"Sneha Mehta Bahareh Azarnoush Boris Chen Avneesh Saluja Vinith Misra Ballav Bihani and Ritwik Kumar. 2020. Simplify-then-translate: Automatic preprocessing for black-box machine translation. arXiv:2005.11197. Retrieved from https:\/\/arxiv.org\/abs\/2005.11197","DOI":"10.1609\/aaai.v34i05.6369"},{"key":"e_1_3_3_44_2","doi-asserted-by":"publisher","DOI":"10.1145\/3105906"},{"key":"e_1_3_3_45_2","doi-asserted-by":"publisher","DOI":"10.1109\/tse.2014.2357438"},{"key":"e_1_3_3_46_2","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2022\/775"},{"key":"e_1_3_3_47_2","unstructured":"Josh Achiam Steven Adler Sandhini Agarwal Lama Ahmad Ilge Akkaya Florencia Leoni Aleman Diogo Almeida Janko Altenschmidt Sam Altman Shyamal Anadkat et al. 2023. GPT-4 Technical Report. arXiv:2303.08774. Retrieved from https:\/\/arxiv.org\/abs\/2303.08774"},{"key":"e_1_3_3_48_2","unstructured":"Aaron Hurst Adam Lerer Adam P. Goucher Adam Perelman Aditya Ramesh Aidan Clark A. J. Ostrow Akila Welihinda Alan Hayes Alec Radford et al. 2024. GPT-4o System Card. arXiv:2410.21276. Retrieved from https:\/\/arxiv.org\/abs\/2410.21276"},{"key":"e_1_3_3_49_2","doi-asserted-by":"publisher","DOI":"10.1145\/3697010"},{"key":"e_1_3_3_50_2","doi-asserted-by":"publisher","DOI":"10.3115\/1073083.1073135"},{"key":"e_1_3_3_51_2","doi-asserted-by":"publisher","DOI":"10.1109\/sp46214.2022.9833571"},{"key":"e_1_3_3_52_2","unstructured":"Dino Pedreschi Luca Pappalardo Ricardo Baeza-Yates Albert-Laszlo Barabasi Frank Dignum Virginia Dignum Tina Eliassi-Rad Fosca Giannotti Janos Kertesz Alistair Knott et al. 2023. Social AI and the challenges of the human-AI ecosystem. arXiv:2306.13723. Retrieved from https:\/\/arxiv.org\/abs\/2306.13723"},{"key":"e_1_3_3_53_2","unstructured":"Alec Radford Jeff Wu Rewon Child D. Luan Dario Amodei and I. Sutskever. 2019. Language models are unsupervised multitask learners. Retrieved from https:\/\/cdn.openai.com\/better-language-models\/language_models_are_unsupervised_multitask_learners.pdf"},{"key":"e_1_3_3_54_2","first-page":"1","article-title":"Exploring the limits of transfer learning with a unified text-to-text transformer","volume":"21","author":"Raffel Colin","year":"2020","unstructured":"Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J. Liu. 2020. Exploring the limits of transfer learning with a unified text-to-text transformer. Journal of Machine Learning Research 21 (2020), 1\u201367.","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_3_3_55_2","doi-asserted-by":"publisher","DOI":"10.1145\/2884781.2884848"},{"key":"e_1_3_3_56_2","unstructured":"Shuo Ren Daya Guo Shuai Lu Long Zhou Shujie Liu Duyu Tang Neel Sundaresan Ming Zhou Ambrosio Blanco and Shuai Ma. 2020. CodeBLEU: A method for automatic evaluation of code synthesis. arXiv:2009.10297. Retrieved from https:\/\/arxiv.org\/abs\/2009.10297"},{"key":"e_1_3_3_57_2","doi-asserted-by":"publisher","DOI":"10.48550\/arxiv.2006.03511"},{"key":"e_1_3_3_58_2","unstructured":"Yongliang Shen Kaitao Song Xu Tan Dongsheng Li Weiming Lu and Yueting Zhuang. 2023. HuggingGPT: Solving AI tasks with ChatGPT and its friends in hugging face. arXiv:2303.17580. Retrieved from https:\/\/arxiv.org\/abs\/2303.17580"},{"key":"e_1_3_3_59_2","unstructured":"Noah Shinn Beck Labash and Ashwin Gopinath. 2023. Reflexion: An autonomous agent with dynamic memory and self-reflection. arXiv:2303.11366. Retrieved from https:\/\/arxiv.org\/abs\/2303.11366"},{"key":"e_1_3_3_60_2","unstructured":"Andr\u00e9 Silva Jo\u00e3o F. Ferreira He Ye and Martin Monperrus. 2023. MUFIN: Improving neural repair models with back-translation. arXiv:2304.02301. Retrieved from https:\/\/arxiv.org\/abs\/2304.02301"},{"key":"e_1_3_3_61_2","doi-asserted-by":"publisher","DOI":"10.1109\/apr59189.2023.00012"},{"key":"e_1_3_3_62_2","doi-asserted-by":"crossref","first-page":"130","DOI":"10.1109\/SANER.2018.8330203","volume-title":"2018 IEEE 25th International Conference on Software Analysis, Evolution and Reengineering (SANER)","author":"Sobreira Victor","year":"2018","unstructured":"Victor Sobreira, Thomas Durieux, Fernanda Madeiral, Martin Monperrus, and Marcelo de Almeida Maia. 2018. Dissection of a bug dataset: Anatomy of 395 patches from Defects4J. In 2018 IEEE 25th International Conference on Software Analysis, Evolution and Reengineering (SANER). IEEE Computer Society, 130\u2013140. DOI: 10.1109\/saner.2018.8330203"},{"key":"e_1_3_3_63_2","doi-asserted-by":"publisher","DOI":"10.1613\/jair.1.12007"},{"key":"e_1_3_3_64_2","first-page":"1","volume-title":"Advances in Neural Information Processing Systems (NeurIPS)","author":"Sutskever Ilya","year":"2014","unstructured":"Ilya Sutskever, Oriol Vinyals, and Quoc V. Le. 2014. Sequence to sequence learning with neural networks. In Advances in Neural Information Processing Systems (NeurIPS), Vol. 27, Curran Associates, Inc., 1\u20139."},{"key":"e_1_3_3_65_2","doi-asserted-by":"crossref","unstructured":"Norbert Tihanyi Tamas Bisztray Ridhi Jain Mohamed Amine Ferrag Lucas C. Cordeiro and Vasileios Mavroeidis. 2023. The FormAI dataset: Generative AI in software security through the lens of formal verification. arXiv:2307.02192. Retrieved from https:\/\/arxiv.org\/abs\/2307.02192","DOI":"10.1145\/3617555.3617874"},{"key":"e_1_3_3_66_2","doi-asserted-by":"publisher","DOI":"10.1145\/3340544"},{"key":"e_1_3_3_67_2","first-page":"1","volume-title":"Advances in Neural Information Processing Systems (NeurIPS)","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, \u0141ukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In Advances in Neural Information Processing Systems (NeurIPS), Vol. 30, Curran, 1\u201311."},{"key":"e_1_3_3_68_2","doi-asserted-by":"crossref","unstructured":"Yue Wang Hung Le Akhilesh Deepak Gotmare Nghi D. Q. Bui Junnan Li and Steven C. H. Hoi. 2023. CodeT5+: Open code large language models for code understanding and generation. arXiv:2305.07922. Retrieved from https:\/\/arxiv.org\/abs\/2305.07922","DOI":"10.18653\/v1\/2023.emnlp-main.68"},{"key":"e_1_3_3_69_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.emnlp-main.685"},{"key":"e_1_3_3_70_2","article-title":"Emergent abilities of large language models","author":"Wei Jason","year":"2022","unstructured":"Jason Wei, Yi Tay, Rishi Bommasani, Colin Raffel, Barret Zoph, Sebastian Borgeaud, Dani Yogatama, Maarten Bosma, Denny Zhou, Donald Metzler, et al. 2022. Emergent abilities of large language models. Transactions on Machine Learning Research (Jun. 2022). Retrieved from https:\/\/openreview.net\/pdf?id=yzkSU5zdwD","journal-title":"Transactions on Machine Learning Research"},{"key":"e_1_3_3_71_2","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4615-4625-2","volume-title":"Experimentation in Software Engineering: An Introduction","author":"Wohlin C.","year":"2000","unstructured":"C. Wohlin, P. Runeson, M. Host, M. C. Ohlsson, B. Regnell, and A. Wesslen. 2000. Experimentation in Software Engineering: An Introduction. Number 6 in The Kluwer International Series in Software Engineering. Springer."},{"key":"e_1_3_3_72_2","doi-asserted-by":"publisher","DOI":"10.1109\/icse48619.2023.00129"},{"key":"e_1_3_3_73_2","doi-asserted-by":"publisher","DOI":"10.1145\/3540250.3549101"},{"key":"e_1_3_3_74_2","unstructured":"Chunqiu Steven Xia and Lingming Zhang. 2023. Conversational automated program repair. arXiv:2301.13246. Retrieved from https:\/\/arxiv.org\/abs\/2301.13246"},{"key":"e_1_3_3_75_2","unstructured":"Chunqiu Steven Xia and Lingming Zhang. 2023. Keep the conversation going: Fixing 162 out of 337 bugs for $0.42 each using ChatGPT. arXiv:2304.00385. Retrieved from https:\/\/arxiv.org\/abs\/2304.00385"},{"key":"e_1_3_3_76_2","doi-asserted-by":"publisher","DOI":"10.1145\/3611643.3633451"},{"key":"e_1_3_3_77_2","unstructured":"Shuoheng Yang Yuxin Wang and Xiaowen Chu. 2020. A survey of deep learning techniques for neural machine translation. arXiv:2002.07526. Retrieved from https:\/\/arxiv.org\/abs\/2002.07526"},{"key":"e_1_3_3_78_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2020.110825"},{"key":"e_1_3_3_79_2","doi-asserted-by":"publisher","DOI":"10.1145\/3533767.3534390"},{"key":"e_1_3_3_80_2","unstructured":"Quanjun Zhang Chunrong Fang Yuxiang Ma Weisong Sun and Zhenyu Chen. 2023. A survey of learning-based automated program repair. arXiv:2301.03270. Retrieved from https:\/\/arxiv.org\/abs\/2301.03270"},{"key":"e_1_3_3_81_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2023.findings-acl.22"}],"container-title":["ACM Transactions on Software Engineering and Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3771922","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,7,10]],"date-time":"2026-07-10T14:42:38Z","timestamp":1783694558000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3771922"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,7,10]]},"references-count":80,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2026,7,31]]}},"alternative-id":["10.1145\/3771922"],"URL":"https:\/\/doi.org\/10.1145\/3771922","relation":{},"ISSN":["1049-331X","1557-7392"],"issn-type":[{"value":"1049-331X","type":"print"},{"value":"1557-7392","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,7,10]]},"assertion":[{"value":"2024-03-22","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-10-09","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-07-10","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}