{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,20]],"date-time":"2025-06-20T04:08:51Z","timestamp":1750392531728,"version":"3.41.0"},"reference-count":73,"publisher":"Association for Computing Machinery (ACM)","issue":"FSE","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. ACM Softw. Eng."],"published-print":{"date-parts":[[2025,6,19]]},"abstract":"<jats:p>\n            Deep Neural Networks (DNNs) are prevalent across a wide range of applications. Despite their success, the complexity and opaque nature of DNNs pose significant challenges in debugging and repairing DNN models, limiting their reliability and broader adoption. In this paper, we propose MLM4DNN, an element-based automated DNN repair method. Unlike previous techniques that focus on post-training adjustments or rely heavily on predefined bug patterns, MLM4DNN repairs DNNs by leveraging a fine-tuned Masked Language Model (MLM) to predict correct fixes for nine predefined key elements in DNNs. We construct a large-scale dataset by masking nine key elements from the correct DNN source code and then force the MLM to restore the correct elements to learn the deep semantics that ensure the normal functionalities of DNNs. Afterwards, a light-weight static analysis tool is designed to filter out low-quality patches to enhance the repair efficiency. We introduce a patch validation method specifically for DNN repair tasks, which consists of three evaluation metrics from different aspects to model the effectiveness of generated patches. We construct a benchmark,\n            <jats:italic toggle=\"yes\">Benchmark<\/jats:italic>\n            <jats:sub>\n              <jats:italic toggle=\"yes\">APR<\/jats:italic>\n              4\n              <jats:italic toggle=\"yes\">DNN<\/jats:italic>\n            <\/jats:sub>\n            , including 51 buggy DNN models and an evaluation tool that outputs the three metrics. We evaluate MLM4DNN against six baselines on\n            <jats:italic toggle=\"yes\">Benchmark<\/jats:italic>\n            <jats:sub>\n              <jats:italic toggle=\"yes\">APR<\/jats:italic>\n              4\n              <jats:italic toggle=\"yes\">DNN<\/jats:italic>\n            <\/jats:sub>\n            , and results show that MLM4DNN outperforms all state-of-the-art baselines, including two dynamic-based and four zero-shot learning-based methods. After applying the fine-tuned MLM design to several prevalent Large Language Models (LLMs), we consistently observe improved performance in DNN repair tasks compared to the original LLMs, which demonstrates the effectiveness of the method proposed in this paper.\n          <\/jats:p>","DOI":"10.1145\/3715716","type":"journal-article","created":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T15:16:02Z","timestamp":1750346162000},"page":"106-129","source":"Crossref","is-referenced-by-count":0,"title":["Element-Based Automated DNN Repair with Fine-Tuned Masked Language Model"],"prefix":"10.1145","volume":"2","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5057-3278","authenticated-orcid":false,"given":"Xu","family":"Wang","sequence":"first","affiliation":[{"name":"Beihang University, Beijing, China"},{"name":"Zhongguancun Laboratory, Beijing, China"},{"name":"Engineering Research Center of Intelligent Computing for Complex Energy Systems, Ministry of Education, Baoding, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-0522-4861","authenticated-orcid":false,"given":"Mingming","family":"Zhang","sequence":"additional","affiliation":[{"name":"Beihang University, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5630-4810","authenticated-orcid":false,"given":"Xiangxin","family":"Meng","sequence":"additional","affiliation":[{"name":"Beihang University, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8316-1894","authenticated-orcid":false,"given":"Jian","family":"Zhang","sequence":"additional","affiliation":[{"name":"Nanyang Technological University, Beijing, Singapore"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7300-9215","authenticated-orcid":false,"given":"Yang","family":"Liu","sequence":"additional","affiliation":[{"name":"Nanyang Technological University, Beijing, Singapore"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3473-9703","authenticated-orcid":false,"given":"Chunming","family":"Hu","sequence":"additional","affiliation":[{"name":"Beihang University, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2025,6,19]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Tensorflow: Large-scale machine learning on heterogeneous distributed systems. arXiv preprint arXiv:1603.04467.","author":"Abadi Mart\u00edn","year":"2016","unstructured":"Mart\u00edn Abadi, Ashish Agarwal, Paul Barham, Eugene Brevdo, Zhifeng Chen, Craig Citro, Greg S Corrado, Andy Davis, Jeffrey Dean, and Matthieu Devin. 2016. Tensorflow: Large-scale machine learning on heterogeneous distributed systems. arXiv preprint arXiv:1603.04467."},{"key":"e_1_2_1_2_1","volume-title":"DeepFD: Automated Fault Diagnosis and Localization for Deep Learning Programs. In 44th IEEE\/ACM 44th International Conference on Software Engineering, ICSE 2022","author":"Cao Jialun","year":"2022","unstructured":"Jialun Cao, Meiziniu Li, Xiao Chen, Ming Wen, Yongqiang Tian, Bo Wu, and Shing-Chi Cheung. 2022. DeepFD: Automated Fault Diagnosis and Localization for Deep Learning Programs. In 44th IEEE\/ACM 44th International Conference on Software Engineering, ICSE 2022, Pittsburgh, PA, USA, May 25-27, 2022. ACM, 573\u2013585. https:\/\/doi.org\/10.1145\/3510003.3510099 10.1145\/3510003.3510099"},{"key":"e_1_2_1_3_1","volume-title":"Mxnet: A flexible and efficient machine learning library for heterogeneous distributed systems. arXiv preprint arXiv:1512.01274.","author":"Chen Tianqi","year":"2015","unstructured":"Tianqi Chen, Mu Li, Yutian Li, Min Lin, Naiyan Wang, Minjie Wang, Tianjun Xiao, Bing Xu, Chiyuan Zhang, and Zheng Zhang. 2015. Mxnet: A flexible and efficient machine learning library for heterogeneous distributed systems. arXiv preprint arXiv:1512.01274."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2019.2940179"},{"key":"e_1_2_1_5_1","volume-title":"Keras: Deep Learning for humans. https:\/\/keras.io [Accessed 18-03-2024]","author":"Chollet Francois","year":"2015","unstructured":"Francois Chollet. 2015. Keras: Deep Learning for humans. https:\/\/keras.io [Accessed 18-03-2024]"},{"key":"e_1_2_1_6_1","volume-title":"A power primer.. Psychological bulletin, 112, 1","author":"Cohen Jacob","year":"1992","unstructured":"Jacob Cohen. 1992. A power primer.. Psychological bulletin, 112, 1 (1992), 155."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1007\/S10462-019-09744-1"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-16722-6_10"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/TITS.2020.2972974"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.18653\/V1"},{"key":"e_1_2_1_11_1","volume-title":"InCoder: A Generative Model for Code Infilling and Synthesis. In The Eleventh International Conference on Learning Representations, ICLR 2023","author":"Fried Daniel","year":"2023","unstructured":"Daniel Fried, Armen Aghajanyan, Jessy Lin, Sida Wang, Eric Wallace, Freda Shi, Ruiqi Zhong, Scott Yih, Luke Zettlemoyer, and Mike Lewis. 2023. InCoder: A Generative Model for Code Infilling and Synthesis. In The Eleventh International Conference on Learning Representations, ICLR 2023, Kigali, Rwanda, May 1-5, 2023. OpenReview.net. https:\/\/openreview.net\/forum?id=hQwb-lbM6EL"},{"key":"e_1_2_1_12_1","volume-title":"42nd International Conference on Software Engineering","author":"Gao Xiang","year":"2020","unstructured":"Xiang Gao, Ripon K. Saha, Mukul R. Prasad, and Abhik Roychoudhury. 2020. Fuzz testing based data augmentation to improve robustness of deep neural networks. In ICSE \u201920: 42nd International Conference on Software Engineering, Seoul, South Korea, 27 June - 19 July, 2020, Gregg Rothermel and Doo-Hwan Bae (Eds.). ACM, 1147\u20131158. https:\/\/doi.org\/10.1145\/3377811.3380415 10.1145\/3377811.3380415"},{"key":"e_1_2_1_13_1","volume-title":"29th ACM SIGSOFT International Symposium on Software Testing and Analysis","author":"Ghanbari Ali","year":"2020","unstructured":"Ali Ghanbari. 2020. ObjSim: lightweight automatic patch prioritization via object similarity. In ISSTA \u201920: 29th ACM SIGSOFT International Symposium on Software Testing and Analysis, Virtual Event, USA, July 18-22, 2020, Sarfraz Khurshid and Corina S. Pasareanu (Eds.). ACM, 541\u2013544. https:\/\/doi.org\/10.1145\/3395363.3404362 10.1145\/3395363.3404362"},{"key":"e_1_2_1_14_1","volume-title":"31st ACM SIGSOFT International Symposium on Software Testing and Analysis","author":"Ghanbari Ali","year":"2022","unstructured":"Ali Ghanbari and Andrian Marcus. 2022. Patch correctness assessment in automated program repair based on the impact of patches on production and test code. In ISSTA \u201922: 31st ACM SIGSOFT International Symposium on Software Testing and Analysis, Virtual Event, South Korea, July 18 - 22, 2022, Sukyoung Ryu and Yannis Smaragdakis (Eds.). ACM, 654\u2013665. https:\/\/doi.org\/10.1145\/3533767.3534368 10.1145\/3533767.3534368"},{"key":"e_1_2_1_15_1","volume-title":"Mutation-based Fault Localization of Deep Neural Networks. In 38th IEEE\/ACM International Conference on Automated Software Engineering, ASE 2023","author":"Ghanbari Ali","year":"2023","unstructured":"Ali Ghanbari, Deepak-George Thomas, Muhammad Arbab Arshad, and Hridesh Rajan. 2023. Mutation-based Fault Localization of Deep Neural Networks. In 38th IEEE\/ACM International Conference on Automated Software Engineering, ASE 2023, Luxembourg, September 11-15, 2023. IEEE, 1301\u20131313. https:\/\/doi.org\/10.1109\/ASE56229.2023.00171 10.1109\/ASE56229.2023.00171"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1002\/ROB.21918"},{"key":"e_1_2_1_17_1","volume-title":"Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), ACL 2022","author":"Guo Daya","year":"2022","unstructured":"Daya Guo, Shuai Lu, Nan Duan, Yanlin Wang, Ming Zhou, and Jian Yin. 2022. UniXcoder: Unified Cross-Modal Pre-training for Code Representation. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), ACL 2022, Dublin, Ireland, May 22-27, 2022, Smaranda Muresan, Preslav Nakov, and Aline Villavicencio (Eds.). Association for Computational Linguistics, 7212\u20137225. https:\/\/doi.org\/10.18653\/V1\/2022.ACL-LONG.499 10.18653\/V1\/2022.ACL-LONG.499"},{"key":"e_1_2_1_18_1","unstructured":"Daya Guo Qihao Zhu Dejian Yang Zhenda Xie Kai Dong Wentao Zhang Guanting Chen Xiao Bi Yu Wu and YK Li. 2024. DeepSeek-Coder: When the Large Language Model Meets Programming\u2013The Rise of Code Intelligence. arXiv preprint arXiv:2401.14196."},{"key":"e_1_2_1_19_1","volume-title":"Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence","author":"Gupta Rahul","year":"2017","unstructured":"Rahul Gupta, Soham Pal, Aditya Kanade, and Shirish K. Shevade. 2017. DeepFix: Fixing Common C Language Errors by Deep Learning. In Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence, February 4-9, 2017, San Francisco, California, USA, Satinder Singh and Shaul Markovitch (Eds.). AAAI Press, 1345\u20131351. https:\/\/doi.org\/10.1609\/AAAI.V31I1.10742 10.1609\/AAAI.V31I1.10742"},{"key":"e_1_2_1_20_1","volume-title":"An Empirical Study on Fine-Tuning Large Language Models of Code for Automated Program Repair. In 38th IEEE\/ACM International Conference on Automated Software Engineering, ASE 2023","author":"Huang Kai","year":"2023","unstructured":"Kai Huang, Xiangxin Meng, Jian Zhang, Yang Liu, Wenjie Wang, Shuhao Li, and Yuqing Zhang. 2023. An Empirical Study on Fine-Tuning Large Language Models of Code for Automated Program Repair. In 38th IEEE\/ACM International Conference on Automated Software Engineering, ASE 2023, Luxembourg, September 11-15, 2023. IEEE, 1162\u20131174. https:\/\/doi.org\/10.1109\/ASE56229.2023.00181 10.1109\/ASE56229.2023.00181"},{"key":"e_1_2_1_21_1","volume-title":"42nd International Conference on Software Engineering","author":"Humbatova Nargiz","year":"2020","unstructured":"Nargiz Humbatova, Gunel Jahangirova, Gabriele Bavota, Vincenzo Riccio, Andrea Stocco, and Paolo Tonella. 2020. Taxonomy of real faults in deep learning systems. In ICSE \u201920: 42nd International Conference on Software Engineering, Seoul, South Korea, 27 June - 19 July, 2020, Gregg Rothermel and Doo-Hwan Bae (Eds.). ACM, 1110\u20131121. https:\/\/doi.org\/10.1145\/3377811.3380395 10.1145\/3377811.3380395"},{"key":"e_1_2_1_22_1","volume-title":"30th ACM SIGSOFT International Symposium on Software Testing and Analysis","author":"Humbatova Nargiz","year":"2021","unstructured":"Nargiz Humbatova, Gunel Jahangirova, and Paolo Tonella. 2021. DeepCrime: mutation testing of deep learning systems based on real faults. In ISSTA \u201921: 30th ACM SIGSOFT International Symposium on Software Testing and Analysis, Virtual Event, Denmark, July 11-17, 2021, Cristian Cadar and Xiangyu Zhang (Eds.). ACM, 67\u201378. https:\/\/doi.org\/10.1145\/3460319.3464825 10.1145\/3460319.3464825"},{"key":"e_1_2_1_23_1","volume-title":"Proceedings of the ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering, ESEC\/SIGSOFT FSE 2019","author":"Islam Md Johirul","year":"2019","unstructured":"Md Johirul Islam, Giang Nguyen, Rangeet Pan, and Hridesh Rajan. 2019. A comprehensive study on deep learning bug characteristics. In Proceedings of the ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering, ESEC\/SIGSOFT FSE 2019, Tallinn, Estonia, August 26-30, 2019, Marlon Dumas, Dietmar Pfahl, Sven Apel, and Alessandra Russo (Eds.). ACM, 510\u2013520. https:\/\/doi.org\/10.1145\/3338906.3338955 10.1145\/3338906.3338955"},{"key":"e_1_2_1_24_1","volume-title":"42nd International Conference on Software Engineering","author":"Islam Md Johirul","year":"2020","unstructured":"Md Johirul Islam, Rangeet Pan, Giang Nguyen, and Hridesh Rajan. 2020. Repairing deep neural networks: fix patterns and challenges. In ICSE \u201920: 42nd International Conference on Software Engineering, Seoul, South Korea, 27 June - 19 July, 2020, Gregg Rothermel and Doo-Hwan Bae (Eds.). ACM, 1135\u20131146. https:\/\/doi.org\/10.1145\/3377811.3380378 10.1145\/3377811.3380378"},{"key":"e_1_2_1_25_1","volume-title":"An Empirical Evaluation of Mutation Operators for Deep Learning Systems. In 13th IEEE International Conference on Software Testing, Validation and Verification, ICST 2020","author":"Jahangirova Gunel","year":"2020","unstructured":"Gunel Jahangirova and Paolo Tonella. 2020. An Empirical Evaluation of Mutation Operators for Deep Learning Systems. In 13th IEEE International Conference on Software Testing, Validation and Verification, ICST 2020, Porto, Portugal, October 24-28, 2020. IEEE, 74\u201384. https:\/\/doi.org\/10.1109\/ICST46399.2020.00018 10.1109\/ICST46399.2020.00018"},{"key":"e_1_2_1_26_1","volume-title":"Proceedings of the ACM International Conference on Multimedia, MM \u201914","author":"Jia Yangqing","year":"2014","unstructured":"Yangqing Jia, Evan Shelhamer, Jeff Donahue, Sergey Karayev, Jonathan Long, Ross B. Girshick, Sergio Guadarrama, and Trevor Darrell. 2014. Caffe: Convolutional Architecture for Fast Feature Embedding. In Proceedings of the ACM International Conference on Multimedia, MM \u201914, Orlando, FL, USA, November 03 - 07, 2014, Kien A. Hua, Yong Rui, Ralf Steinmetz, Alan Hanjalic, Apostol Natsev, and Wenwu Zhu (Eds.). ACM, 675\u2013678. https:\/\/doi.org\/10.1145\/2647868.2654889 10.1145\/2647868.2654889"},{"key":"e_1_2_1_27_1","volume-title":"Impact of Code Language Models on Automated Program Repair. In 45th IEEE\/ACM International Conference on Software Engineering, ICSE 2023","author":"Jiang Nan","year":"2023","unstructured":"Nan Jiang, Kevin Liu, Thibaud Lutellier, and Lin Tan. 2023. Impact of Code Language Models on Automated Program Repair. In 45th IEEE\/ACM International Conference on Software Engineering, ICSE 2023, Melbourne, Australia, May 14-20, 2023. IEEE, 1430\u20131442. https:\/\/doi.org\/10.1109\/ICSE48619.2023.00125 10.1109\/ICSE48619.2023.00125"},{"key":"e_1_2_1_28_1","doi-asserted-by":"crossref","first-page":"141","DOI":"10.3390\/electronics11010141","article-title":"A survey of recommendation systems: recommendation models, techniques, and application fields","volume":"11","author":"Ko Hyeyoung","year":"2022","unstructured":"Hyeyoung Ko, Suyeon Lee, Yoonseo Park, and Anna Choi. 2022. A survey of recommendation systems: recommendation models, techniques, and application fields. Electronics, 11, 1 (2022), 141.","journal-title":"Electronics"},{"key":"e_1_2_1_29_1","volume-title":"Deep Learning for Code Workshop.","author":"Kolak Sophia D","year":"2022","unstructured":"Sophia D Kolak, Ruben Martins, Claire Le Goues, and Vincent Josua Hellendoorn. 2022. Patch generation with language models: Feasibility and scaling behavior. In Deep Learning for Code Workshop."},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1007\/S10664-019-09780-Z"},{"key":"e_1_2_1_31_1","volume-title":"Proceedings of the 39th IEEE\/ACM International Conference on Automated Software Engineering, ASE 2024","author":"Li Guochang","year":"2024","unstructured":"Guochang Li, Chen Zhi, Jialiang Chen, Junxiao Han, and Shuiguang Deng. 2024. Exploring Parameter-Efficient Fine-Tuning of Large Language Model on Automated Program Repair. In Proceedings of the 39th IEEE\/ACM International Conference on Automated Software Engineering, ASE 2024, Sacramento, CA, USA, October 27 - November 1, 2024, Vladimir Filkov, Baishakhi Ray, and Minghui Zhou (Eds.). ACM, 719\u2013731. https:\/\/doi.org\/10.1145\/3691620.3695066 10.1145\/3691620.3695066"},{"key":"e_1_2_1_32_1","volume-title":"31st ACM SIGSOFT International Symposium on Software Testing and Analysis","author":"Li Yu","year":"2022","unstructured":"Yu Li, Muxi Chen, and Qiang Xu. 2022. HybridRepair: towards annotation-efficient repair for deep learning models. In ISSTA \u201922: 31st ACM SIGSOFT International Symposium on Software Testing and Analysis, Virtual Event, South Korea, July 18 - 22, 2022, Sukyoung Ryu and Yannis Smaragdakis (Eds.). ACM, 227\u2013238. https:\/\/doi.org\/10.1145\/3533767.3534408 10.1145\/3533767.3534408"},{"key":"e_1_2_1_33_1","volume-title":"DEAR: A Novel Deep Learning-based Approach for Automated Program Repair. In 44th IEEE\/ACM 44th International Conference on Software Engineering, ICSE 2022","author":"Li Yi","year":"2022","unstructured":"Yi Li, Shaohua Wang, and Tien N. Nguyen. 2022. DEAR: A Novel Deep Learning-based Approach for Automated Program Repair. In 44th IEEE\/ACM 44th International Conference on Software Engineering, ICSE 2022, Pittsburgh, PA, USA, May 25-27, 2022. ACM, 511\u2013523. https:\/\/doi.org\/10.1145\/3510003.3510177 10.1145\/3510003.3510177"},{"key":"e_1_2_1_34_1","unstructured":"Xi Victoria Lin Todor Mihaylov Mikel Artetxe Tianlu Wang Shuohui Chen Daniel Simig Myle Ott Naman Goyal and Shruti Bhosale. 2021. Few-shot learning with multilingual language models. arXiv preprint arXiv:2112.10668."},{"key":"e_1_2_1_35_1","volume-title":"Proceedings of the 28th ACM SIGSOFT International Symposium on Software Testing and Analysis, ISSTA 2019","author":"Liu Kui","year":"2019","unstructured":"Kui Liu, Anil Koyuncu, Dongsun Kim, and Tegawend\u00e9 F. Bissyand\u00e9. 2019. TBar: revisiting template-based automated program repair. In Proceedings of the 28th ACM SIGSOFT International Symposium on Software Testing and Analysis, ISSTA 2019, Beijing, China, July 15-19, 2019, Dongmei Zhang and Anders M\u00f8ller (Eds.). ACM, 31\u201342. https:\/\/doi.org\/10.1145\/3293882.3330577 10.1145\/3293882.3330577"},{"key":"e_1_2_1_36_1","volume-title":"Decoupled Weight Decay Regularization. In 7th International Conference on Learning Representations, ICLR 2019","author":"Loshchilov Ilya","year":"2019","unstructured":"Ilya Loshchilov and Frank Hutter. 2019. Decoupled Weight Decay Regularization. In 7th International Conference on Learning Representations, ICLR 2019, New Orleans, LA, USA, May 6-9, 2019. OpenReview.net. https:\/\/openreview.net\/forum?id=Bkg6RiCqY7"},{"key":"e_1_2_1_37_1","volume-title":"29th ACM SIGSOFT International Symposium on Software Testing and Analysis","author":"Lutellier Thibaud","year":"2020","unstructured":"Thibaud Lutellier, Hung Viet Pham, Lawrence Pang, Yitong Li, Moshi Wei, and Lin Tan. 2020. CoCoNuT: combining context-aware neural translation models using ensemble for program repair. In ISSTA \u201920: 29th ACM SIGSOFT International Symposium on Software Testing and Analysis, Virtual Event, USA, July 18-22, 2020, Sarfraz Khurshid and Corina S. Pasareanu (Eds.). ACM, 101\u2013114. https:\/\/doi.org\/10.1145\/3395363.3397369 10.1145\/3395363.3397369"},{"key":"e_1_2_1_38_1","volume-title":"Proceedings of the 2018 ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering, ESEC\/SIGSOFT FSE 2018, Lake Buena Vista, FL, USA","author":"Ma Shiqing","year":"2018","unstructured":"Shiqing Ma, Yingqi Liu, Wen-Chuan Lee, Xiangyu Zhang, and Ananth Grama. 2018. MODE: automated neural network model debugging via state differential analysis and input selection. In Proceedings of the 2018 ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering, ESEC\/SIGSOFT FSE 2018, Lake Buena Vista, FL, USA, November 04-09, 2018, Gary T. Leavens, Alessandro Garcia, and Corina S. Pasareanu (Eds.). ACM, 175\u2013186. https:\/\/doi.org\/10.1145\/3236024.3236082 10.1145\/3236024.3236082"},{"key":"e_1_2_1_39_1","volume-title":"Improving Fault Localization and Program Repair with Deep Semantic Features and Transferred Knowledge. In 44th IEEE\/ACM 44th International Conference on Software Engineering, ICSE 2022","author":"Meng Xiangxin","year":"2022","unstructured":"Xiangxin Meng, Xu Wang, Hongyu Zhang, Hailong Sun, and Xudong Liu. 2022. Improving Fault Localization and Program Repair with Deep Semantic Features and Transferred Knowledge. In 44th IEEE\/ACM 44th International Conference on Software Engineering, ICSE 2022, Pittsburgh, PA, USA, May 25-27, 2022. ACM, 1169\u20131180. https:\/\/doi.org\/10.1145\/3510003.3510147 10.1145\/3510003.3510147"},{"key":"e_1_2_1_40_1","volume-title":"Template-based Neural Program Repair. In 45th IEEE\/ACM International Conference on Software Engineering, ICSE 2023","author":"Meng Xiangxin","year":"2023","unstructured":"Xiangxin Meng, Xu Wang, Hongyu Zhang, Hailong Sun, Xudong Liu, and Chunming Hu. 2023. Template-based Neural Program Repair. In 45th IEEE\/ACM International Conference on Software Engineering, ICSE 2023, Melbourne, Australia, May 14-20, 2023. IEEE, 1456\u20131468. https:\/\/doi.org\/10.1109\/ICSE48619.2023.00127 10.1109\/ICSE48619.2023.00127"},{"key":"e_1_2_1_41_1","doi-asserted-by":"crossref","first-page":"370","DOI":"10.2307\/2344614","article-title":"Generalized Linear Models. Journal of the Royal Statistical Society","volume":"135","author":"Nelder J. A.","year":"1972","unstructured":"J. A. Nelder and R. W. M. Wedderburn. 1972. Generalized Linear Models. Journal of the Royal Statistical Society. Series A (General), 135, 3 (1972), 370\u2013384. issn:00359238 http:\/\/www.jstor.org\/stable\/2344614","journal-title":"Series A (General)"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3470006"},{"key":"e_1_2_1_43_1","unstructured":"OpenAI. 2022. Introducing ChatGPT. https:\/\/openai.com\/blog\/chatgpt [Accessed 24-03-2024]"},{"key":"e_1_2_1_44_1","unstructured":"OpenAI. 2024. Hello GPT-4o. https:\/\/openai.com\/index\/hello-gpt-4o [Accessed 24-08-2024]"},{"key":"e_1_2_1_45_1","volume-title":"Pytorch: An imperative style, high-performance deep learning library. Advances in neural information processing systems, 32","author":"Paszke Adam","year":"2019","unstructured":"Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, and Luca Antiga. 2019. Pytorch: An imperative style, high-performance deep learning library. Advances in neural information processing systems, 32 (2019)."},{"key":"e_1_2_1_46_1","volume-title":"QuixBugs. In 3rd IEEE\/ACM International Workshop on Automated Program Repair, APR@ICSE 2022","author":"Prenner Julian Aron","year":"2022","unstructured":"Julian Aron Prenner, Hlib Babii, and Romain Robbes. 2022. Can OpenAI\u2019s Codex Fix Bugs?: An evaluation on QuixBugs. In 3rd IEEE\/ACM International Workshop on Automated Program Repair, APR@ICSE 2022, Pittsburgh, PA, USA, May 19, 2022. IEEE, 69\u201375. https:\/\/doi.org\/10.1145\/3524459.3527351 10.1145\/3524459.3527351"},{"key":"e_1_2_1_47_1","article-title":"Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer","volume":"21","author":"Raffel Colin","year":"2020","unstructured":"Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J. Liu. 2020. Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer. J. Mach. Learn. Res., 21 (2020), 140:1\u2013140:67. https:\/\/jmlr.org\/papers\/v21\/20-074.html","journal-title":"J. Mach. Learn. Res."},{"key":"e_1_2_1_48_1","volume-title":"Proceedings of the 41st International Conference on Software Engineering, ICSE 2019, Montreal, QC, Canada","author":"Saha Seemanta","year":"2019","unstructured":"Seemanta Saha, Ripon K. Saha, and Mukul R. Prasad. 2019. Harnessing evolution for multi-hunk program repair. In Proceedings of the 41st International Conference on Software Engineering, ICSE 2019, Montreal, QC, Canada, May 25-31, 2019, Joanne M. Atlee, Tevfik Bultan, and Jon Whittle (Eds.). IEEE \/ ACM, 13\u201324. https:\/\/doi.org\/10.1109\/ICSE.2019.00020 10.1109\/ICSE.2019.00020"},{"key":"e_1_2_1_49_1","volume-title":"CHI Conference on Human Factors in Computing Systems, Virtual Event \/ Yokohama","author":"Schoop Eldon","year":"2021","unstructured":"Eldon Schoop, Forrest Huang, and Bjoern Hartmann. 2021. UMLAUT: Debugging Deep Learning Programs using Program Structure and Model Behavior. In CHI \u201921: CHI Conference on Human Factors in Computing Systems, Virtual Event \/ Yokohama, Japan, May 8-13, 2021, Yoshifumi Kitamura, Aaron Quigley, Katherine Isbister, Takeo Igarashi, Pernille Bj\u00f8rn, and Steven Mark Drucker (Eds.). ACM, 310:1\u2013310:16. https:\/\/doi.org\/10.1145\/3411764.3445538 10.1145\/3411764.3445538"},{"key":"e_1_2_1_50_1","volume-title":"Proceedings of the 32nd ACM SIGSOFT International Symposium on Software Testing and Analysis, ISSTA 2023","author":"Schumi Richard","year":"2023","unstructured":"Richard Schumi and Jun Sun. 2023. Semantic-Based Neural Network Repair. In Proceedings of the 32nd ACM SIGSOFT International Symposium on Software Testing and Analysis, ISSTA 2023, Seattle, WA, USA, July 17-21, 2023, Ren\u00e9 Just and Gordon Fraser (Eds.). ACM, 150\u2013162. https:\/\/doi.org\/10.1145\/3597926.3598045 10.1145\/3597926.3598045"},{"key":"e_1_2_1_51_1","volume-title":"2017 International Conference on Computer, Communications and Electronics (Comptelix). 162\u2013167","author":"Singh Shashi Pal","year":"2017","unstructured":"Shashi Pal Singh, Ajai Kumar, Hemant Darbari, Lenali Singh, Anshika Rastogi, and Shikha Jain. 2017. Machine translation using deep learning: An overview. In 2017 International Conference on Computer, Communications and Electronics (Comptelix). 162\u2013167. https:\/\/doi.org\/10.1109\/COMPTELIX.2017.8003957 10.1109\/COMPTELIX.2017.8003957"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/3563210"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1613\/JAIR.1.12007"},{"key":"e_1_2_1_54_1","volume-title":"Llama: Open and efficient foundation language models. arXiv preprint arXiv:2302.13971.","author":"Touvron Hugo","year":"2023","unstructured":"Hugo Touvron, Thibaut Lavril, Gautier Izacard, Xavier Martinet, Marie-Anne Lachaux, Timoth\u00e9e Lacroix, Baptiste Rozi\u00e8re, Naman Goyal, Eric Hambro, and Faisal Azhar. 2023. Llama: Open and efficient foundation language models. arXiv preprint arXiv:2302.13971."},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-81685-8_1"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1007\/S11704-024-40231-1"},{"key":"e_1_2_1_57_1","volume-title":"Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, EMNLP 2021, Virtual Event \/ Punta Cana, Dominican Republic","author":"Wang Yue","year":"2021","unstructured":"Yue Wang, Weishi Wang, Shafiq R. Joty, and Steven C. H. Hoi. 2021. CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, EMNLP 2021, Virtual Event \/ Punta Cana, Dominican Republic, 7-11 November, 2021, Marie-Francine Moens, Xuanjing Huang, Lucia Specia, and Scott Wen-tau Yih (Eds.). Association for Computational Linguistics, 8696\u20138708. https:\/\/doi.org\/10.18653\/V1\/2021.EMNLP-MAIN.685 10.18653\/V1\/2021.EMNLP-MAIN.685"},{"key":"e_1_2_1_58_1","volume-title":"DeepDiagnosis: Automatically Diagnosing Faults and Recommending Actionable Fixes in Deep Learning Programs. In 44th IEEE\/ACM 44th International Conference on Software Engineering, ICSE 2022","author":"Wardat Mohammad","year":"2022","unstructured":"Mohammad Wardat, Breno Dantas Cruz, Wei Le, and Hridesh Rajan. 2022. DeepDiagnosis: Automatically Diagnosing Faults and Recommending Actionable Fixes in Deep Learning Programs. In 44th IEEE\/ACM 44th International Conference on Software Engineering, ICSE 2022, Pittsburgh, PA, USA, May 25-27, 2022. ACM, 561\u2013572. https:\/\/doi.org\/10.1145\/3510003.3510071 10.1145\/3510003.3510071"},{"key":"e_1_2_1_59_1","volume-title":"DeepLocalize: Fault Localization for Deep Neural Networks. In 43rd IEEE\/ACM International Conference on Software Engineering, ICSE 2021","author":"Wardat Mohammad","year":"2021","unstructured":"Mohammad Wardat, Wei Le, and Hridesh Rajan. 2021. DeepLocalize: Fault Localization for Deep Neural Networks. In 43rd IEEE\/ACM International Conference on Software Engineering, ICSE 2021, Madrid, Spain, 22-30 May 2021. IEEE, 251\u2013262. https:\/\/doi.org\/10.1109\/ICSE43902.2021.00034 10.1109\/ICSE43902.2021.00034"},{"key":"e_1_2_1_60_1","volume-title":"Proceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, ESEC\/FSE 2023","author":"Wei Yuxiang","year":"2023","unstructured":"Yuxiang Wei, Chunqiu Steven Xia, and Lingming Zhang. 2023. Copiloting the Copilots: Fusing Large Language Models with Completion Engines for Automated Program Repair. In Proceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, ESEC\/FSE 2023, San Francisco, CA, USA, December 3-9, 2023, Satish Chandra, Kelly Blincoe, and Paolo Tonella (Eds.). ACM, 172\u2013184. https:\/\/doi.org\/10.1145\/3611643.3616271 10.1145\/3611643.3616271"},{"key":"e_1_2_1_61_1","volume-title":"26th IEEE International Conference on Software Analysis, Evolution and Reengineering, SANER 2019","author":"White Martin","year":"2019","unstructured":"Martin White, Michele Tufano, Matias Martinez, Martin Monperrus, and Denys Poshyvanyk. 2019. Sorting and Transforming Program Repair Ingredients via Deep Learning Code Similarities. In 26th IEEE International Conference on Software Analysis, Evolution and Reengineering, SANER 2019, Hangzhou, China, February 24-27, 2019, Xinyu Wang, David Lo, and Emad Shihab (Eds.). IEEE, 479\u2013490. https:\/\/doi.org\/10.1109\/SANER.2019.8668043 10.1109\/SANER.2019.8668043"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1142\/S1793962323410088"},{"key":"e_1_2_1_63_1","volume-title":"The Plastic Surgery Hypothesis in the Era of Large Language Models. In 38th IEEE\/ACM International Conference on Automated Software Engineering, ASE 2023","author":"Xia Chunqiu Steven","year":"2023","unstructured":"Chunqiu Steven Xia, Yifeng Ding, and Lingming Zhang. 2023. The Plastic Surgery Hypothesis in the Era of Large Language Models. In 38th IEEE\/ACM International Conference on Automated Software Engineering, ASE 2023, Luxembourg, September 11-15, 2023. IEEE, 522\u2013534. https:\/\/doi.org\/10.1109\/ASE56229.2023.00047 10.1109\/ASE56229.2023.00047"},{"key":"e_1_2_1_64_1","volume-title":"Automated Program Repair in the Era of Large Pre-trained Language Models. In 45th IEEE\/ACM International Conference on Software Engineering, ICSE 2023","author":"Xia Chunqiu Steven","year":"2023","unstructured":"Chunqiu Steven Xia, Yuxiang Wei, and Lingming Zhang. 2023. Automated Program Repair in the Era of Large Pre-trained Language Models. In 45th IEEE\/ACM International Conference on Software Engineering, ICSE 2023, Melbourne, Australia, May 14-20, 2023. IEEE, 1482\u20131494. https:\/\/doi.org\/10.1109\/ICSE48619.2023.00129 10.1109\/ICSE48619.2023.00129"},{"key":"e_1_2_1_65_1","volume-title":"Proceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, ESEC\/FSE 2022","author":"Xia Chunqiu Steven","year":"2022","unstructured":"Chunqiu Steven Xia and Lingming Zhang. 2022. Less training, more repairing please: revisiting automated program repair via zero-shot learning. In Proceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, ESEC\/FSE 2022, Singapore, Singapore, November 14-18, 2022, Abhik Roychoudhury, Cristian Cadar, and Miryung Kim (Eds.). ACM, 959\u2013971. https:\/\/doi.org\/10.1145\/3540250.3549101 10.1145\/3540250.3549101"},{"key":"e_1_2_1_66_1","volume-title":"Proceedings of the 33rd ACM SIGSOFT International Symposium on Software Testing and Analysis, ISSTA 2024","author":"Xia Chunqiu Steven","year":"2024","unstructured":"Chunqiu Steven Xia and Lingming Zhang. 2024. Automated Program Repair via Conversation: Fixing 162 out of 337 Bugs for $ 0.42 Each using ChatGPT. In Proceedings of the 33rd ACM SIGSOFT International Symposium on Software Testing and Analysis, ISSTA 2024, Vienna, Austria, September 16-20, 2024, Maria Christakis and Michael Pradel (Eds.). ACM, 819\u2013831. https:\/\/doi.org\/10.1145\/3650212.3680323 10.1145\/3650212.3680323"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1109\/COMST.2024.3353265"},{"key":"e_1_2_1_68_1","volume-title":"Neural Program Repair with Execution-based Backpropagation. In 44th IEEE\/ACM 44th International Conference on Software Engineering, ICSE 2022","author":"Ye He","year":"2022","unstructured":"He Ye, Matias Martinez, and Martin Monperrus. 2022. Neural Program Repair with Execution-based Backpropagation. In 44th IEEE\/ACM 44th International Conference on Software Engineering, ICSE 2022, Pittsburgh, PA, USA, May 25-27, 2022. ACM, 1506\u20131518. https:\/\/doi.org\/10.1145\/3510003.3510222 10.1145\/3510003.3510222"},{"key":"e_1_2_1_69_1","volume-title":"34th IEEE\/ACM International Conference on Automated Software Engineering, ASE 2019","author":"Zhang Hao","year":"2019","unstructured":"Hao Zhang and W. K. Chan. 2019. Apricot: A Weight-Adaptation Approach to Fixing Deep Learning Models. In 34th IEEE\/ACM International Conference on Automated Software Engineering, ASE 2019, San Diego, CA, USA, November 11-15, 2019. IEEE, 376\u2013387. https:\/\/doi.org\/10.1109\/ASE.2019.00043 10.1109\/ASE.2019.00043"},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2019.2962027"},{"key":"e_1_2_1_71_1","volume-title":"Gamma: Revisiting Template-Based Automated Program Repair Via Mask Prediction. In 38th IEEE\/ACM International Conference on Automated Software Engineering, ASE 2023","author":"Zhang Quanjun","year":"2023","unstructured":"Quanjun Zhang, Chunrong Fang, Tongke Zhang, Bowen Yu, Weisong Sun, and Zhenyu Chen. 2023. Gamma: Revisiting Template-Based Automated Program Repair Via Mask Prediction. In 38th IEEE\/ACM International Conference on Automated Software Engineering, ASE 2023, Luxembourg, September 11-15, 2023. IEEE, 535\u2013547. https:\/\/doi.org\/10.1109\/ASE56229.2023.00063 10.1109\/ASE56229.2023.00063"},{"key":"e_1_2_1_72_1","volume-title":"AUTOTRAINER: An Automatic DNN Training Problem Detection and Repair System. In 43rd IEEE\/ACM International Conference on Software Engineering, ICSE 2021","author":"Zhang Xiaoyu","year":"2021","unstructured":"Xiaoyu Zhang, Juan Zhai, Shiqing Ma, and Chao Shen. 2021. AUTOTRAINER: An Automatic DNN Training Problem Detection and Repair System. In 43rd IEEE\/ACM International Conference on Software Engineering, ICSE 2021, Madrid, Spain, 22-30 May 2021. IEEE, 359\u2013371. https:\/\/doi.org\/10.1109\/ICSE43902.2021.00043 10.1109\/ICSE43902.2021.00043"},{"key":"e_1_2_1_73_1","volume-title":"29th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering","author":"Zhu Qihao","year":"2021","unstructured":"Qihao Zhu, Zeyu Sun, Yuan-an Xiao, Wenjie Zhang, Kang Yuan, Yingfei Xiong, and Lu Zhang. 2021. A syntax-guided edit decoder for neural program repair. In ESEC\/FSE \u201921: 29th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, Athens, Greece, August 23-28, 2021, Diomidis Spinellis, Georgios Gousios, Marsha Chechik, and Massimiliano Di Penta (Eds.). ACM, 341\u2013353. https:\/\/doi.org\/10.1145\/3468264.3468544 10.1145\/3468264.3468544"}],"container-title":["Proceedings of the ACM on Software Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3715716","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T15:17:08Z","timestamp":1750346228000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3715716"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,19]]},"references-count":73,"journal-issue":{"issue":"FSE","published-print":{"date-parts":[[2025,6,19]]}},"alternative-id":["10.1145\/3715716"],"URL":"https:\/\/doi.org\/10.1145\/3715716","relation":{},"ISSN":["2994-970X"],"issn-type":[{"value":"2994-970X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,6,19]]}}}