{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,15]],"date-time":"2026-05-15T15:48:06Z","timestamp":1778860086687,"version":"3.51.4"},"publisher-location":"New York, NY, USA","reference-count":64,"publisher":"ACM","license":[{"start":{"date-parts":[[2023,7,12]],"date-time":"2023-07-12T00:00:00Z","timestamp":1689120000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,7,12]]},"DOI":"10.1145\/3597926.3598036","type":"proceedings-article","created":{"date-parts":[[2023,7,13]],"date-time":"2023-07-13T20:12:53Z","timestamp":1689279173000},"page":"39-51","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":31,"title":["Towards Efficient Fine-Tuning of Pre-trained Code Models: An Experimental Study and Beyond"],"prefix":"10.1145","author":[{"given":"Ensheng","family":"Shi","sequence":"first","affiliation":[{"name":"Xi\u2019an Jiaotong University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yanlin","family":"Wang","sequence":"additional","affiliation":[{"name":"Sun Yat-sen University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hongyu","family":"Zhang","sequence":"additional","affiliation":[{"name":"Chongqing University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lun","family":"Du","sequence":"additional","affiliation":[{"name":"Microsoft, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shi","family":"Han","sequence":"additional","affiliation":[{"name":"Microsoft, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dongmei","family":"Zhang","sequence":"additional","affiliation":[{"name":"Microsoft, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hongbin","family":"Sun","sequence":"additional","affiliation":[{"name":"Xi\u2019an Jiaotong University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2023,7,13]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"Zuidema","author":"Abnar Samira","year":"2019","unstructured":"Samira Abnar , Lisa Beinborn , Rochelle Choenni , and Willem H . Zuidema . 2019 . Blackbox Meets Blackbox: Representational Similarity & Stability Analysis of Neural Language Models and Brains. In BlackboxNLP@ACL. Association for Computational Linguistics , 191\u2013203. Samira Abnar, Lisa Beinborn, Rochelle Choenni, and Willem H. Zuidema. 2019. Blackbox Meets Blackbox: Representational Similarity & Stability Analysis of Neural Language Models and Brains. In BlackboxNLP@ACL. Association for Computational Linguistics, 191\u2013203."},{"key":"e_1_3_2_1_2_1","volume-title":"Unified Pre-training for Program Understanding and Generation","author":"Ahmad Wasi Uddin","unstructured":"Wasi Uddin Ahmad , Saikat Chakraborty , Baishakhi Ray , and Kai-Wei Chang . 2021. Unified Pre-training for Program Understanding and Generation . In NAACL-HLT. Association for Computational Linguistics , 2655\u20132668. Wasi Uddin Ahmad, Saikat Chakraborty, Baishakhi Ray, and Kai-Wei Chang. 2021. Unified Pre-training for Program Understanding and Generation. In NAACL-HLT. Association for Computational Linguistics, 2655\u20132668."},{"key":"e_1_3_2_1_3_1","unstructured":"Alfred V Aho Monica S Lam Ravi Sethi and Jeffrey D Ullman. 2007. Compilers: principles techniques & tools. Pearson Education India. Alfred V Aho Monica S Lam Ravi Sethi and Jeffrey D Ullman. 2007. Compilers: principles techniques & tools. Pearson Education India."},{"key":"e_1_3_2_1_4_1","volume-title":"User\u2019s guide to correlation coefficients. Turkish journal of emergency medicine, 18, 3","author":"Akoglu Haldun","year":"2018","unstructured":"Haldun Akoglu . 2018. User\u2019s guide to correlation coefficients. Turkish journal of emergency medicine, 18, 3 ( 2018 ), 91\u201393. Haldun Akoglu. 2018. User\u2019s guide to correlation coefficients. Turkish journal of emergency medicine, 18, 3 (2018), 91\u201393."},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/MSR.2013.6624029"},{"key":"e_1_3_2_1_6_1","volume-title":"METEOR: An Automatic Metric for MT Evaluation with Improved Correlation with Human Judgments. In IEEvaluation@ACL.","author":"Banerjee Satanjeev","year":"2005","unstructured":"Satanjeev Banerjee and Alon Lavie . 2005 . METEOR: An Automatic Metric for MT Evaluation with Improved Correlation with Human Judgments. In IEEvaluation@ACL. Satanjeev Banerjee and Alon Lavie. 2005. METEOR: An Automatic Metric for MT Evaluation with Improved Correlation with Human Judgments. In IEEvaluation@ACL."},{"key":"e_1_3_2_1_7_1","unstructured":"Hangbo Bao Li Dong Songhao Piao and Furu Wei. 2022. BEiT: BERT Pre-Training of Image Transformers. In ICLR. OpenReview.net. Hangbo Bao Li Dong Songhao Piao and Furu Wei. 2022. BEiT: BERT Pre-Training of Image Transformers. In ICLR. OpenReview.net."},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/72.279181"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"crossref","unstructured":"Saikat Chakraborty Toufique Ahmed Yangruibo Ding Premkumar Devanbu and Baishakhi Ray. 2022. NatGen: Generative pre-training by\" Naturalizing\" source code. Saikat Chakraborty Toufique Ahmed Yangruibo Ding Premkumar Devanbu and Baishakhi Ray. 2022. NatGen: Generative pre-training by\" Naturalizing\" source code.","DOI":"10.1145\/3540250.3549162"},{"key":"e_1_3_2_1_10_1","volume-title":"ACL (1)","author":"Chrupala Grzegorz","unstructured":"Grzegorz Chrupala and Afra Alishahi . 2019. Correlating Neural and Symbolic Representations of Language . In ACL (1) . Association for Computational Linguistics , 2952\u20132962. Grzegorz Chrupala and Afra Alishahi. 2019. Correlating Neural and Symbolic Representations of Language. In ACL (1). Association for Computational Linguistics, 2952\u20132962."},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/1985404.1985417"},{"key":"e_1_3_2_1_12_1","volume-title":"BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In NAACL-HLT (1)","author":"Devlin Jacob","year":"2019","unstructured":"Jacob Devlin , Ming-Wei Chang , Kenton Lee , and Kristina Toutanova . 2019 . BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In NAACL-HLT (1) . Association for Computational Linguistics , 4171\u20134186. Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In NAACL-HLT (1). Association for Computational Linguistics, 4171\u20134186."},{"key":"e_1_3_2_1_13_1","volume-title":"ACL (1)","author":"Ding Yangruibo","unstructured":"Yangruibo Ding , Luca Buratti , Saurabh Pujar , Alessandro Morari , Baishakhi Ray , and Saikat Chakraborty . 2022. Towards Learning (Dis)-Similarity of Source Code from Program Contrasts . In ACL (1) . Association for Computational Linguistics , 6300\u20136312. Yangruibo Ding, Luca Buratti, Saurabh Pujar, Alessandro Morari, Baishakhi Ray, and Saikat Chakraborty. 2022. Towards Learning (Dis)-Similarity of Source Code from Program Contrasts. In ACL (1). Association for Computational Linguistics, 6300\u20136312."},{"key":"e_1_3_2_1_14_1","volume-title":"Proceedings of the 30th ACM International Conference on Information & Knowledge Management. 2994\u20132998","author":"Du Lun","year":"2021","unstructured":"Lun Du , Xiaozhou Shi , Yanlin Wang , Ensheng Shi , Shi Han , and Dongmei Zhang . 2021 . Is a Single Model Enough? MuCoS: A Multi-Model Ensemble Learning Approach for Semantic Code Search . In Proceedings of the 30th ACM International Conference on Information & Knowledge Management. 2994\u20132998 . Lun Du, Xiaozhou Shi, Yanlin Wang, Ensheng Shi, Shi Han, and Dongmei Zhang. 2021. Is a Single Model Enough? MuCoS: A Multi-Model Ensemble Learning Approach for Semantic Code Search. In Proceedings of the 30th ACM International Conference on Information & Knowledge Management. 2994\u20132998."},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"crossref","unstructured":"Zhangyin Feng Daya Guo Duyu Tang Nan Duan Xiaocheng Feng Ming Gong Linjun Shou Bing Qin Ting Liu Daxin Jiang and Ming Zhou. 2020. CodeBERT: A Pre-Trained Model for Programming and Natural Languages. In EMNLP (Findings). Zhangyin Feng Daya Guo Duyu Tang Nan Duan Xiaocheng Feng Ming Gong Linjun Shou Bing Qin Ting Liu Daxin Jiang and Ming Zhou. 2020. CodeBERT: A Pre-Trained Model for Programming and Natural Languages. In EMNLP (Findings).","DOI":"10.18653\/v1\/2020.findings-emnlp.139"},{"key":"e_1_3_2_1_16_1","unstructured":"Xiaodong Gu Hongyu Zhang and Sunghun Kim. 2018. Deep code search. In ICSE. ACM 933\u2013944. Xiaodong Gu Hongyu Zhang and Sunghun Kim. 2018. Deep code search. In ICSE. ACM 933\u2013944."},{"key":"e_1_3_2_1_17_1","volume-title":"ACL (1)","author":"Guo Daya","unstructured":"Daya Guo , Shuai Lu , Nan Duan , Yanlin Wang , Ming Zhou , and Jian Yin . 2022. UniXcoder: Unified Cross-Modal Pre-training for Code Representation . In ACL (1) . Association for Computational Linguistics , 7212\u20137225. Daya Guo, Shuai Lu, Nan Duan, Yanlin Wang, Ming Zhou, and Jian Yin. 2022. UniXcoder: Unified Cross-Modal Pre-training for Code Representation. In ACL (1). Association for Computational Linguistics, 7212\u20137225."},{"key":"e_1_3_2_1_18_1","volume-title":"GraphCodeBERT: Pre-training Code Representations with Data Flow. In 9th International Conference on Learning Representations, ICLR 2021","author":"Guo Daya","year":"2021","unstructured":"Daya Guo , Shuo Ren , Shuai Lu , Zhangyin Feng , Duyu Tang , Shujie Liu , Long Zhou , Nan Duan , Alexey Svyatkovskiy , Shengyu Fu , Michele Tufano , Shao Kun Deng , Colin B. Clement , Dawn Drain , Neel Sundaresan , Jian Yin , Daxin Jiang , and Ming Zhou . 2021 . GraphCodeBERT: Pre-training Code Representations with Data Flow. In 9th International Conference on Learning Representations, ICLR 2021 , Virtual Event, Austria , May 3-7, 2021. OpenReview.net. https:\/\/openreview.net\/forum?id=jLoC4ez43PZ Daya Guo, Shuo Ren, Shuai Lu, Zhangyin Feng, Duyu Tang, Shujie Liu, Long Zhou, Nan Duan, Alexey Svyatkovskiy, Shengyu Fu, Michele Tufano, Shao Kun Deng, Colin B. Clement, Dawn Drain, Neel Sundaresan, Jian Yin, Daxin Jiang, and Ming Zhou. 2021. GraphCodeBERT: Pre-training Code Representations with Data Flow. In 9th International Conference on Learning Representations, ICLR 2021, Virtual Event, Austria, May 3-7, 2021. OpenReview.net. https:\/\/openreview.net\/forum?id=jLoC4ez43PZ"},{"key":"e_1_3_2_1_19_1","volume-title":"Girshick","author":"He Kaiming","year":"2022","unstructured":"Kaiming He , Xinlei Chen , Saining Xie , Yanghao Li , Piotr Doll\u00e1r , and Ross B . Girshick . 2022 . Masked Autoencoders Are Scalable Vision Learners. In CVPR. IEEE , 15979\u201315988. Kaiming He, Xinlei Chen, Saining Xie, Yanghao Li, Piotr Doll\u00e1r, and Ross B. Girshick. 2022. Masked Autoencoders Are Scalable Vision Learners. In CVPR. IEEE, 15979\u201315988."},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3551349.3556900"},{"key":"e_1_3_2_1_22_1","volume-title":"ICML (Proceedings of Machine Learning Research","volume":"2799","author":"Houlsby Neil","year":"2019","unstructured":"Neil Houlsby , Andrei Giurgiu , Stanislaw Jastrzebski , Bruna Morrone , Quentin de Laroussilhe , Andrea Gesmundo , Mona Attariyan , and Sylvain Gelly . 2019 . Parameter-Efficient Transfer Learning for NLP . In ICML (Proceedings of Machine Learning Research , Vol. 97). PMLR, 2790\u2013 2799 . Neil Houlsby, Andrei Giurgiu, Stanislaw Jastrzebski, Bruna Morrone, Quentin de Laroussilhe, Andrea Gesmundo, Mona Attariyan, and Sylvain Gelly. 2019. Parameter-Efficient Transfer Learning for NLP. In ICML (Proceedings of Machine Learning Research, Vol. 97). PMLR, 2790\u20132799."},{"key":"e_1_3_2_1_23_1","volume-title":"CodeSearchNet Challenge: Evaluating the State of Semantic Code Search. CoRR, abs\/1909.09436","author":"Husain Hamel","year":"2019","unstructured":"Hamel Husain , Ho-Hsiang Wu , Tiferet Gazit , Miltiadis Allamanis , and Marc Brockschmidt . 2019. CodeSearchNet Challenge: Evaluating the State of Semantic Code Search. CoRR, abs\/1909.09436 ( 2019 ), arXiv:1909.09436. arxiv:1909.09436 Hamel Husain, Ho-Hsiang Wu, Tiferet Gazit, Miltiadis Allamanis, and Marc Brockschmidt. 2019. CodeSearchNet Challenge: Evaluating the State of Semantic Code Search. CoRR, abs\/1909.09436 (2019), arXiv:1909.09436. arxiv:1909.09436"},{"key":"e_1_3_2_1_24_1","unstructured":"Srinivasan Iyer Ioannis Konstas Alvin Cheung and Luke Zettlemoyer. 2018. Mapping language to code in programmatic context. arXiv preprint arXiv:1808.09588. Srinivasan Iyer Ioannis Konstas Alvin Cheung and Luke Zettlemoyer. 2018. Mapping language to code in programmatic context. arXiv preprint arXiv:1808.09588."},{"key":"e_1_3_2_1_25_1","volume-title":"Mapping Language to Code in Programmatic Context","author":"Iyer Srinivasan","unstructured":"Srinivasan Iyer , Ioannis Konstas , Alvin Cheung , and Luke Zettlemoyer . 2018. Mapping Language to Code in Programmatic Context . In EMNLP. Association for Computational Linguistics , 1643\u20131652. Srinivasan Iyer, Ioannis Konstas, Alvin Cheung, and Luke Zettlemoyer. 2018. Mapping Language to Code in Programmatic Context. In EMNLP. Association for Computational Linguistics, 1643\u20131652."},{"key":"e_1_3_2_1_26_1","unstructured":"Junguang Jiang Yang Shu Jianmin Wang and Mingsheng Long. 2022. Transferability in Deep Learning: A Survey. arXiv preprint arXiv:2201.05867. Junguang Jiang Yang Shu Jianmin Wang and Mingsheng Long. 2022. Transferability in Deep Learning: A Survey. arXiv preprint arXiv:2201.05867."},{"key":"e_1_3_2_1_27_1","volume-title":"CURE: Code-Aware Neural Machine Translation for Automatic Program Repair","author":"Jiang Nan","year":"2021","unstructured":"Nan Jiang , Thibaud Lutellier , and Lin Tan . 2021 . CURE: Code-Aware Neural Machine Translation for Automatic Program Repair . In ICSE. IEEE , 1161\u20131173. Nan Jiang, Thibaud Lutellier, and Lin Tan. 2021. CURE: Code-Aware Neural Machine Translation for Automatic Program Repair. In ICSE. IEEE, 1161\u20131173."},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.5555\/3488766.3488792"},{"key":"e_1_3_2_1_29_1","volume-title":"EMNLP (Findings) (Findings of ACL","author":"Jiao Xiaoqi","unstructured":"Xiaoqi Jiao , Yichun Yin , Lifeng Shang , Xin Jiang , Xiao Chen , Linlin Li , Fang Wang , and Qun Liu . 2020. TinyBERT: Distilling BERT for Natural Language Understanding . In EMNLP (Findings) (Findings of ACL , Vol. EMNLP 2020). Association for Computational Linguistics, 4163\u2013 4174 . Xiaoqi Jiao, Yichun Yin, Lifeng Shang, Xin Jiang, Xiao Chen, Linlin Li, Fang Wang, and Qun Liu. 2020. TinyBERT: Distilling BERT for Natural Language Understanding. In EMNLP (Findings) (Findings of ACL, Vol. EMNLP 2020). Association for Computational Linguistics, 4163\u20134174."},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASE51524.2021.9678927"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"crossref","unstructured":"Nikolaus Kriegeskorte Marieke Mur and Peter A Bandettini. 2008. Representational similarity analysis-connecting the branches of systems neuroscience. Frontiers in systems neuroscience 4. Nikolaus Kriegeskorte Marieke Mur and Peter A Bandettini. 2008. Representational similarity analysis-connecting the branches of systems neuroscience. Frontiers in systems neuroscience 4.","DOI":"10.3389\/neuro.06.004.2008"},{"key":"e_1_3_2_1_32_1","volume-title":"ROUGE: A Package for Automatic Evaluation of Summaries. In ACL.","author":"Lin Chin-Yew","year":"2004","unstructured":"Chin-Yew Lin . 2004 . ROUGE: A Package for Automatic Evaluation of Summaries. In ACL. Chin-Yew Lin. 2004. ROUGE: A Package for Automatic Evaluation of Summaries. In ACL."},{"key":"e_1_3_2_1_33_1","volume-title":"RoBERTa: A Robustly Optimized BERT Pretraining Approach. CoRR, abs\/1907.11692","author":"Liu Yinhan","year":"2019","unstructured":"Yinhan Liu , Myle Ott , Naman Goyal , Jingfei Du , Mandar Joshi , Danqi Chen , Omer Levy , Mike Lewis , Luke Zettlemoyer , and Veselin Stoyanov . 2019. RoBERTa: A Robustly Optimized BERT Pretraining Approach. CoRR, abs\/1907.11692 ( 2019 ). Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019. RoBERTa: A Robustly Optimized BERT Pretraining Approach. CoRR, abs\/1907.11692 (2019)."},{"key":"e_1_3_2_1_34_1","volume-title":"Shengyu Fu, and Shujie Liu.","author":"Lu Shuai","year":"2021","unstructured":"Shuai Lu , Daya Guo , Shuo Ren , Junjie Huang , Alexey Svyatkovskiy , Ambrosio Blanco , Colin B. Clement , Dawn Drain , Daxin Jiang , Duyu Tang , Ge Li , Lidong Zhou , Linjun Shou , Long Zhou , Michele Tufano , Ming Gong , Ming Zhou , Nan Duan , Neel Sundaresan , Shao Kun Deng , Shengyu Fu, and Shujie Liu. 2021 . CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation. CoRR , abs\/2102.04664 (2021). Shuai Lu, Daya Guo, Shuo Ren, Junjie Huang, Alexey Svyatkovskiy, Ambrosio Blanco, Colin B. Clement, Dawn Drain, Daxin Jiang, Duyu Tang, Ge Li, Lidong Zhou, Linjun Shou, Long Zhou, Michele Tufano, Ming Gong, Ming Zhou, Nan Duan, Neel Sundaresan, Shao Kun Deng, Shengyu Fu, and Shujie Liu. 2021. CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation. CoRR, abs\/2102.04664 (2021)."},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3340531.3412747"},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.1976.233837"},{"key":"e_1_3_2_1_37_1","volume-title":"What Happens To BERT Embeddings During Fine-tuning? In BlackboxNLP@EMNLP","author":"Merchant Amil","unstructured":"Amil Merchant , Elahe Rahimtoroghi , Ellie Pavlick , and Ian Tenney . 2020. What Happens To BERT Embeddings During Fine-tuning? In BlackboxNLP@EMNLP . Association for Computational Linguistics , 33\u201344. Amil Merchant, Elahe Rahimtoroghi, Ellie Pavlick, and Ian Tenney. 2020. What Happens To BERT Embeddings During Fine-tuning? In BlackboxNLP@EMNLP. Association for Computational Linguistics, 33\u201344."},{"key":"e_1_3_2_1_38_1","unstructured":"Anders M\u00f8ller and Michael I Schwartzbach. 2012. Static program analysis. Notes. Feb. Anders M\u00f8ller and Michael I Schwartzbach. 2012. Static program analysis. Notes. Feb."},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v30i1.10139"},{"key":"e_1_3_2_1_40_1","unstructured":"Changan Niu Chuanyi Li Vincent Ng Jidong Ge Liguo Huang and Bin Luo. 2022. SPT-Code: Sequence-to-Sequence Pre-Training for Learning Source Code Representations. In ICSE. ACM 1\u201313. Changan Niu Chuanyi Li Vincent Ng Jidong Ge Liguo Huang and Bin Luo. 2022. SPT-Code: Sequence-to-Sequence Pre-Training for Learning Source Code Representations. In ICSE. ACM 1\u201313."},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"crossref","unstructured":"Kishore Papineni Salim Roukos Todd Ward and Wei-Jing Zhu. 2002. Bleu: a Method for Automatic Evaluation of Machine Translation. In ACL. ACL 311\u2013318. Kishore Papineni Salim Roukos Todd Ward and Wei-Jing Zhu. 2002. Bleu: a Method for Automatic Evaluation of Machine Translation. In ACL. ACL 311\u2013318.","DOI":"10.3115\/1073083.1073135"},{"key":"e_1_3_2_1_42_1","unstructured":"Julian Aron Prenner and Romain Robbes. 2021. Automatic Program Repair with OpenAI\u2019s Codex: Evaluating QuixBugs. arXiv preprint arXiv:2111.03922. Julian Aron Prenner and Romain Robbes. 2021. Automatic Program Repair with OpenAI\u2019s Codex: Evaluating QuixBugs. arXiv preprint arXiv:2111.03922."},{"key":"e_1_3_2_1_43_1","article-title":"Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer","volume":"21","author":"Raffel Colin","year":"2020","unstructured":"Colin Raffel , Noam Shazeer , Adam Roberts , Katherine Lee , Sharan Narang , Michael Matena , Yanqi Zhou , Wei Li , and Peter J. Liu . 2020 . Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer . J. Mach. Learn. Res. , 21 (2020), 140:1\u2013140:67. Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J. Liu. 2020. Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer. J. Mach. Learn. Res., 21 (2020), 140:1\u2013140:67.","journal-title":"J. Mach. Learn. Res."},{"key":"e_1_3_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1017\/S1351324909005129"},{"key":"e_1_3_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1213\/ANE.0000000000002864"},{"key":"e_1_3_2_1_46_1","unstructured":"Ensheng Shi Wenchao Gub Yanlin Wang Lun Du Hongyu Zhang Shi Han Dongmei Zhang and Hongbin Sun. 2022. Enhancing Semantic Code Search with Multimodal Contrastive Learning and Soft Data Augmentation. arXiv preprint arXiv:2204.03293. Ensheng Shi Wenchao Gub Yanlin Wang Lun Du Hongyu Zhang Shi Han Dongmei Zhang and Hongbin Sun. 2022. Enhancing Semantic Code Search with Multimodal Contrastive Learning and Soft Data Augmentation. arXiv preprint arXiv:2204.03293."},{"key":"e_1_3_2_1_47_1","unstructured":"Ensheng Shi Yanlin Wang Lun Du Junjie Chen Shi Han Hongyu Zhang Dongmei Zhang and Hongbin Sun. 2022. On the Evaluation of Neural Code Summarization. In ICSE. Ensheng Shi Yanlin Wang Lun Du Junjie Chen Shi Han Hongyu Zhang Dongmei Zhang and Hongbin Sun. 2022. On the Evaluation of Neural Code Summarization. In ICSE."},{"key":"e_1_3_2_1_48_1","volume-title":"Energy and Policy Considerations for Modern Deep Learning Research","author":"Strubell Emma","unstructured":"Emma Strubell , Ananya Ganesh , and Andrew McCallum . 2020. Energy and Policy Considerations for Modern Deep Learning Research . In AAAI. AAAI Press , 13693\u201313696. Emma Strubell, Ananya Ganesh, and Andrew McCallum. 2020. Energy and Policy Considerations for Modern Deep Learning Research. In AAAI. AAAI Press, 13693\u201313696."},{"key":"e_1_3_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSME.2014.77"},{"key":"e_1_3_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/3368089.3417058"},{"key":"e_1_3_2_1_51_1","unstructured":"Telly. 2023. Replication Package. ISSTA https:\/\/github.com\/DeepSoftwareAnalytics\/Telly Telly. 2023. Replication Package. ISSTA https:\/\/github.com\/DeepSoftwareAnalytics\/Telly"},{"key":"e_1_3_2_1_52_1","volume-title":"ACL (1)","author":"Tenney Ian","unstructured":"Ian Tenney , Dipanjan Das , and Ellie Pavlick . 2019. BERT Rediscovers the Classical NLP Pipeline . In ACL (1) . Association for Computational Linguistics , 4593\u20134601. Ian Tenney, Dipanjan Das, and Ellie Pavlick. 2019. BERT Rediscovers the Classical NLP Pipeline. In ACL (1). Association for Computational Linguistics, 4593\u20134601."},{"key":"e_1_3_2_1_53_1","volume-title":"Samuel R. Bowman, Dipanjan Das, and Ellie Pavlick.","author":"Tenney Ian","year":"2019","unstructured":"Ian Tenney , Patrick Xia , Berlin Chen , Alex Wang , Adam Poliak , R. Thomas McCoy , Najoung Kim , Benjamin Van Durme , Samuel R. Bowman, Dipanjan Das, and Ellie Pavlick. 2019 . What do you learn from context? Probing for sentence structure in contextualized word representations. In ICLR (Poster). OpenReview .net. Ian Tenney, Patrick Xia, Berlin Chen, Alex Wang, Adam Poliak, R. Thomas McCoy, Najoung Kim, Benjamin Van Durme, Samuel R. Bowman, Dipanjan Das, and Ellie Pavlick. 2019. What do you learn from context? Probing for sentence structure in contextualized word representations. In ICLR (Poster). OpenReview.net."},{"key":"e_1_3_2_1_54_1","doi-asserted-by":"crossref","unstructured":"Sergey Troshin and Nadezhda Chirkova. 2022. Probing Pretrained Models of Source Code. arXiv preprint arXiv:2202.08975. Sergey Troshin and Nadezhda Chirkova. 2022. Probing Pretrained Models of Source Code. arXiv preprint arXiv:2202.08975.","DOI":"10.18653\/v1\/2022.blackboxnlp-1.31"},{"key":"e_1_3_2_1_55_1","doi-asserted-by":"crossref","unstructured":"Rosalia Tufano Simone Masiero Antonio Mastropaolo Luca Pascarella Denys Poshyvanyk and Gabriele Bavota. 2022. Using Pre-Trained Models to Boost Code Review Automation. In ICSE. ACM 2291\u20132302. Rosalia Tufano Simone Masiero Antonio Mastropaolo Luca Pascarella Denys Poshyvanyk and Gabriele Bavota. 2022. Using Pre-Trained Models to Boost Code Review Automation. In ICSE. ACM 2291\u20132302.","DOI":"10.1145\/3510003.3510621"},{"key":"e_1_3_2_1_56_1","unstructured":"Ashish Vaswani Noam Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan N. Gomez Lukasz Kaiser and Illia Polosukhin. 2017. Attention is All you Need. In NIPS. 5998\u20136008. Ashish Vaswani Noam Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan N. Gomez Lukasz Kaiser and Illia Polosukhin. 2017. Attention is All you Need. In NIPS. 5998\u20136008."},{"key":"e_1_3_2_1_57_1","doi-asserted-by":"crossref","unstructured":"Ramakrishna Vedantam C. Lawrence Zitnick and Devi Parikh. 2015. CIDEr: Consensus-based image description evaluation. In CVPR. Ramakrishna Vedantam C. Lawrence Zitnick and Devi Parikh. 2015. CIDEr: Consensus-based image description evaluation. In CVPR.","DOI":"10.1109\/CVPR.2015.7299087"},{"key":"e_1_3_2_1_58_1","doi-asserted-by":"crossref","unstructured":"Yao Wan Wei Zhao Hongyu Zhang Yulei Sui Guandong Xu and Hai Jin. 2022. What Do They Capture? - A Structural Analysis of Pre-Trained Language Models for Source Code. In ICSE. ACM 2377\u20132388. Yao Wan Wei Zhao Hongyu Zhang Yulei Sui Guandong Xu and Hai Jin. 2022. What Do They Capture? - A Structural Analysis of Pre-Trained Language Models for Source Code. In ICSE. ACM 2377\u20132388.","DOI":"10.1145\/3510003.3510050"},{"key":"e_1_3_2_1_59_1","volume-title":"K-adapter: Infusing knowledge into pre-trained models with adapters. arXiv preprint arXiv:2002.01808.","author":"Wang Ruize","year":"2020","unstructured":"Ruize Wang , Duyu Tang , Nan Duan , Zhongyu Wei , Xuanjing Huang , Guihong Cao , Daxin Jiang , and Ming Zhou . 2020 . K-adapter: Infusing knowledge into pre-trained models with adapters. arXiv preprint arXiv:2002.01808. Ruize Wang, Duyu Tang, Nan Duan, Zhongyu Wei, Xuanjing Huang, Guihong Cao, Daxin Jiang, and Ming Zhou. 2020. K-adapter: Infusing knowledge into pre-trained models with adapters. arXiv preprint arXiv:2002.01808."},{"key":"e_1_3_2_1_60_1","first-page":"5776","article-title":"Minilm: Deep self-attention distillation for task-agnostic compression of pre-trained transformers","volume":"33","author":"Wang Wenhui","year":"2020","unstructured":"Wenhui Wang , Furu Wei , Li Dong , Hangbo Bao , Nan Yang , and Ming Zhou . 2020 . Minilm: Deep self-attention distillation for task-agnostic compression of pre-trained transformers . Advances in Neural Information Processing Systems , 33 (2020), 5776 \u2013 5788 . Wenhui Wang, Furu Wei, Li Dong, Hangbo Bao, Nan Yang, and Ming Zhou. 2020. Minilm: Deep self-attention distillation for task-agnostic compression of pre-trained transformers. Advances in Neural Information Processing Systems, 33 (2020), 5776\u20135788.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_1_61_1","volume-title":"Cocogum: Contextual code summarization with multi-relational gnn on umls.","author":"Wang Yanlin","year":"2020","unstructured":"Yanlin Wang , Lun Du , Ensheng Shi , Yuxuan Hu , Shi Han , and Dongmei Zhang . 2020 . Cocogum: Contextual code summarization with multi-relational gnn on umls. Microsoft , MSR-TR- 2020-16. [Online]. Available:. https:\/\/www.microsoft.com\/en-us\/research\/publication\/cocogum-contextual-code-summarization-with-multi-relational-gnn-on-umls Yanlin Wang, Lun Du, Ensheng Shi, Yuxuan Hu, Shi Han, and Dongmei Zhang. 2020. Cocogum: Contextual code summarization with multi-relational gnn on umls. Microsoft, MSR-TR-2020-16. [Online]. Available:. https:\/\/www.microsoft.com\/en-us\/research\/publication\/cocogum-contextual-code-summarization-with-multi-relational-gnn-on-umls"},{"key":"e_1_3_2_1_62_1","volume-title":"Efficient DNN Training with Knowledge-Guided Layer Freezing. CoRR, abs\/2201.06227","author":"Wang Yiding","year":"2022","unstructured":"Yiding Wang , Decang Sun , Kai Chen , Fan Lai , and Mosharaf Chowdhury . 2022. Efficient DNN Training with Knowledge-Guided Layer Freezing. CoRR, abs\/2201.06227 ( 2022 ). Yiding Wang, Decang Sun, Kai Chen, Fan Lai, and Mosharaf Chowdhury. 2022. Efficient DNN Training with Knowledge-Guided Layer Freezing. CoRR, abs\/2201.06227 (2022)."},{"key":"e_1_3_2_1_63_1","volume-title":"Hoi","author":"Wang Yue","year":"2021","unstructured":"Yue Wang , Weishi Wang , Shafiq R. Joty , and Steven C. H . Hoi . 2021 . CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation. In EMNLP (1). Association for Computational Linguistics , 8696\u20138708. Yue Wang, Weishi Wang, Shafiq R. Joty, and Steven C. H. Hoi. 2021. CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation. In EMNLP (1). Association for Computational Linguistics, 8696\u20138708."},{"key":"e_1_3_2_1_64_1","doi-asserted-by":"crossref","unstructured":"Zhengran Zeng Hanzhuo Tan Haotian Zhang Jing Li Yuqun Zhang and Lingming Zhang. 2022. An extensive study on pre-trained models for program understanding and generation. In ISSTA. ACM 39\u201351. Zhengran Zeng Hanzhuo Tan Haotian Zhang Jing Li Yuqun Zhang and Lingming Zhang. 2022. An extensive study on pre-trained models for program understanding and generation. In ISSTA. ACM 39\u201351.","DOI":"10.1145\/3533767.3534390"}],"event":{"name":"ISSTA '23: 32nd ACM SIGSOFT International Symposium on Software Testing and Analysis","location":"Seattle WA USA","acronym":"ISSTA '23","sponsor":["SIGSOFT ACM Special Interest Group on Software Engineering","AITO"]},"container-title":["Proceedings of the 32nd ACM SIGSOFT International Symposium on Software Testing and Analysis"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3597926.3598036","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3597926.3598036","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:48:41Z","timestamp":1750182521000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3597926.3598036"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,7,12]]},"references-count":64,"alternative-id":["10.1145\/3597926.3598036","10.1145\/3597926"],"URL":"https:\/\/doi.org\/10.1145\/3597926.3598036","relation":{},"subject":[],"published":{"date-parts":[[2023,7,12]]},"assertion":[{"value":"2023-07-13","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}