{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,8]],"date-time":"2026-10-08T11:33:37Z","timestamp":1791459217960,"version":"4.3.4"},"reference-count":89,"publisher":"Association for Computing Machinery (ACM)","issue":"OOPSLA2","license":[{"start":{"date-parts":[[2023,10,16]],"date-time":"2023-10-16T00:00:00Z","timestamp":1697414400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Key R&D Program of China","award":["2022YFA1005101"],"award-info":[{"award-number":["2022YFA1005101"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61932021,62002125,62272072"],"award-info":[{"award-number":["61932021,62002125,62272072"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Young Elite Scientists Sponsorship Program by CAST","award":["2021QNRC001"],"award-info":[{"award-number":["2021QNRC001"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Program. Lang."],"published-print":{"date-parts":[[2023,10,16]]},"abstract":"<jats:p>Automatically transforming developers' natural language descriptions into source code has been a longstanding goal in software engineering research.  \nTwo types of approaches have been proposed in the literature to achieve this: code generation, which involves generating a new code snippet, and code search, which involves reusing existing code.  \nHowever, despite existing efforts, the effectiveness of the state-of-the-art techniques remains limited.  \nTo seek for further advancement, our insight is that code generation and code search can help overcome the limitation of each other:  \nthe code generator can benefit from feedback on the quality of its generated code, which can be provided by the code searcher, while the code searcher can benefit from the additional training data augmented by the code generator to better understand code semantics.  \nDrawing on this insight, we propose a novel approach that combines code generation and code search techniques using a generative adversarial network (GAN), enabling mutual improvement through the adversarial training.  \nSpecifically, we treat code generation and code search as the generator and discriminator in the GAN framework, respectively, and incorporate several customized designs for our tasks.  \nWe evaluate our approach in eight different settings, and consistently observe significant performance improvements for both code generation and code search.  \nFor instance, when using NatGen, a state-of-the-art code generator, as the generator and GraphCodeBERT, a state-of-the-art code searcher, as the discriminator, we achieve a 32% increase in CodeBLEU score for code generation, and a 12% increase in mean reciprocal rank for code search on a large-scale Python dataset, compared to their original performances.<\/jats:p>","DOI":"10.1145\/3622815","type":"journal-article","created":{"date-parts":[[2023,10,16]],"date-time":"2023-10-16T11:41:29Z","timestamp":1697456489000},"page":"486-515","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":24,"title":["Two Birds with One Stone: Boosting Code Generation and Code Search via a Generative Adversarial Network"],"prefix":"10.1145","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1469-2063","authenticated-orcid":false,"given":"Shangwen","family":"Wang","sequence":"first","affiliation":[{"name":"National University of Defense Technology, Changsha, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5905-4677","authenticated-orcid":false,"given":"Bo","family":"Lin","sequence":"additional","affiliation":[{"name":"National University of Defense Technology, Changsha, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5393-7858","authenticated-orcid":false,"given":"Zhensu","family":"Sun","sequence":"additional","affiliation":[{"name":"Singapore Management University, Singapore, Singapore"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5588-9618","authenticated-orcid":false,"given":"Ming","family":"Wen","sequence":"additional","affiliation":[{"name":"Huazhong University of Science and Technology, Wuhan, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8147-8126","authenticated-orcid":false,"given":"Yepang","family":"Liu","sequence":"additional","affiliation":[{"name":"Southern University of Science and Technology, Shenzhen, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4504-6806","authenticated-orcid":false,"given":"Yan","family":"Lei","sequence":"additional","affiliation":[{"name":"Chongqing University, Chongqing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4204-7424","authenticated-orcid":false,"given":"Xiaoguang","family":"Mao","sequence":"additional","affiliation":[{"name":"National University of Defense Technology, Changsha, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2023,10,16]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/3212695"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.2019.00051"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3586030"},{"key":"e_1_2_1_4_1","volume-title":"Scheduled sampling for sequence prediction with recurrent neural networks. Advances in neural information processing systems, 28","author":"Bengio Samy","year":"2015","unstructured":"Samy Bengio , Oriol Vinyals , Navdeep Jaitly , and Noam Shazeer . 2015. Scheduled sampling for sequence prediction with recurrent neural networks. Advances in neural information processing systems, 28 ( 2015 ). Samy Bengio, Oriol Vinyals, Navdeep Jaitly, and Noam Shazeer. 2015. Scheduled sampling for sequence prediction with recurrent neural networks. Advances in neural information processing systems, 28 (2015)."},{"key":"e_1_2_1_5_1","volume-title":"Large Scale GAN Training for High Fidelity Natural Image Synthesis. In International Conference on Learning Representations.","author":"Brock Andrew","year":"2019","unstructured":"Andrew Brock , Jeff Donahue , and Karen Simonyan . 2019 . Large Scale GAN Training for High Fidelity Natural Image Synthesis. In International Conference on Learning Representations. Andrew Brock, Jeff Donahue, and Karen Simonyan. 2019. Large Scale GAN Training for High Fidelity Natural Image Synthesis. In International Conference on Learning Representations."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3404835.3462840"},{"key":"e_1_2_1_7_1","volume-title":"Leveraging Grammar and Reinforcement Learning for Neural Program Synthesis. In International Conference on Learning Representations (ICLR).","author":"Bunel Rudy","year":"2018","unstructured":"Rudy Bunel , Matthew Hausknecht , Jacob Devlin , Rishabh Singh , and Pushmeet Kohli . 2018 . Leveraging Grammar and Reinforcement Learning for Neural Program Synthesis. In International Conference on Learning Representations (ICLR). Rudy Bunel, Matthew Hausknecht, Jacob Devlin, Rishabh Singh, and Pushmeet Kohli. 2018. Leveraging Grammar and Reinforcement Learning for Neural Program Synthesis. In International Conference on Learning Representations (ICLR)."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3338906.3340458"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3540250.3549162"},{"key":"e_1_2_1_10_1","volume-title":"Jared Kaplan, Harri Edwards, Yuri Burda, Nicholas Joseph, and Greg Brockman.","author":"Chen Mark","year":"2021","unstructured":"Mark Chen , Jerry Tworek , Heewoo Jun , Qiming Yuan , Henrique Ponde de Oliveira Pinto , Jared Kaplan, Harri Edwards, Yuri Burda, Nicholas Joseph, and Greg Brockman. 2021 . Evaluating large language models trained on code. arXiv preprint arXiv:2107.03374. Mark Chen, Jerry Tworek, Heewoo Jun, Qiming Yuan, Henrique Ponde de Oliveira Pinto, Jared Kaplan, Harri Edwards, Yuri Burda, Nicholas Joseph, and Greg Brockman. 2021. Evaluating large language models trained on code. arXiv preprint arXiv:2107.03374."},{"key":"e_1_2_1_11_1","volume-title":"A continual learning survey: Defying forgetting in classification tasks","author":"Lange Matthias De","year":"2021","unstructured":"Matthias De Lange , Rahaf Aljundi , Marc Masana , Sarah Parisot , Xu Jia , Ale\u0161 Leonardis , Gregory Slabaugh , and Tinne Tuytelaars . 2021. A continual learning survey: Defying forgetting in classification tasks . IEEE transactions on pattern analysis and machine intelligence, 44, 7 ( 2021 ), 3366\u20133385. Matthias De Lange, Rahaf Aljundi, Marc Masana, Sarah Parisot, Xu Jia, Ale\u0161 Leonardis, Gregory Slabaugh, and Tinne Tuytelaars. 2021. A continual learning survey: Defying forgetting in classification tasks. IEEE transactions on pattern analysis and machine intelligence, 44, 7 (2021), 3366\u20133385."},{"key":"e_1_2_1_12_1","volume-title":"Deep generative image models using a laplacian pyramid of adversarial networks. Advances in neural information processing systems, 28","author":"Denton Emily L","year":"2015","unstructured":"Emily L Denton , Soumith Chintala , and Rob Fergus . 2015. Deep generative image models using a laplacian pyramid of adversarial networks. Advances in neural information processing systems, 28 ( 2015 ). Emily L Denton, Soumith Chintala, and Rob Fergus. 2015. Deep generative image models using a laplacian pyramid of adversarial networks. Advances in neural information processing systems, 28 (2015)."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/n19-1423"},{"key":"e_1_2_1_14_1","volume-title":"Code Search: A Survey of Techniques for Finding Code. arXiv preprint arXiv:2204.02765.","author":"Grazia Luca Di","year":"2022","unstructured":"Luca Di Grazia and Michael Pradel . 2022 . Code Search: A Survey of Techniques for Finding Code. arXiv preprint arXiv:2204.02765. Luca Di Grazia and Michael Pradel. 2022. Code Search: A Survey of Techniques for Finding Code. arXiv preprint arXiv:2204.02765."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P18-1068"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3551349.3556903"},{"key":"e_1_2_1_17_1","volume-title":"2023 IEEE\/ACM 45th International Conference on Software Engineering (ICSE).","author":"Fan Zhiyu","year":"2023","unstructured":"Zhiyu Fan , Xiang Gao , Abhik Roychoudhury , and Shin Hwei Tan . 2023 . Automated Repair of Programs from Large Language Models . In 2023 IEEE\/ACM 45th International Conference on Software Engineering (ICSE). Zhiyu Fan, Xiang Gao, Abhik Roychoudhury, and Shin Hwei Tan. 2023. Automated Repair of Programs from Large Language Models. In 2023 IEEE\/ACM 45th International Conference on Software Engineering (ICSE)."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.findings-emnlp.139"},{"key":"e_1_2_1_19_1","volume-title":"Keeping Pace with Ever-Increasing Data: Towards Continual Learning of Code Intelligence Models. In 2023 IEEE\/ACM 45th International Conference on Software Engineering (ICSE).","author":"Gao Shuzheng","year":"2023","unstructured":"Shuzheng Gao , Hongyu Zhang , Cuiyun Gao , and Chaozheng Wang . 2023 . Keeping Pace with Ever-Increasing Data: Towards Continual Learning of Code Intelligence Models. In 2023 IEEE\/ACM 45th International Conference on Software Engineering (ICSE). Shuzheng Gao, Hongyu Zhang, Cuiyun Gao, and Chaozheng Wang. 2023. Keeping Pace with Ever-Increasing Data: Towards Continual Learning of Code Intelligence Models. In 2023 IEEE\/ACM 45th International Conference on Software Engineering (ICSE)."},{"key":"e_1_2_1_20_1","volume-title":"Generative Adversarial Nets. Advances in Neural Information Processing Systems, 27","author":"Goodfellow Ian","year":"2014","unstructured":"Ian Goodfellow , Jean Pouget-Abadie , Mehdi Mirza , Bing Xu , David Warde-Farley , Sherjil Ozair , Aaron Courville , and Yoshua Bengio . 2014. Generative Adversarial Nets. Advances in Neural Information Processing Systems, 27 ( 2014 ). Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2014. Generative Adversarial Nets. Advances in Neural Information Processing Systems, 27 (2014)."},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3180155.3180167"},{"key":"e_1_2_1_22_1","unstructured":"Daya Guo Shuo Ren Shuai Lu Zhangyin Feng Duyu Tang Shujie Liu Long Zhou Nan Duan Alexey Svyatkovskiy and Shengyu Fu. 2021. GraphCodeBERT: Pre-training Code Representations with Data Flow. In ICLR. \t\t\t\t  Daya Guo Shuo Ren Shuai Lu Zhangyin Feng Duyu Tang Shujie Liu Long Zhou Nan Duan Alexey Svyatkovskiy and Shengyu Fu. 2021. GraphCodeBERT: Pre-training Code Representations with Data Flow. In ICLR."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.54292"},{"key":"e_1_2_1_24_1","volume-title":"A retrieve-and-edit framework for predicting structured outputs. Advances in Neural Information Processing Systems, 31","author":"Hashimoto Tatsunori B","year":"2018","unstructured":"Tatsunori B Hashimoto , Kelvin Guu , Yonatan Oren , and Percy S Liang . 2018. A retrieve-and-edit framework for predicting structured outputs. Advances in Neural Information Processing Systems, 31 ( 2018 ). Tatsunori B Hashimoto, Kelvin Guu, Yonatan Oren, and Percy S Liang. 2018. A retrieve-and-edit framework for predicting structured outputs. Advances in Neural Information Processing Systems, 31 (2018)."},{"key":"e_1_2_1_25_1","volume-title":"Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing.","author":"Hayati Shirley Anugrah","year":"2018","unstructured":"Shirley Anugrah Hayati , Raphael Olivier , Pravalika Avvaru , Pengcheng Yin , Anthony Tomasic , and Graham Neubig . 2018 . Retrieval-Based Neural Code Generation . In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing. Shirley Anugrah Hayati, Raphael Olivier, Pravalika Avvaru, Pengcheng Yin, Anthony Tomasic, and Graham Neubig. 2018. Retrieval-Based Neural Code Generation. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-006-9025-1"},{"key":"e_1_2_1_27_1","unstructured":"Hamel Husain Ho-Hsiang Wu Tiferet Gazit Miltiadis Allamanis and Marc Brockschmidt. 2019. Codesearchnet challenge: Evaluating the state of semantic code search. arXiv preprint arXiv:1909.09436. \t\t\t\t  Hamel Husain Ho-Hsiang Wu Tiferet Gazit Miltiadis Allamanis and Marc Brockschmidt. 2019. Codesearchnet challenge: Evaluating the state of semantic code search. arXiv preprint arXiv:1909.09436."},{"key":"e_1_2_1_28_1","volume-title":"Proceedings of the ACM on Programming Languages, 4, OOPSLA","author":"James Michael B","year":"2020","unstructured":"Michael B James , Zheng Guo , Ziteng Wang , Shivani Doshi , Hila Peleg , Ranjit Jhala , and Nadia Polikarpova . 2020 . Digging for fold: synthesis-aided API discovery for Haskell . Proceedings of the ACM on Programming Languages, 4, OOPSLA (2020), 1\u201327. Michael B James, Zheng Guo, Ziteng Wang, Shivani Doshi, Hila Peleg, Ranjit Jhala, and Nadia Polikarpova. 2020. Digging for fold: synthesis-aided API discovery for Haskell. Proceedings of the ACM on Programming Languages, 4, OOPSLA (2020), 1\u201327."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/VLHCC.2004.47"},{"key":"e_1_2_1_30_1","volume-title":"Mitigating the Effect of Class Imbalance in Fault Localization Using Context-aware Generative Adversarial Network. In 2023 IEEE\/ACM 31st International Conference on Program Comprehension (ICPC).","author":"Lei Yan","year":"2023","unstructured":"Yan Lei , Tiantian Wen , Huan Xie , Lingfeng Fu , Chunyan Liu , Lei Xu , and Hongxia Sun . 2023 . Mitigating the Effect of Class Imbalance in Fault Localization Using Context-aware Generative Adversarial Network. In 2023 IEEE\/ACM 31st International Conference on Program Comprehension (ICPC). Yan Lei, Tiantian Wen, Huan Xie, Lingfeng Fu, Chunyan Liu, Lei Xu, and Hongxia Sun. 2023. Mitigating the Effect of Class Imbalance in Fault Localization Using Context-aware Generative Adversarial Network. In 2023 IEEE\/ACM 31st International Conference on Program Comprehension (ICPC)."},{"key":"e_1_2_1_31_1","volume-title":"SkCoder: A Sketch-based Approach for Automatic Code Generation. In 2023 IEEE\/ACM 45th International Conference on Software Engineering (ICSE).","author":"Li Jia","year":"2023","unstructured":"Jia Li , Yongmin Li , Ge Li , Zhi Jin , Yiyang Hao , and Xing Hu . 2023 . SkCoder: A Sketch-based Approach for Automatic Code Generation. In 2023 IEEE\/ACM 45th International Conference on Software Engineering (ICSE). Jia Li, Yongmin Li, Ge Li, Zhi Jin, Yiyang Hao, and Xing Hu. 2023. SkCoder: A Sketch-based Approach for Automatic Code Generation. In 2023 IEEE\/ACM 45th International Conference on Software Engineering (ICSE)."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D17-1230"},{"key":"e_1_2_1_33_1","volume-title":"Competition-level code generation with alphacode. Science, 378, 6624","author":"Li Yujia","year":"2022","unstructured":"Yujia Li , David Choi , Junyoung Chung , Nate Kushman , Julian Schrittwieser , R\u00e9mi Leblond , Tom Eccles , James Keeling , Felix Gimeno , and Agustin Dal Lago . 2022. Competition-level code generation with alphacode. Science, 378, 6624 ( 2022 ), 1092\u20131097. Yujia Li, David Choi, Junyoung Chung, Nate Kushman, Julian Schrittwieser, R\u00e9mi Leblond, Tom Eccles, James Keeling, Felix Gimeno, and Agustin Dal Lago. 2022. Competition-level code generation with alphacode. Science, 378, 6624 (2022), 1092\u20131097."},{"key":"e_1_2_1_34_1","volume-title":"Learning without forgetting","author":"Li Zhizhong","year":"2017","unstructured":"Zhizhong Li and Derek Hoiem . 2017. Learning without forgetting . IEEE transactions on pattern analysis and machine intelligence, 40, 12 ( 2017 ), 2935\u20132947. Zhizhong Li and Derek Hoiem. 2017. Learning without forgetting. IEEE transactions on pattern analysis and machine intelligence, 40, 12 (2017), 2935\u20132947."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3387904.3389278"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P16-1057"},{"key":"e_1_2_1_37_1","first-page":"1","article-title":"Opportunities and challenges in code search tools","volume":"54","author":"Liu Chao","year":"2021","unstructured":"Chao Liu , Xin Xia , David Lo , Cuiyun Gao , Xiaohu Yang , and John Grundy . 2021 . Opportunities and challenges in code search tools . ACM Computing Surveys (CSUR) , 54 , 9 (2021), 1 \u2013 40 . Chao Liu, Xin Xia, David Lo, Cuiyun Gao, Xiaohu Yang, and John Grundy. 2021. Opportunities and challenges in code search tools. ACM Computing Surveys (CSUR), 54, 9 (2021), 1\u201340.","journal-title":"ACM Computing Surveys (CSUR)"},{"key":"e_1_2_1_38_1","first-page":"1","article-title":"Deep Learning Based Program Generation from Requirements Text: Are We There Yet","author":"Liu Hui","year":"2020","unstructured":"Hui Liu , Mingzhu Shen , Jiaqi Zhu , Nan Niu , Ge Li , and Lu Zhang . 2020 . Deep Learning Based Program Generation from Requirements Text: Are We There Yet ? IEEE Transactions on Software Engineering , 1 \u2013 1 . Hui Liu, Mingzhu Shen, Jiaqi Zhu, Nan Niu, Ge Li, and Lu Zhang. 2020. Deep Learning Based Program Generation from Requirements Text: Are We There Yet? IEEE Transactions on Software Engineering, 1\u20131.","journal-title":"IEEE Transactions on Software Engineering"},{"key":"e_1_2_1_39_1","volume-title":"CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation. In Thirty-fifth Conference on Neural Information Processing Systems Datasets and Benchmarks Track (Round 1).","author":"Lu Shuai","year":"2021","unstructured":"Shuai Lu , Daya Guo , Shuo Ren , Junjie Huang , Alexey Svyatkovskiy , Ambrosio Blanco , Colin Clement , Dawn Drain , Daxin Jiang , and Duyu Tang . 2021 . CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation. In Thirty-fifth Conference on Neural Information Processing Systems Datasets and Benchmarks Track (Round 1). Shuai Lu, Daya Guo, Shuo Ren, Junjie Huang, Alexey Svyatkovskiy, Ambrosio Blanco, Colin Clement, Dawn Drain, Daxin Jiang, and Duyu Tang. 2021. CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation. In Thirty-fifth Conference on Neural Information Processing Systems Datasets and Benchmarks Track (Round 1)."},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3360578"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.2015.42"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/1985793.1985809"},{"key":"e_1_2_1_43_1","volume-title":"2012 34th International Conference on Software Engineering (ICSE). 848\u2013858","author":"McMillan Collin","year":"2012","unstructured":"Collin McMillan , Negar Hariri , Denys Poshyvanyk , Jane Cleland-Huang , and Bamshad Mobasher . 2012 . Recommending source code for use in rapid software prototypes . In 2012 34th International Conference on Software Engineering (ICSE). 848\u2013858 . Collin McMillan, Negar Hariri, Denys Poshyvanyk, Jane Cleland-Huang, and Bamshad Mobasher. 2012. Recommending source code for use in rapid software prototypes. In 2012 34th International Conference on Software Engineering (ICSE). 848\u2013858."},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/3360569"},{"key":"e_1_2_1_45_1","unstructured":"Mehdi Mirza and Simon Osindero. 2014. Conditional generative adversarial nets. arXiv preprint arXiv:1411.1784. \t\t\t\t  Mehdi Mirza and Simon Osindero. 2014. Conditional generative adversarial nets. arXiv preprint arXiv:1411.1784."},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-007-9040-x"},{"key":"e_1_2_1_47_1","volume-title":"An Empirical Comparison of Pre-Trained Models of Source Code. In 2023 IEEE\/ACM 45th International Conference on Software Engineering (ICSE).","author":"Niu Changan","year":"2023","unstructured":"Changan Niu , Chuanyi Li , Vincent Ng , Dongxiao Chen , Jidong Ge , and Bin Luo . 2023 . An Empirical Comparison of Pre-Trained Models of Source Code. In 2023 IEEE\/ACM 45th International Conference on Software Engineering (ICSE). Changan Niu, Chuanyi Li, Vincent Ng, Dongxiao Chen, Jidong Ge, and Bin Luo. 2023. An Empirical Comparison of Pre-Trained Models of Source Code. In 2023 IEEE\/ACM 45th International Conference on Software Engineering (ICSE)."},{"key":"e_1_2_1_48_1","volume-title":"Proceedings of the international multiconference of engineers and computer scientists. 1, 380\u2013384","author":"Niwattanakul Suphakit","year":"2013","unstructured":"Suphakit Niwattanakul , Jatsada Singthongchai , Ekkachai Naenudorn , and Supachanun Wanapu . 2013 . Using of Jaccard coefficient for keywords similarity . In Proceedings of the international multiconference of engineers and computer scientists. 1, 380\u2013384 . Suphakit Niwattanakul, Jatsada Singthongchai, Ekkachai Naenudorn, and Supachanun Wanapu. 2013. Using of Jaccard coefficient for keywords similarity. In Proceedings of the international multiconference of engineers and computer scientists. 1, 380\u2013384."},{"key":"e_1_2_1_49_1","volume-title":"Proceedings of the 40th annual meeting of the Association for Computational Linguistics. 311\u2013318","author":"Papineni Kishore","year":"2002","unstructured":"Kishore Papineni , Salim Roukos , Todd Ward , and Wei-Jing Zhu . 2002 . Bleu: a method for automatic evaluation of machine translation . In Proceedings of the 40th annual meeting of the Association for Computational Linguistics. 311\u2013318 . Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. Bleu: a method for automatic evaluation of machine translation. In Proceedings of the 40th annual meeting of the Association for Computational Linguistics. 311\u2013318."},{"key":"e_1_2_1_50_1","volume-title":"2022 IEEE Symposium on Security and Privacy (SP). 754\u2013768","author":"Pearce Hammond","year":"2022","unstructured":"Hammond Pearce , Baleegh Ahmad , Benjamin Tan , Brendan Dolan-Gavitt , and Ramesh Karri . 2022 . Asleep at the keyboard? assessing the security of github copilot\u2019s code contributions . In 2022 IEEE Symposium on Security and Privacy (SP). 754\u2013768 . Hammond Pearce, Baleegh Ahmad, Benjamin Tan, Brendan Dolan-Gavitt, and Ramesh Karri. 2022. Asleep at the keyboard? assessing the security of github copilot\u2019s code contributions. In 2022 IEEE Symposium on Security and Privacy (SP). 754\u2013768."},{"key":"e_1_2_1_51_1","volume-title":"Proceedings of the ACM on Programming Languages, 6, OOPSLA1","author":"Pelsmaeker Dani\u00ebl AA","year":"2022","unstructured":"Dani\u00ebl AA Pelsmaeker , Hendrik van Antwerpen , Casper Bach Poulsen , and Eelco Visser . 2022 . Language-parametric static semantic code completion . Proceedings of the ACM on Programming Languages, 6, OOPSLA1 (2022), 1\u201330. Dani\u00ebl AA Pelsmaeker, Hendrik van Antwerpen, Casper Bach Poulsen, and Eelco Visser. 2022. Language-parametric static semantic code completion. Proceedings of the ACM on Programming Languages, 6, OOPSLA1 (2022), 1\u201330."},{"key":"e_1_2_1_52_1","unstructured":"Alec Radford Luke Metz and Soumith Chintala. 2015. Unsupervised representation learning with deep convolutional generative adversarial networks. arXiv preprint arXiv:1511.06434. \t\t\t\t  Alec Radford Luke Metz and Soumith Chintala. 2015. Unsupervised representation learning with deep convolutional generative adversarial networks. arXiv preprint arXiv:1511.06434."},{"key":"e_1_2_1_53_1","unstructured":"Alec Radford Karthik Narasimhan Tim Salimans and Ilya Sutskever. 2018. Improving language understanding by generative pre-training. \t\t\t\t  Alec Radford Karthik Narasimhan Tim Salimans and Ilya Sutskever. 2018. Improving language understanding by generative pre-training."},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/2594291.2594321"},{"key":"e_1_2_1_55_1","unstructured":"Shuo Ren Daya Guo Shuai Lu Long Zhou Shujie Liu Duyu Tang Neel Sundaresan Ming Zhou Ambrosio Blanco and Shuai Ma. 2020. Codebleu: a method for automatic evaluation of code synthesis. arXiv preprint arXiv:2009.10297. \t\t\t\t  Shuo Ren Daya Guo Shuai Lu Long Zhou Shujie Liu Duyu Tang Neel Sundaresan Ming Zhou Ambrosio Blanco and Shuai Ma. 2020. Codebleu: a method for automatic evaluation of code synthesis. arXiv preprint arXiv:2009.10297."},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/2786805.2786855"},{"key":"e_1_2_1_57_1","volume-title":"Improved techniques for training gans. Advances in neural information processing systems, 29","author":"Salimans Tim","year":"2016","unstructured":"Tim Salimans , Ian Goodfellow , Wojciech Zaremba , Vicki Cheung , Alec Radford , and Xi Chen . 2016. Improved techniques for training gans. Advances in neural information processing systems, 29 ( 2016 ). Tim Salimans, Ian Goodfellow, Wojciech Zaremba, Vicki Cheung, Alec Radford, and Xi Chen. 2016. Improved techniques for training gans. Advances in neural information processing systems, 29 (2016)."},{"key":"e_1_2_1_58_1","unstructured":"Ensheng Shi Wenchao Gub Yanlin Wang Lun Du Hongyu Zhang Shi Han Dongmei Zhang and Hongbin Sun. 2022. Enhancing Semantic Code Search with Multimodal Contrastive Learning and Soft Data Augmentation. arXiv preprint arXiv:2204.03293. \t\t\t\t  Ensheng Shi Wenchao Gub Yanlin Wang Lun Du Hongyu Zhang Shi Han Dongmei Zhang and Hongbin Sun. 2022. Enhancing Semantic Code Search with Multimodal Contrastive Learning and Soft Data Augmentation. arXiv preprint arXiv:2204.03293."},{"key":"e_1_2_1_59_1","first-page":"537","article-title":"A Survey of Automatic Code Generation from Natural Language","volume":"17","author":"Shin Jiho","year":"2021","unstructured":"Jiho Shin and Jaechang Nam . 2021 . A Survey of Automatic Code Generation from Natural Language . Journal of Information Processing Systems , 17 , 3 (2021), 537 \u2013 555 . Jiho Shin and Jaechang Nam. 2021. A Survey of Automatic Code Generation from Natural Language. Journal of Information Processing Systems, 17, 3 (2021), 537\u2013555.","journal-title":"Journal of Information Processing Systems"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/3387904.3389269"},{"key":"e_1_2_1_61_1","volume-title":"International Conference on Machine Learning. 4790\u20134799","author":"Sun Shao-Hua","year":"2018","unstructured":"Shao-Hua Sun , Hyeonwoo Noh , Sriram Somasundaram , and Joseph Lim . 2018 . Neural program synthesis from diverse demonstration videos . In International Conference on Machine Learning. 4790\u20134799 . Shao-Hua Sun, Hyeonwoo Noh, Sriram Somasundaram, and Joseph Lim. 2018. Neural program synthesis from diverse demonstration videos. In International Conference on Machine Learning. 4790\u20134799."},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/3510003.3510140"},{"key":"e_1_2_1_63_1","volume-title":"Policy gradient methods for reinforcement learning with function approximation. Advances in neural information processing systems, 12","author":"Sutton Richard S","year":"1999","unstructured":"Richard S Sutton , David McAllester , Satinder Singh , and Yishay Mansour . 1999. Policy gradient methods for reinforcement learning with function approximation. Advances in neural information processing systems, 12 ( 1999 ). Richard S Sutton, David McAllester, Satinder Singh, and Yishay Mansour. 1999. Policy gradient methods for reinforcement learning with function approximation. Advances in neural information processing systems, 12 (1999)."},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00165"},{"key":"e_1_2_1_65_1","article-title":"Visualizing data using t-SNE","volume":"9","author":"der Maaten Laurens Van","year":"2008","unstructured":"Laurens Van der Maaten and Geoffrey Hinton . 2008 . Visualizing data using t-SNE .. Journal of machine learning research , 9 , 11 (2008). Laurens Van der Maaten and Geoffrey Hinton. 2008. Visualizing data using t-SNE.. Journal of machine learning research, 9, 11 (2008).","journal-title":"Journal of machine learning research"},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/3485477"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.2019.00012"},{"key":"e_1_2_1_68_1","unstructured":"Chaozheng Wang Junhao Hu Cuiyun Gao Yu Jin Tao Xie Hailiang Huang Zhenyu Lei and Yuetang Deng. 2023. Practitioners\u2019 Expectations on Code Completion. arXiv preprint arXiv:2301.03846. \t\t\t\t  Chaozheng Wang Junhao Hu Cuiyun Gao Yu Jin Tao Xie Hailiang Huang Zhenyu Lei and Yuetang Deng. 2023. Practitioners\u2019 Expectations on Code Completion. arXiv preprint arXiv:2301.03846."},{"key":"e_1_2_1_69_1","volume-title":"Annual Conference of the North American Chapter of the Association for Computational Linguistics.","author":"Wang Hong","year":"2019","unstructured":"Hong Wang , Wenhan Xiong , Mo Yu , Xiaoxiao Guo , Shiyu Chang , and William Yang Wang . 2019 . Sentence embedding alignment for lifelong relation extraction . In Annual Conference of the North American Chapter of the Association for Computational Linguistics. Hong Wang, Wenhan Xiong, Mo Yu, Xiaoxiao Guo, Shiyu Chang, and William Yang Wang. 2019. Sentence embedding alignment for lifelong relation extraction. In Annual Conference of the North American Chapter of the Association for Computational Linguistics."},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.5281\/zenodo.7824776"},{"key":"e_1_2_1_71_1","volume-title":"Proceedings of the 31st ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC\/FSE). https:\/\/doi.org\/10","author":"Wang Shangwen","year":"2023","unstructured":"Shangwen Wang , Mingyang Geng , Bo Lin , Zhensu Sun , Ming Wen , Yepang Liu , Li Li , Tegawend\u00e9 F. Bissyand\u00e9 , and Xiaoguang Mao . 2023 . Natural Language to Code: How Far are We? In Proceedings of the 31st ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC\/FSE). https:\/\/doi.org\/10 .1145\/3611643.3616323 10.1145\/3611643.3616323 Shangwen Wang, Mingyang Geng, Bo Lin, Zhensu Sun, Ming Wen, Yepang Liu, Li Li, Tegawend\u00e9 F. Bissyand\u00e9, and Xiaoguang Mao. 2023. Natural Language to Code: How Far are We? In Proceedings of the 31st ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC\/FSE). https:\/\/doi.org\/10.1145\/3611643.3616323"},{"key":"e_1_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.emnlp-main.685"},{"key":"e_1_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE43902.2021.00025"},{"key":"e_1_2_1_74_1","volume-title":"Proceedings of the 2000 International Conference on Software Engineering. ICSE 2000 the New Millennium. 725\u2013727","author":"Whalen Michael W","year":"2000","unstructured":"Michael W Whalen . 2000 . High-integrity code generation for state-based formalisms . In Proceedings of the 2000 International Conference on Software Engineering. ICSE 2000 the New Millennium. 725\u2013727 . Michael W Whalen. 2000. High-integrity code generation for state-based formalisms. In Proceedings of the 2000 International Conference on Software Engineering. ICSE 2000 the New Millennium. 725\u2013727."},{"key":"e_1_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.2307\/3001968"},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2022.3181070"},{"key":"e_1_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-017-9514-4"},{"key":"e_1_2_1_78_1","first-page":"1","article-title":"In-ide code generation from natural language: Promise and challenges","volume":"31","author":"Xu Frank F","year":"2022","unstructured":"Frank F Xu , Bogdan Vasilescu , and Graham Neubig . 2022 . In-ide code generation from natural language: Promise and challenges . ACM Transactions on Software Engineering and Methodology (TOSEM) , 31 , 2 (2022), 1 \u2013 47 . Frank F Xu, Bogdan Vasilescu, and Graham Neubig. 2022. In-ide code generation from natural language: Promise and challenges. ACM Transactions on Software Engineering and Methodology (TOSEM), 31, 2 (2022), 1\u201347.","journal-title":"ACM Transactions on Software Engineering and Methodology (TOSEM)"},{"key":"e_1_2_1_79_1","volume-title":"Two-Stage Attention-Based Model for Code Search with Textual and Structural Features. In 2021 IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER). 342\u2013353","author":"Xu Ling","year":"2021","unstructured":"Ling Xu , Huanhuan Yang , Chao Liu , Jianhang Shuai , Meng Yan , Yan Lei , and Zhou Xu . 2021 . Two-Stage Attention-Based Model for Code Search with Textual and Structural Features. In 2021 IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER). 342\u2013353 . Ling Xu, Huanhuan Yang, Chao Liu, Jianhang Shuai, Meng Yan, Yan Lei, and Zhou Xu. 2021. Two-Stage Attention-Based Model for Code Search with Textual and Structural Features. In 2021 IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER). 342\u2013353."},{"key":"e_1_2_1_80_1","volume-title":"Jayavardhan Reddy Peddamail, and Huan Sun","author":"Yao Ziyu","year":"2019","unstructured":"Ziyu Yao , Jayavardhan Reddy Peddamail, and Huan Sun . 2019 . Coacor : Code annotation for code retrieval with reinforcement learning. In The world wide web conference. 2203\u20132214. Ziyu Yao, Jayavardhan Reddy Peddamail, and Huan Sun. 2019. Coacor: Code annotation for code retrieval with reinforcement learning. In The world wide web conference. 2203\u20132214."},{"key":"e_1_2_1_81_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P17-1041"},{"key":"e_1_2_1_82_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D18-2002"},{"key":"e_1_2_1_83_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v31i1.10804"},{"key":"e_1_2_1_84_1","doi-asserted-by":"publisher","DOI":"10.1145\/3533767.3534390"},{"key":"e_1_2_1_85_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P19-1426"},{"key":"e_1_2_1_86_1","volume-title":"Proceedings of the ACM on Programming Languages, 6, OOPSLA2","author":"Zhang Yuhao","year":"2022","unstructured":"Yuhao Zhang , Yasharth Bajpai , Priyanshu Gupta , Ameya Ketkar , Miltiadis Allamanis , Titus Barik , Sumit Gulwani , Arjun Radhakrishna , Mohammad Raza , and Gustavo Soares . 2022 . Overwatch: learning patterns in code edit sequences . Proceedings of the ACM on Programming Languages, 6, OOPSLA2 (2022), 395\u2013423. Yuhao Zhang, Yasharth Bajpai, Priyanshu Gupta, Ameya Ketkar, Miltiadis Allamanis, Titus Barik, Sumit Gulwani, Arjun Radhakrishna, Mohammad Raza, and Gustavo Soares. 2022. Overwatch: learning patterns in code edit sequences. Proceedings of the ACM on Programming Languages, 6, OOPSLA2 (2022), 395\u2013423."},{"key":"e_1_2_1_87_1","doi-asserted-by":"crossref","unstructured":"Junchen Zhao Yurun Song Junlin Wang and Ian G Harris. 2022. GAP-Gen: Guided Automatic Python Code Generation. arXiv preprint arXiv:2201.08810. \t\t\t\t  Junchen Zhao Yurun Song Junlin Wang and Ian G Harris. 2022. GAP-Gen: Guided Automatic Python Code Generation. arXiv preprint arXiv:2201.08810.","DOI":"10.18653\/v1\/2023.eacl-srw.4"},{"key":"e_1_2_1_88_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE43902.2021.00074"},{"key":"e_1_2_1_89_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.244"}],"container-title":["Proceedings of the ACM on Programming Languages"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3622815","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3622815","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T12:37:04Z","timestamp":1750163824000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3622815"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,16]]},"references-count":89,"journal-issue":{"issue":"OOPSLA2","published-print":{"date-parts":[[2023,10,16]]}},"alternative-id":["10.1145\/3622815"],"URL":"https:\/\/doi.org\/10.1145\/3622815","relation":{},"ISSN":["2475-1421"],"issn-type":[{"value":"2475-1421","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,10,16]]},"assertion":[{"value":"2023-10-16","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}