{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,7]],"date-time":"2026-03-07T19:48:13Z","timestamp":1772912893799,"version":"3.50.1"},"reference-count":94,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2025,2,23]],"date-time":"2025-02-23T00:00:00Z","timestamp":1740268800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100005145","name":"Basic Research Program of Jiangsu Province","doi-asserted-by":"crossref","award":["BK20201250"],"award-info":[{"award-number":["BK20201250"]}],"id":[{"id":"10.13039\/501100005145","id-type":"DOI","asserted-by":"crossref"}]},{"name":"CCF-Huawei Populus Grove Fund"},{"name":"National Key Research and Development Program of China","award":["2022YFF0711404"],"award-info":[{"award-number":["2022YFF0711404"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Softw. Eng. Methodol."],"published-print":{"date-parts":[[2025,3,31]]},"abstract":"<jats:p>\n            <jats:italic>Background<\/jats:italic>\n            . Code search aims to find the most relevant code snippet in a large codebase based on a given natural language query. An accurate code search engine can increase code reuse and improve programming efficiency. The focus of code search is how to represent the semantic similarity of code and query. With the development of code pre-trained models, the pattern of using numeric feature vectors (embeddings) to represent code semantics and using vector distance to represent semantic similarity has replaced traditional string matching methods. The quality of semantic representations is critical to the effectiveness of downstream tasks such as code search. Currently, the state-of-the-art (SOTA) learning method uses the contrastive learning paradigm. The objective of contrastive learning is to maximize the similarity between matching code and query (positive samples) and minimize the similarity between mismatched pairs (negative samples). To increase the reusing of negative samples, prior contrastive learning approaches use a large queue (memory bank) to store embeddings.\n          <\/jats:p>\n          <jats:p>\n            <jats:italic>Problem<\/jats:italic>\n            . However, there is still a lot of room for improvement in using negative examples for code search: \u2460 Due to the random selection of negative samples, semantic representations learned by existing models cannot distinguish similar codes well. \u2461 Since semantic vectors in the memory bank are reused from previous inference results and then directly used for loss function calculation without gradient descent, the model cannot effectively learn the negative sample semantic information.\n            <jats:italic>Method<\/jats:italic>\n            . To solve the above problems, we propose a contrastive learning code search model with hard negative mining called CoCoHaNeRe: \u2776 To enable the model to distinguish similar codes, we introduce hard negative examples into contrastive training, which are negative examples in the codebase that are most similar to positive examples. As a result, hard negative examples are most likely to make the model make mistakes. \u2777 To improve the learning efficiency of negative samples during training, we add all hard negative examples to the model's gradient descent process.\n            <jats:italic>Result<\/jats:italic>\n            . To verify the effectiveness of CoCoHaNeRe, we conducted experiments on large code search datasets with six programming languages, as well as similar retrieval tasks code clone detection and code question answering. Experimental results show that our model achieves SOTA performance. In the code search task, the average MRR score of CoCoHaNeRe exceeds CodeBERT, GraphCodeBERT, and UniXcoder by 11.25%, 8.13%, and 7.38%, respectively. It has also made great progress in code clone detection and code question answering. In addition, our method performs well in different programming languages and code pre-training models. Furthermore, qualitative analysis shows that our model effectively distinguishes high-order semantic differences between similar codes.\n          <\/jats:p>","DOI":"10.1145\/3695994","type":"journal-article","created":{"date-parts":[[2024,10,11]],"date-time":"2024-10-11T12:50:43Z","timestamp":1728651043000},"page":"1-35","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":4,"title":["Effective Hard Negative Mining for Contrastive Learning-Based Code Search"],"prefix":"10.1145","volume":"34","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3584-9920","authenticated-orcid":false,"given":"Ye","family":"Fan","sequence":"first","affiliation":[{"name":"National Key Laboratory for Novel Software Technology at Nanjing University, Nanjing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9270-5072","authenticated-orcid":false,"given":"Chuanyi","family":"Li","sequence":"additional","affiliation":[{"name":"National Key Laboratory for Novel Software Technology at Nanjing University, Nanjing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1773-0942","authenticated-orcid":false,"given":"Jidong","family":"Ge","sequence":"additional","affiliation":[{"name":"National Key Laboratory for Novel Software Technology at Nanjing University, Nanjing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7790-0195","authenticated-orcid":false,"given":"LiGuo","family":"Huang","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Southern Methodist University, Dallas, TX, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-1102-9584","authenticated-orcid":false,"given":"Bin","family":"Luo","sequence":"additional","affiliation":[{"name":"National Key Laboratory for Novel Software Technology at Nanjing University, Nanjing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2025,2,23]]},"reference":[{"key":"e_1_3_2_2_2","unstructured":"Facebook Website. 2023. https:\/\/www.facebook.com"},{"key":"e_1_3_2_3_2","unstructured":"Github Website. 2023. https:\/\/www.github.com"},{"key":"e_1_3_2_4_2","unstructured":"Our Replication Package. 2023. https:\/\/bitbucket.org\/codeintelli\/cocohanere"},{"key":"e_1_3_2_5_2","unstructured":"StackOverflow Website. 2023. https:\/\/stackoverflow.com\/"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.naacl-main.211"},{"key":"e_1_3_2_7_2","unstructured":"Shushan Arakelyan Anna Hakhverdyan Miltiadis Allamanis Luis Garcia Christophe Hauser and Xiang Ren. 2022. NS3: Neuro-Symbolic Semantic Code Search. Retrieved from http:\/\/papers.nips.cc\/paper_files\/paper\/2022\/hash\/43f5f6c5cb333115914c8448b8506411-Abstract-Conference.html"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1518944"},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1145\/3404835.3462840"},{"key":"e_1_3_2_10_2","unstructured":"Luca Buratti Saurabh Pujar Mihaela A. Bornea J. Scott McCarley Yunhui Zheng Gaetano Rossiello Alessandro Morari Jim Laredo Veronika Thost Yufan Zhuang and Giacomo Domeniconi. 2020. Exploring software naturalness through neural language models. arXiv:2006.12641. Retrieved from https:\/\/arxiv.org\/abs\/2006.12641"},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1145\/3338906.3340458"},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSME.2017.56"},{"key":"e_1_3_2_13_2","volume-title":"Proceedings of the Annual Conference on Neural Information Processing Systems 2020 (NeurIPS \u201920)","author":"Caron Mathilde","year":"2020","unstructured":"Mathilde Caron, Ishan Misra, Julien Mairal, Priya Goyal, Piotr Bojanowski, and Armand Joulin. 2020. Unsupervised learning of visual features by contrasting cluster assignments. In Proceedings of the Annual Conference on Neural Information Processing Systems 2020 (NeurIPS \u201920). Marc\u2019Aurelio Ranzato, Raia Hadsell, Maria-Florina Balcan, and Hsuan-Tien Lin (Eds.), Retrieved from https:\/\/proceedings.neurips.cc\/paper\/2020\/hash\/70feb62b69f16e0238f741fab228fec2-Abstract.html"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1145\/3510003.3510125"},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1145\/2393596.2393606"},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-58577-8_7"},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2021\/317"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.18653\/V1\/N19-1423"},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.5555\/3495724.3495817"},{"key":"e_1_3_2_20_2","unstructured":"Dawn Drain Colin B. Clement Guillermo Serrato and Neel Sundaresan. 2021. DeepDebug: Fixing python bugs using stack traces backtranslation and code skeletons. arXiv:2105.09352. Retrieved from https:\/\/arxiv.org\/abs\/2105.09352"},{"key":"e_1_3_2_21_2","doi-asserted-by":"crossref","unstructured":"Hongchao Fang and Pengtao Xie. 2020. CERT: Contrastive self-supervised learning for language understanding. arXiv:2005.12766. Retrieved from https:\/\/arxiv.org\/abs\/2005.12766","DOI":"10.36227\/techrxiv.12308378.v1"},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.findings-emnlp.139"},{"key":"e_1_3_2_23_2","unstructured":"Luyu Gao Zhuyun Dai Zhen Fan and Jamie Callan. 2020. Complementing lexical retrieval with semantic residual embedding. arXiv:2004.13969. DOI: https:\/\/arxiv.org\/abs\/2004.13969"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.emnlp-main.552"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1145\/3180155.3180167"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2022.acl-long.499"},{"key":"e_1_3_2_27_2","volume-title":"Proceedings of the 9th International Conference on Learning Representations (ICLR \u201921)","author":"Guo Daya","year":"2021","unstructured":"Daya Guo, Shuo Ren, Shuai Lu, Zhangyin Feng, Duyu Tang, Shujie Liu, Long Zhou, Nan Duan, Alexey Svyatkovskiy, Shengyu Fu, Michele Tufano, Shao Kun Deng, Colin B. Clement, Dawn Drain, Neel Sundaresan, Jian Yin, Daxin Jiang, and Ming Zhou. 2021. GraphCodeBERT: Pre-training code representations with data flow. In Proceedings of the 9th International Conference on Learning Representations (ICLR \u201921). OpenReview.net. Retrieved from https:\/\/openreview.net\/forum?id=jLoC4ez43PZ"},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00975"},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2009.5070524"},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSM.2009.5306387"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1145\/3394486.3403305"},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.acl-long.442"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1145\/3447548.3467408"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v38i3.28017"},{"key":"e_1_3_2_35_2","unstructured":"Hamel Husain Ho-Hsiang Wu Tiferet Gazit Miltiadis Allamanis and Marc Brockschmidt. 2019. CodeSearchNet challenge: Evaluating the state of semantic code search. arXiv:1909.09436. Retrieved from http:\/\/arxiv.org\/abs\/1909.09436"},{"key":"e_1_3_2_36_2","first-page":"547","article-title":"\u00c9tude comparative de la distribution florale dans une portion des Alpes et des Jura","volume":"37","author":"Jaccard Paul","year":"1901","unstructured":"Paul Jaccard. 1901. \u00c9tude comparative de la distribution florale dans une portion des Alpes et des Jura. Bulletin de la Societe Vaudoise des Sciences Naturelles 37 (1901), 547\u2013579.","journal-title":"Bulletin de la Societe Vaudoise des Sciences Naturelles"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.emnlp-main.482"},{"key":"e_1_3_2_38_2","doi-asserted-by":"crossref","unstructured":"Ashish Jaiswal Ashwin Ramesh Babu Mohammad Zaki Zadeh Debapriya Banerjee and Fillia Makedon. 2020. A survey on contrastive self-supervised learning. arXiv:2011.00362. Retrieved from https:\/\/arxiv.org\/abs\/2011.00362","DOI":"10.3390\/technologies9010002"},{"key":"e_1_3_2_39_2","first-page":"54","volume-title":"Proceedings of the 37th Conference on Uncertainty in Artificial Intelligence (UAI \u201921)","author":"Jiang Xue","year":"2021","unstructured":"Xue Jiang, Zhuoran Zheng, Chen Lyu, Liang Li, and Lei Lyu. 2021. TreeBERT: A tree-based pre-trained model for programming language. In Proceedings of the 37th Conference on Uncertainty in Artificial Intelligence (UAI \u201921). Cassio P. de Campos, Marloes H. Maathuis, and Erik Quaeghebeur (Eds.), Proceedings of Machine Learning Research, Vol. 161, AUAI Press, 54\u201363. Retrieved from https:\/\/proceedings.mlr.press\/v161\/jiang21a.html"},{"key":"e_1_3_2_40_2","first-page":"5110","volume-title":"Proceedings of the 37th International Conference on Machine Learning (ICML \u201920) Proceedings of Machine Learning Research, Vol. 119","author":"Kanade Aditya","year":"2020","unstructured":"Aditya Kanade, Petros Maniatis, Gogul Balakrishnan, and Kensen Shi. 2020. Learning and evaluating contextual embedding of source code. In Proceedings of the 37th International Conference on Machine Learning (ICML \u201920) Proceedings of Machine Learning Research, Vol. 119, PMLR, 5110\u20135121. Retrieved from http:\/\/proceedings.mlr.press\/v119\/kanade20a.html"},{"key":"e_1_3_2_41_2","unstructured":"Rafael-Michael Karampatsis and Charles Sutton. 2020. SCELMo: Source code embeddings from language models. arXiv:2004.13214. Retrieved from https:\/\/arxiv.org\/abs\/2004.13214"},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.emnlp-main.550"},{"key":"e_1_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.1145\/2568225.2568292"},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.1145\/2597073.2597087"},{"key":"e_1_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.acl-main.703"},{"key":"e_1_3_2_46_2","unstructured":"Xiaonan Li Yeyun Gong Yelong Shen Xipeng Qiu Hang Zhang Bolun Yao Weizhen Qi Daxin Jiang Weizhu Chen and Nan Duan. 2022. CodeRetriever: Unimodal and bimodal contrastive learning. arXiv:2201.10866. Retrieved from https:\/\/arxiv.org\/abs\/2201.10866"},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.1145\/2950290.2950341"},{"key":"e_1_3_2_48_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-58577-8_8"},{"key":"e_1_3_2_49_2","doi-asserted-by":"publisher","DOI":"10.1145\/3324884.3416591"},{"key":"e_1_3_2_50_2","unstructured":"Yinhan Liu Myle Ott Naman Goyal Jingfei Du Mandar Joshi Danqi Chen Omer Levy Mike Lewis Luke Zettlemoyer and Veselin Stoyanov. 2019. RoBERTa: A robustly optimized BERT pretraining approach. arXiv:1907.11692. Retrieved from http:\/\/arxiv.org\/abs\/1907.11692"},{"key":"e_1_3_2_51_2","doi-asserted-by":"publisher","DOI":"10.1109\/SANER.2015.7081874"},{"key":"e_1_3_2_52_2","volume-title":"Proceedings of the Neural Information Processing Systems Track on Datasets and Benchmarks 1, NeurIPS Datasets and Benchmarks 2021","author":"Lu Shuai","year":"2021","unstructured":"Shuai Lu, Daya Guo, Shuo Ren, Junjie Huang, Alexey Svyatkovskiy, Ambrosio Blanco, Colin B. Clement, Dawn Drain, Daxin Jiang, Duyu Tang, Ge Li, Lidong Zhou, Linjun Shou, Long Zhou, Michele Tufano, Ming Gong, Ming Zhou, Nan Duan, Neel Sundaresan, Shao Kun Deng, Shengyu Fu, and Shujie Liu. 2021. CodeXGLUE: A machine learning benchmark dataset for code understanding and generation. In Proceedings of the Neural Information Processing Systems Track on Datasets and Benchmarks 1, NeurIPS Datasets and Benchmarks 2021. Joaquin Vanschoren and Sai-Kit Yeung (Eds.), Retrieved from https:\/\/datasets-benchmarks-proceedings.neurips.cc\/paper\/2021\/hash\/c16a5320fa475530d9583c34fd356ef5-Abstract-round1.html"},{"key":"e_1_3_2_53_2","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.2015.42"},{"key":"e_1_3_2_54_2","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511809071"},{"key":"e_1_3_2_55_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE43902.2021.00041"},{"key":"e_1_3_2_56_2","doi-asserted-by":"publisher","unstructured":"Collin McMillan Mark Grechanik Denys Poshyvanyk Chen Fu and Qing Xie. 2012. Exemplar: A source code search engine for finding highly relevant applications. IEEE Transactions on Software Engineering 38 5 (2012) 1069\u20131087. DOI: 10.1109\/TSE.2011.84","DOI":"10.1109\/TSE.2011.84"},{"key":"e_1_3_2_57_2","doi-asserted-by":"publisher","DOI":"10.1145\/1985793.1985809"},{"key":"e_1_3_2_58_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00674"},{"key":"e_1_3_2_59_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v30i1.10139"},{"key":"e_1_3_2_60_2","doi-asserted-by":"publisher","unstructured":"Arvind Neelakantan Tao Xu Raul Puri Alec Radford Jesse Michael Han Jerry Tworek Qiming Yuan Nikolas Tezak Jong Wook Kim Chris Hallacy et al. 2022. Text and code embeddings by contrastive pre-training. arXiv:2201.10005. Retrieved from 10.48550\/arXiv.2201.10005","DOI":"10.48550\/arXiv.2201.10005"},{"key":"e_1_3_2_61_2","unstructured":"Liming Nie He Jiang Zhilei Ren Zeyi Sun and Xiaochen Li. 2017. Query expansion based on crowd knowledge for code search. arXiv:1703.01443. Retrieved from http:\/\/arxiv.org\/abs\/1703.01443"},{"key":"e_1_3_2_62_2","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2022\/775"},{"key":"e_1_3_2_63_2","doi-asserted-by":"publisher","DOI":"10.1145\/3510003.3510096"},{"key":"e_1_3_2_64_2","doi-asserted-by":"publisher","DOI":"10.1145\/2597073.2597077"},{"key":"e_1_3_2_65_2","doi-asserted-by":"publisher","DOI":"10.1145\/3385412.3386001"},{"key":"e_1_3_2_66_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52729.2023.00673"},{"key":"e_1_3_2_67_2","first-page":"8748","volume-title":"Proceedings of the International Conference on Machine Learning.","author":"Radford Alec","year":"2021","unstructured":"Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al. 2021. Learning transferable visual models from natural language supervision. In Proceedings of the International Conference on Machine Learning. PMLR, 8748\u20138763."},{"issue":"8","key":"e_1_3_2_68_2","first-page":"9","article-title":"Language models are unsupervised multitask learners","volume":"1","author":"Radford Alec","year":"2019","unstructured":"Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. 2019. Language models are unsupervised multitask learners. OpenAI Blog 1, 8 (2019), 9.","journal-title":"OpenAI Blog"},{"key":"e_1_3_2_69_2","first-page":"140:1","article-title":"Exploring the limits of transfer learning with a unified text-to-text transformer","volume":"21","author":"Raffel Colin","year":"2020","unstructured":"Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J. Liu. 2020. Exploring the limits of transfer learning with a unified text-to-text transformer. Journal of Machine Learning Research 21 (2020), 140:1\u2013140:67. Retrieved from http:\/\/jmlr.org\/papers\/v21\/20-074.html","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_3_2_70_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSME.2018.00057"},{"key":"e_1_3_2_71_2","first-page":"1441","volume-title":"Proceedings of the 14th International Conference on Neural Information Processing Systems: Natural and Synthetic (NIPS \u201901)","author":"Richardson Matthew","year":"2001","unstructured":"Matthew Richardson and Pedro M. Domingos. 2001. The Intelligent surfer: Probabilistic combination of link and content information in PageRank. In Proceedings of the 14th International Conference on Neural Information Processing Systems: Natural and Synthetic (NIPS \u201901). Thomas G. Dietterich, Suzanna Becker, and Zoubin Ghahramani (Eds.), MIT Press, 1441\u20131448. Retrieved from https:\/\/proceedings.neurips.cc\/paper\/2001\/hash\/a501bebf79d570651ff601788ea9d16d-Abstract.html"},{"key":"e_1_3_2_72_2","doi-asserted-by":"publisher","unstructured":"Stephen E. Robertson and Karen Sp\u00e4rck Jones. 1976. Relevance weighting of search terms. Journal of the American Society for Information Science 27 3 (1976) 129\u2013146. DOI: 10.1002\/ASI.4630270302","DOI":"10.1002\/ASI.4630270302"},{"key":"e_1_3_2_73_2","doi-asserted-by":"publisher","DOI":"10.1145\/3211346.3211353"},{"key":"e_1_3_2_74_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE48619.2023.00185"},{"key":"e_1_3_2_75_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSME.2014.77"},{"key":"e_1_3_2_76_2","doi-asserted-by":"publisher","DOI":"10.1145\/3368089.3417058"},{"key":"e_1_3_2_77_2","volume-title":"Proceedings of the Annual Conference on Neural Information Processing Systems 2020 (NeurIPS \u201920)","author":"Tian Yonglong","year":"2020","unstructured":"Yonglong Tian, Chen Sun, Ben Poole, Dilip Krishnan, Cordelia Schmid, and Phillip Isola. 2020. What makes for good views for contrastive learning? In Proceedings of the Annual Conference on Neural Information Processing Systems 2020 (NeurIPS \u201920). Hugo Larochelle, Marc\u2019Aurelio Ranzato, Raia Hadsell, Maria-Florina Balcan, and Hsuan-Tien Lin (Eds.), Retrieved from https:\/\/proceedings.neurips.cc\/paper\/2020\/hash\/4c2e5eaae9152079b9e95845750bb9ab-Abstract.html"},{"key":"e_1_3_2_78_2","first-page":"5998","volume-title":"Proceedings of the 31st International Conference on Neural Information Processing Systems (NIPS \u201917)","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In Proceedings of the 31st International Conference on Neural Information Processing Systems (NIPS \u201917). Isabelle Guyon, Ulrike von Luxburg, Samy Bengio, Hanna M. Wallach, Rob Fergus, S. V. N. Vishwanathan, and Roman Garnett (Eds.)., 5998\u20136008. Retrieved from https:\/\/proceedings.neurips.cc\/paper\/2017\/hash\/3f5ee243547dee91fbd053c1c4a845aa-Abstract.html"},{"key":"e_1_3_2_79_2","doi-asserted-by":"publisher","DOI":"10.1109\/SANER48275.2020.9054857"},{"key":"e_1_3_2_80_2","doi-asserted-by":"publisher","unstructured":"Xin Wang Yasheng Wang Fei Mi Pingyi Zhou Yao Wan Xiao Liu Li Li Hao Wu Jin Liu and Xin Jiang. 2021b. Syncobert: Syntax-guided multi-modal contrastive pre-training for code representation. arXiv:2108.04556. Retrieved from 10.48550\/arXiv.2108.04556","DOI":"10.48550\/arXiv.2108.04556"},{"key":"e_1_3_2_81_2","doi-asserted-by":"crossref","unstructured":"Yue Wang Hung Le Akhilesh Gotmare Nghi Bui Junnan Li and Steven Hoi. 2023. CodeT5+: Open code large language models for code understanding and generation. arXiv:2305.07922. Retrieved from https:\/\/arxiv.org\/abs\/2305.07922","DOI":"10.18653\/v1\/2023.emnlp-main.68"},{"key":"e_1_3_2_82_2","first-page":"25","volume-title":"Proceedings of the 26th Annual Conference on Learning Theory (COLT \u201913)","volume":"30","author":"Wang Yining","year":"2013","unstructured":"Yining Wang, Liwei Wang, Yuanzhi Li, Di He, and Tie-Yan Liu. 2013. A theoretical analysis of NDCG type ranking measures. In Proceedings of the 26th Annual Conference on Learning Theory (COLT \u201913). Shai Shalev-Shwartz and Ingo Steinwart (Eds.), JMLR Workshop and Conference Proceedings, Vol. 30, JMLR.org, 25\u201354. Retrieved from http:\/\/proceedings.mlr.press\/v30\/Wang13.html"},{"key":"e_1_3_2_83_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.emnlp-main.685"},{"key":"e_1_3_2_84_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.1984.5010248"},{"key":"e_1_3_2_85_2","doi-asserted-by":"publisher","unstructured":"Jun Xia Lirong Wu Ge Wang Jintao Chen and Stan Z Li. 2021. Progcl: Rethinking hard negative mining in graph contrastive learning. arXiv:2110.02027. Retrieved from 10.48550\/arXiv.2110.02027","DOI":"10.48550\/arXiv.2110.02027"},{"key":"e_1_3_2_86_2","unstructured":"Huang Xie Okko R\u00e4s\u00e4nen and Tuomas Virtanen. 2023. On negative sampling for contrastive audio-text retrieval. arXiv:2211.04070. Retrieved from https:\/\/arxiv.org\/abs\/2211.04070"},{"key":"e_1_3_2_87_2","doi-asserted-by":"publisher","unstructured":"Lee Xiong Chenyan Xiong Ye Li Kwok-Fung Tang Jialin Liu Paul Bennett Junaid Ahmed and Arnold Overwijk. 2020. Approximate nearest neighbor negative contrastive learning for dense text retrieval. arXiv:2007.00808. Retrieved from 10.48550\/arXiv.2007.00808","DOI":"10.48550\/arXiv.2007.00808"},{"key":"e_1_3_2_88_2","doi-asserted-by":"publisher","DOI":"10.1109\/SANER48275.2020.9054840"},{"key":"e_1_3_2_89_2","doi-asserted-by":"publisher","DOI":"10.1145\/3477495.3531937"},{"key":"e_1_3_2_90_2","doi-asserted-by":"publisher","DOI":"10.1145\/3404835.3462880"},{"key":"e_1_3_2_91_2","unstructured":"Jingtao Zhan Jiaxin Mao Yiqun Liu Min Zhang and Shaoping Ma. 2020. RepBERT: Contextualized text embeddings for first-stage retrieval. arXiv:2006.15498. Retrieved from https:\/\/arxiv.org\/abs\/2006.15498"},{"key":"e_1_3_2_92_2","first-page":"8792","volume-title":"Proceedings of the 32nd International Conference on Neural Information Processing Systems 2018 (NeurIPS \u201918)","author":"Zhang Zhilu","year":"2018","unstructured":"Zhilu Zhang and Mert R. Sabuncu. 2018. Generalized cross entropy loss for training deep neural networks with noisy labels. In Proceedings of the 32nd International Conference on Neural Information Processing Systems 2018 (NeurIPS \u201918). Montr\u00e9al, Canada, Samy Bengio, Hanna M. Wallach, Hugo Larochelle, Kristen Grauman, Nicol\u00f2 Cesa-Bianchi, and Roman Garnett (Eds.), 8792\u20138802. Retrieved from https:\/\/proceedings.neurips.cc\/paper\/2018\/hash\/f2925f97bc13ad2852a7a551802feea0-Abstract.html"},{"key":"e_1_3_2_93_2","doi-asserted-by":"publisher","DOI":"10.1145\/2950290.2950298"},{"key":"e_1_3_2_94_2","unstructured":"Ming Zhu Aneesh Jain Karthik Suresh Roshan Ravindran Sindhu Tipirneni and Chandan K. Reddy. 2022. XLCoST: A benchmark dataset for cross-lingual code intelligence. arxiv:2206.08474. Retrieved from https:\/\/arxiv.org\/abs\/2206.08474"},{"key":"e_1_3_2_95_2","doi-asserted-by":"publisher","DOI":"10.1145\/3324884.3416530"}],"container-title":["ACM Transactions on Software Engineering and Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3695994","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3695994","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T00:04:30Z","timestamp":1750291470000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3695994"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,2,23]]},"references-count":94,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2025,3,31]]}},"alternative-id":["10.1145\/3695994"],"URL":"https:\/\/doi.org\/10.1145\/3695994","relation":{},"ISSN":["1049-331X","1557-7392"],"issn-type":[{"value":"1049-331X","type":"print"},{"value":"1557-7392","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,2,23]]},"assertion":[{"value":"2024-01-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-08-12","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-02-23","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}