{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,31]],"date-time":"2026-07-31T22:40:15Z","timestamp":1785537615079,"version":"3.56.0"},"reference-count":225,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2024,12,26]],"date-time":"2024-12-26T00:00:00Z","timestamp":1735171200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.springernature.com\/gp\/researchers\/text-and-data-mining"},{"start":{"date-parts":[[2024,12,26]],"date-time":"2024-12-26T00:00:00Z","timestamp":1735171200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.springernature.com\/gp\/researchers\/text-and-data-mining"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Empir Software Eng"],"published-print":{"date-parts":[[2025,3]]},"DOI":"10.1007\/s10664-024-10602-0","type":"journal-article","created":{"date-parts":[[2024,12,26]],"date-time":"2024-12-26T11:45:04Z","timestamp":1735213504000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":101,"title":["Towards an understanding of large language models in software engineering tasks"],"prefix":"10.1007","volume":"30","author":[{"given":"Zibin","family":"Zheng","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kaiwen","family":"Ning","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Qingyuan","family":"Zhong","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jiachi","family":"Chen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wenqing","family":"Chen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lianghong","family":"Guo","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Weicheng","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yanlin","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,12,26]]},"reference":[{"key":"10602_CR1","unstructured":"Ahmad B, Tan B, Karri R, Pearce H (2023b) Flag: Finding line anomalies (in code) with generative AI. arXiv:2306.12643"},{"key":"10602_CR2","unstructured":"Ahmad B, Thakur S, Tan B, Karri R, Pearce H (2023c) Fixing hardware security bugs with large language models. arXiv:2302.01215"},{"key":"10602_CR3","doi-asserted-by":"crossref","unstructured":"Ahmad A, Waseem M, Liang P, Fehmideh M, Aktar MS, Mikkonen T (2023a) Towards human-bot collaborative software architecting with chatgpt. arXiv:2302.14600","DOI":"10.1145\/3593434.3593468"},{"key":"10602_CR4","doi-asserted-by":"crossref","unstructured":"Ahmed T, Devanbu PT (2022) Few-shot training llms for project-specific code-summarization. In: 37th IEEE\/ACM International conference on automated software engineering, ASE 2022, Rochester, MI, USA, October 10-14, 2022, ACM","DOI":"10.1145\/3551349.3559555"},{"key":"10602_CR5","doi-asserted-by":"crossref","unstructured":"Ahmed T, GHOSH S, Bansal C, Zimmermann T, Zhang X, Rajmohan S (2023) Recommending root-cause and mitigation steps for cloud incidents using large language models. In: ICSE 2023","DOI":"10.1109\/ICSE48619.2023.00149"},{"key":"10602_CR6","doi-asserted-by":"crossref","unstructured":"Ahmed T, Pai KS, Devanbu P, Barr ET (2024) Automatic semantic augmentation of language model prompts (for code summarization). arXiv:2304.06815","DOI":"10.1145\/3597503.3639183"},{"key":"10602_CR7","unstructured":"Ba JL, Kiros JR, Hinton GE (2016) Layer normalization. arXiv:1607.06450"},{"key":"10602_CR8","unstructured":"Barei\u00df P, Souza B, d\u2019Amorim M, Pradel M (2022) Code generation tools (almost) for free? a study of few-shot, pre-trained language models on code. arXiv:2206.01335"},{"key":"10602_CR9","doi-asserted-by":"publisher","unstructured":"Barke S, James MB, Polikarpova N (2023a) Grounded copilot: How programmers interact with code-generating models. OOPSLA1 7, https:\/\/doi.org\/10.1145\/3586030","DOI":"10.1145\/3586030"},{"key":"10602_CR10","doi-asserted-by":"crossref","unstructured":"Barke S, James MB, Polikarpova N (2023b) Grounded copilot: How programmers interact with code-generating models. OOPSLA1 7","DOI":"10.1145\/3586030"},{"key":"10602_CR11","doi-asserted-by":"crossref","unstructured":"Bi Z, Chen J, Jiang Y, Xiong F, Guo W, Chen H, Zhang N (2023) Codekgc: Code language model for generative knowledge graph construction. arXiv:2304.09048","DOI":"10.1145\/3641850"},{"key":"10602_CR12","first-page":"1877","volume":"33","author":"T Brown","year":"2020","unstructured":"Brown T, Mann B, Ryder N, Subbiah M, Kaplan JD, Dhariwal P, Neelakantan A, Shyam P, Sastry G, Askell A et al (2020) Language models are few-shot learners. Adv Neural Inf Process Syst 33:1877\u20131901","journal-title":"Adv Neural Inf Process Syst"},{"key":"10602_CR13","unstructured":"Buscemi A (2023a) A comparative study of code generation using chatgpt 3.5 across 10 programming languages. arXiv:2308.04477"},{"key":"10602_CR14","unstructured":"Buscemi A (2023b) A comparative study of code generation using chatgpt 3.5 across 10 programming languages. arXiv:2308.04477"},{"key":"10602_CR15","unstructured":"Cai Y, Mao S, Wu W, Wang Z, Liang Y, Ge T, Wu C, You W, Song T, Xia Y, Tien J, Duan N (2023) Low-code llm: Visual programming over llms. arXiv:2304.08103"},{"key":"10602_CR16","doi-asserted-by":"publisher","unstructured":"Chai Y, Wang S, Pang C, Sun Y, Tian H, Wu H (2022) Ernie-code: Beyond english-centric cross-lingual pretraining for programming languages. https:\/\/doi.org\/10.48550\/arXiv.2212.06742","DOI":"10.48550\/arXiv.2212.06742"},{"key":"10602_CR17","unstructured":"Chan A, Kharkar A, Moghaddam RZ, Mohylevskyy Y, Helyar A, Kamal E, Elkamhawy M, Sundaresan N (2023) Transformer-based vulnerability detection in code at edittime: Zero-shot, few-shot, or fine-tuning? arXiv:2306.01754"},{"key":"10602_CR18","unstructured":"Charalambous Y, Tihanyi N, Jain R, Sun Y, Ferrag MA, Cordeiro LC (2023) A new era in software security: Towards self-healing software via large language models and formal verification. arXiv:2305.14752"},{"issue":"6","key":"10602_CR19","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s10664-021-10018-0","volume":"26","author":"J Chen","year":"2021","unstructured":"Chen J, Xia X, Lo D, Grundy J, Yang X (2021) Maintenance-related concerns for post-deployed ethereum smart contract development: issues, techniques, and future challenges. Empir Softw Eng 26(6):1\u201344","journal-title":"Empir Softw Eng"},{"key":"10602_CR20","doi-asserted-by":"crossref","unstructured":"Chen Q, Lacomis J, Schwartz EJ, Neubig G, Vasilescu B, Goues CL (2022b) Varclr: variable semantic representation pre-training via contrastive learning. In: Proceedings of the 44th international conference on software engineering, Association for Computing Machinery, ICSE \u201922","DOI":"10.1145\/3510003.3510162"},{"key":"10602_CR21","unstructured":"Chen X, Lin M, Sch\u00e4rli N, Zhou D (2023b) Teaching large language models to self-debug. arXiv:2304.05128"},{"key":"10602_CR22","unstructured":"Chen A, Scheurer J, Korbak T, Campos JA, Chan JS, Bowman SR, Cho K, Perez E (2023a) Improving code generation by training with natural language feedback. arXiv:2303.16749"},{"key":"10602_CR23","unstructured":"Chen B, Zhang F, Nguyen A, Zan D, Lin Z, Lou JG, Chen W (2022a) Codet: Code generation with generated tests. arXiv:2207.10397"},{"key":"10602_CR24","doi-asserted-by":"crossref","unstructured":"Choudhuri R, Liu D, Steinmacher I, Gerosa M, Sarma A (2023) How far are we? the triumphs and trials of generative ai in learning software engineering. arXiv:2312.11719","DOI":"10.1145\/3597503.3639201"},{"key":"10602_CR25","unstructured":"Chowdhery A, Narang S, Devlin J, Bosma M, Mishra G, Roberts A, Barham P, Chung HW, Sutton C, Gehrmann S, et\u00a0al (2022) Palm: Scaling language modeling with pathways. arXiv:2204.02311"},{"key":"10602_CR26","unstructured":"Chung HW, Hou L, Longpre S, Zoph B, Tay Y, Fedus W, Li E, Wang X, Dehghani M, Brahma S, et\u00a0al (2022) Scaling instruction-finetuned language models. arXiv:2210.11416"},{"key":"10602_CR27","doi-asserted-by":"crossref","unstructured":"Ding Y, Steenhoek B, Pei K, Kaiser G, Le W, Ray B (2023) Traced: Execution-aware pre-training for source code. arXiv:2306.07487","DOI":"10.1145\/3597503.3608140"},{"key":"10602_CR28","unstructured":"Dinh T, Zhao J, Tan S, Negrinho R, Lausen L, Zha S, Karypis G (2023) Large language models of code fail at completing code with potential bugs. arXiv:2306.03438"},{"key":"10602_CR29","unstructured":"Dong Y, Jiang X, Jin Z, Li G (2023) Self-collaboration code generation via chatgpt. arXiv:2304.07590"},{"key":"10602_CR30","doi-asserted-by":"crossref","unstructured":"Escamilla E, Salsabil L, Klein M, Wu J, Weigle MC, Nelson ML (2023) It\u2019s not just github: Identifying data and software sources included in publications. arXiv:2307.14469","DOI":"10.1007\/978-3-031-43849-3_17"},{"key":"10602_CR31","doi-asserted-by":"crossref","unstructured":"Fan Z, Gao X, Mirchev M, Roychoudhury A, Tan SH (2023b) Automated repair of programs from large language models. arXiv:2205.10583","DOI":"10.1109\/ICSE48619.2023.00128"},{"key":"10602_CR32","doi-asserted-by":"crossref","unstructured":"Fan L, Li L, Ma Z, Lee S, Yu H, Hemphill L (2023a) A bibliometric review of large language models research from 2017 to 2023. arXiv:2304.02020","DOI":"10.1145\/3664930"},{"key":"10602_CR33","unstructured":"Feiyu (2023) Wechat. https:\/\/tern.cc\/o150R4"},{"key":"10602_CR34","doi-asserted-by":"crossref","unstructured":"Feldt R, Kang S, Yoon J, Yoo S (2023) Towards autonomous testing agents via conversational large language models. arXiv:2306.05152","DOI":"10.1109\/ASE56229.2023.00148"},{"key":"10602_CR35","doi-asserted-by":"crossref","unstructured":"Feng S, Chen C (2023) Prompting is all you need: Automated android bug replay with large language models. arXiv:2306.01987","DOI":"10.1145\/3597503.3608137"},{"key":"10602_CR36","doi-asserted-by":"publisher","unstructured":"Feng S, Ma S, Yu J, Chen C, Zhou T, Zhen Y (2021) Auto-icon: An automated code generation tool for icon designs assisting in UI development. In: Hammond T, Verbert K, Parra D, Knijnenburg BP, O\u2019Donovan J, Teale P (eds) IUI \u201921: 26th International Conference on Intelligent User Interfaces, College Station, TX, USA, April 13-17, 2021, ACM, pp 59\u201369. https:\/\/doi.org\/10.1145\/3397481.3450671","DOI":"10.1145\/3397481.3450671"},{"key":"10602_CR37","doi-asserted-by":"crossref","unstructured":"Feng Y, Vanam S, Cherukupally M, Zheng W, Qiu M, Chen H (2023) Investigating code generation performance of chat-gpt with crowdsourcing social data. In: Proceedings of the 47th IEEE computer software and applications conference, pp 1\u201310","DOI":"10.1109\/COMPSAC57700.2023.00117"},{"issue":"3","key":"10602_CR38","doi-asserted-by":"publisher","first-page":"973","DOI":"10.1109\/TSE.2022.3170087","volume":"49","author":"MA Ferrario","year":"2023","unstructured":"Ferrario MA, Winter E (2023) Applying human values theory to software engineering practice: Lessons and implications. IEEE Trans Softw Eng 49(3):973\u201399. https:\/\/doi.org\/10.1109\/TSE.2022.3170087","journal-title":"IEEE Trans Softw Eng"},{"key":"10602_CR39","unstructured":"gangz (2023) Gitee. https:\/\/gitee.com\/gangz2009\/tetris-by-chat-gpt\/"},{"key":"10602_CR40","doi-asserted-by":"crossref","unstructured":"Gao J, Guo Y, Lim G, Zhang T, Zhang Z, Li TJJ, Perrault ST (2023) Collabcoder: a gpt-powered workflow for collaborative qualitative analysis. arXiv:2304.07366","DOI":"10.1145\/3584931.3607500"},{"key":"10602_CR41","doi-asserted-by":"publisher","unstructured":"Gao Z, Xia X, Lo D, Grundy JC (2022) Technical q &a site answer recommendation via question boosting. https:\/\/doi.org\/10.48550\/arXiv.2210.15846","DOI":"10.48550\/arXiv.2210.15846"},{"key":"10602_CR42","doi-asserted-by":"crossref","unstructured":"Geng M, Wang S, Dong D, Wang H, Li G, Jin Z, Mao X, Liao X (2023) Large language models are few-shot summarizers: multi-intent comment generation via in-context learning. arXiv:2304.11384","DOI":"10.1145\/3597503.3608134"},{"key":"10602_CR43","unstructured":"Gozalo-Brizuela R, Garrido-Merchan EC (2023) Chatgpt is not all you need. a state of the art review of large generative ai models. arXiv:2301.04655"},{"key":"10602_CR44","doi-asserted-by":"crossref","unstructured":"Guo Q, Cao J, Xie X, Liu S, Li X, Chen B, Peng X (2023) Exploring the potential of chatgpt in automated code refinement: An empirical study. arXiv:2309.08221","DOI":"10.1145\/3597503.3623306"},{"key":"10602_CR45","unstructured":"Gupta P, Khare A, Bajpai Y, Chakraborty S, Gulwani S, Kanade A, Radhakrishna A, Soares G, Tiwari A (2023) Grace: generation using associated code edits. arXiv:2305.14129"},{"key":"10602_CR46","doi-asserted-by":"crossref","unstructured":"Hellas A, Leinonen J, Sarsa S, Koutcheme C, Kujanp\u00e4\u00e4 L, Sorva J (2023) Exploring the responses of large language models to beginner programmers\u2019 help requests. arXiv:2306.05715","DOI":"10.1145\/3568813.3600139"},{"key":"10602_CR47","doi-asserted-by":"crossref","unstructured":"Hern\u00e1ndez\u00a0L\u00f3pez JA, Weyssow M, Cuadrado JS, Sahraoui H (2022) Ast-probe: recovering abstract syntax trees from hidden representations of pre-trained language models. In: Proceedings of the 37th IEEE\/ACM international conference on automated software engineering, Association for Computing Machinery, ASE \u201922","DOI":"10.1145\/3551349.3556900"},{"key":"10602_CR48","doi-asserted-by":"crossref","unstructured":"He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770\u2013778","DOI":"10.1109\/CVPR.2016.90"},{"issue":"1","key":"10602_CR49","doi-asserted-by":"publisher","first-page":"211","DOI":"10.1109\/TSE.2022.3148539","volume":"49","author":"M Hoffmann","year":"2023","unstructured":"Hoffmann M, M\u00e9ndez D, Fagerholm F, Luckhardt A (2023) The human side of software engineering teams: An investigation of contemporary challenges. IEEE Trans Softw Eng 49(1):211\u201322. https:\/\/doi.org\/10.1109\/TSE.2022.3148539","journal-title":"IEEE Trans Softw Eng"},{"key":"10602_CR50","unstructured":"Houde S, et\u00a0al. (2022) User and technical perspectives of controllable code generation. In: NeurIPS HCAI workshop"},{"key":"10602_CR51","unstructured":"Huaggingface (2021) Training codeparrot from scratch. https:\/\/huggingface.co\/blog\/codeparrot"},{"key":"10602_CR52","doi-asserted-by":"crossref","unstructured":"Huang J, Chang KCC (2023) Towards reasoning in large language models: a survey. arXiv:2212.10403","DOI":"10.18653\/v1\/2023.findings-acl.67"},{"key":"10602_CR53","doi-asserted-by":"publisher","unstructured":"Hu T, Xu Z, Fang Y, Wu Y, Yuan B, Zou D, Jin H (2023b) Fine-grained code clone detection with block-based splitting of abstract syntax tree. In: Just R, Fraser G (Eds) Proceedings of the 32nd ACM SIGSOFT International symposium on software testing and analysis, ISSTA 2023, Seattle, WA, USA, July 17-21, 2023, ACM, pp 89\u2013100. https:\/\/doi.org\/10.1145\/3597926.3598040,","DOI":"10.1145\/3597926.3598040"},{"key":"10602_CR54","unstructured":"Hu J, Zhang Q, Yin H (2023a) Augmenting greybox fuzzing with generative AI. arXiv:2306.06782"},{"key":"10602_CR55","unstructured":"Jain A, Adiole C, Chaudhuri S, Reps T, Jermaine C (2023) Tuning models of code with compiler-generated reinforcement learning feedback. arXiv:2305.18341"},{"key":"10602_CR56","doi-asserted-by":"publisher","unstructured":"Jain N, Vaidyanath S, Iyer AS, Natarajan N, Parthasarathy S, Rajamani SK, Sharma R (2022b) Jigsaw: large language models meet program synthesis. In: 44th IEEE\/ACM 44th international conference on software engineering, ICSE 2022, Pittsburgh, PA, USA, May 25-27, 2022, ACM, pp 1219\u2013123. https:\/\/doi.org\/10.1145\/3510003.3510203","DOI":"10.1145\/3510003.3510203"},{"key":"10602_CR57","doi-asserted-by":"crossref","unstructured":"Jain N, Vaidyanath S, Iyer A, Natarajan N, Parthasarathy S, Rajamani S, Sharma R (2022a) Jigsaw: large language models meet program synthesis. In: Proceedings of the 44th international conference on software engineering, Association for Computing Machinery, ICSE \u201922","DOI":"10.1145\/3510003.3510203"},{"key":"10602_CR58","doi-asserted-by":"publisher","unstructured":"Jalil S, Rafi S, LaToza TD, Moran K, Lam W (2023) ChatGPT and software testing education: Promises & perils. In: 2023 IEEE international conference on software testing, verification and validation workshops (ICSTW), IEEE. https:\/\/doi.org\/10.1109\/icstw58534.2023.00078","DOI":"10.1109\/icstw58534.2023.00078"},{"key":"10602_CR59","unstructured":"Jiang S, Wang Y, Wang Y (2023a) Selfevolve: A code evolution framework via large language models. arXiv:2306.02907"},{"key":"10602_CR60","doi-asserted-by":"crossref","unstructured":"Jiang Y, Zhang C, He S, Yang Z, Ma M, Qin S, Kang Y, Dang Y, Rajmohan S, Lin Q, Zhang D (2023b) Xpert: empowering incident management with query recommendations via large language models. arXiv:2312.11988","DOI":"10.1145\/3597503.3639081"},{"issue":"3","key":"10602_CR61","doi-asserted-by":"publisher","first-page":"10251","DOI":"10.1016\/j.ipm.2021.102518","volume":"58","author":"N Jing","year":"2021","unstructured":"Jing N, Liu Q, Sugumaran V (2021) A blockchain-based code copyright management system. Inf Process Manag 58(3):10251. https:\/\/doi.org\/10.1016\/j.ipm.2021.102518","journal-title":"Inf Process Manag"},{"key":"10602_CR62","unstructured":"Kande R, Pearce H, Tan B, Dolan-Gavitt B, Thakur S, Karri R, Rajendran J (2023) Llm-assisted generation of hardware assertions. arXiv:2306.14027"},{"key":"10602_CR63","doi-asserted-by":"crossref","unstructured":"Kang S, Yoon J, Yoo S (2022) Large language models are few-shot testers: exploring llm-based general bug reproduction. arXiv:2209.11515","DOI":"10.1109\/ICSE48619.2023.00194"},{"key":"10602_CR64","unstructured":"Kaplan J, McCandlish S, Henighan T, Brown TB, Chess B, Child R, Gray S, Radford A, Wu J, Amodei D (2020) Scaling laws for neural language models. arXiv:2001.08361"},{"key":"10602_CR65","doi-asserted-by":"crossref","unstructured":"Karmakar A, Robbes R (2021) What do pre-trained code models know about code? In: 2021 36th IEEE\/ACM international conference on automated software engineering (ASE)","DOI":"10.1109\/ASE51524.2021.9678927"},{"key":"10602_CR66","unstructured":"Ke L, Sheng H, Cai F, Yunhe Z, Ming L (2023) Discriminating human-authored from chatgpt-generated code via discernable feature analysis. arXiv:2306.14397"},{"key":"10602_CR67","doi-asserted-by":"publisher","unstructured":"Khan JY, Uddin G (2023) Automatic code documentation generation using gpt-3. In: Proceedings of the 37th IEEE\/ACM international conference on automated software engineering, association for computing machinery, New York, NY, USA, AShttps:\/\/doi.org\/10.1145\/3551349.3559548,","DOI":"10.1145\/3551349.3559548"},{"key":"10602_CR68","unstructured":"Khlaaf H, Mishkin P, Achiam J, Krueger G, Brundage M (2022) A hazard analysis framework for code synthesis large language models. arXiv:2207.14157"},{"key":"10602_CR69","doi-asserted-by":"crossref","unstructured":"Khoury R, Avila AR, Brunelle J, Camara BM (2023) How secure is code generated by chatgpt? arXiv:2304.09655","DOI":"10.1109\/SMC53992.2023.10394237"},{"key":"10602_CR70","unstructured":"Kitchenham BA (2007) Kitchenham, b.: Guidelines for performing systematic literature reviews in software engineering. EBSE technical report ebse-2007-01. IEEE Computer society"},{"issue":"12","key":"10602_CR71","doi-asserted-by":"publisher","first-page":"256:1","DOI":"10.1145\/3572905","volume":"55","author":"Z Kotti","year":"2023","unstructured":"Kotti Z, Galanopoulou R, Spinellis D (2023) Machine learning for software engineering: A tertiary study. ACM Comput Surv 55(12):256:1-256:39. https:\/\/doi.org\/10.1145\/3572905","journal-title":"ACM Comput Surv"},{"key":"10602_CR72","unstructured":"Kou B, Chen S, Wang Z, Ma L, Zhang T (2023) Is model attention aligned with human attention? an empirical study on large language models for code generation. arXiv:2306.01220"},{"key":"10602_CR73","unstructured":"Lahiri SK, Naik A, Sakkas G, Choudhury P, von Veh C, Musuvathi M, Inala JP, Wang C, Gao J (2022) Interactive code generation via test-driven user-intent formalization. arXiv:2208.05950"},{"key":"10602_CR74","doi-asserted-by":"publisher","unstructured":"Lanciano G, Stein M, Hilt V, Cucinotta T (2023) Analyzing declarative deployment code with large language models. In: Proceedings of the 13th international conference on cloud computing and services science - CLOSER, INSTICC, SciTePress, pp 289\u201329. https:\/\/doi.org\/10.5220\/0011991200003488","DOI":"10.5220\/0011991200003488"},{"key":"10602_CR75","doi-asserted-by":"publisher","unstructured":"Lee J, Han K, Yu H (2022a) A light bug triage framework for applying large pre-trained language model. In: 37th IEEE\/ACM international conference on automated software engineering, ASE 2022, Rochester, MI, USA, October 10-14, 2022, ACM, pp 3:1\u20133:1. https:\/\/doi.org\/10.1145\/3551349.3556898,","DOI":"10.1145\/3551349.3556898"},{"key":"10602_CR76","doi-asserted-by":"crossref","unstructured":"Lee J, Han K, Yu H (2022b) A light bug triage framework for applying large pre-trained language model. In: Proceedings of the 37th IEEE\/ACM international conference on automated software engineering, Association for Computing Machinery, ASE \u201922","DOI":"10.1145\/3551349.3556898"},{"key":"10602_CR77","doi-asserted-by":"crossref","unstructured":"Lee T, Hong S, Ahn J, Hong I, Lee H, Yun S, Shin J, Kim G (2023) Who wrote this code? watermarking for code generation. arXiv:2305.15060","DOI":"10.18653\/v1\/2024.acl-long.268"},{"key":"10602_CR78","doi-asserted-by":"crossref","unstructured":"Leinonen J, Denny P, MacNeil S, Sarsa S, Bernstein S, Kim J, Tran A, Hellas A (2023a) Comparing code explanations created by students and large language models. arXiv:2304.03938","DOI":"10.1145\/3587102.3588785"},{"key":"10602_CR79","doi-asserted-by":"crossref","unstructured":"Leinonen J, Hellas A, Sarsa S, Reeves B, Denny P, Prather J, Becker BA (2023b) Using large language models to enhance programming error messages. In: Proceedings of the 54th ACM technical symposium on computer science education V. 1, Association for Computing Machinery, New York, NY, USA, SIGCSE 2023, pp 563-569","DOI":"10.1145\/3545945.3569770"},{"key":"10602_CR80","doi-asserted-by":"crossref","unstructured":"Lemieux C, Inala JP, Lahiri S, Sen S (2023) Codamosa: escaping coverage plateaus in test generation with pre-trained large language models. In: ICSE\u201923","DOI":"10.1109\/ICSE48619.2023.00085"},{"key":"10602_CR81","doi-asserted-by":"crossref","unstructured":"Lewis M, Liu Y, Goyal N, Ghazvininejad M, Mohamed A, Levy O, Stoyanov V, Zettlemoyer L (2019) Bart: denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension. arXiv:1910.13461","DOI":"10.18653\/v1\/2020.acl-main.703"},{"key":"10602_CR82","unstructured":"Li TO, Zong W, Wang Y, Tian H, Wang Y, Cheung SC, Kramer J (2023d) Finding failure-inducing test cases with chatgpt. arXiv:2304.11686"},{"key":"10602_CR83","unstructured":"Li XY, Xue JT, Xie Z, Li M (2023e) Think outside the code: brainstorming boosts large language models in code generation. arXiv:2305.10679"},{"key":"10602_CR84","doi-asserted-by":"publisher","unstructured":"Li Y, Choi D, Chung J, Kushman N, Schrittwieser J, Leblond R, Eccles T, Keeling J, Gimeno F, Lago AD, Hubert T, Choy P, de\u00a0Masson\u00a0d\u2019Autume C, Babuschkin I, Chen X, Huang PS, Welbl J, Gowal S, Cherepanov A, Molloy J, Mankowitz DJ, Robson ES, Kohli P, de\u00a0Freitas N, Kavukcuoglu K, Vinyals O (2022c) Competition-level code generation with alphacode. Science 378(6624):1092\u2013109. https:\/\/doi.org\/10.1126\/science.abq1158https:\/\/www.science.org\/doi\/abs\/10.1126\/science.abq1158","DOI":"10.1126\/science.abq1158"},{"key":"10602_CR85","unstructured":"Li B, Fang G, Yang Y, Wang Q, Ye W, Zhao W, Zhang S (2023a) Evaluating chatgpt\u2019s information extraction capabilities: An assessment of performance, explainability, calibration, and faithfulness. arXiv:2304.11633"},{"key":"10602_CR86","unstructured":"Li J, Li G, Li Y, Jin Z (2023b) Enabling programming thinking in large language models toward code generation. arXiv:2305.06599"},{"key":"10602_CR87","doi-asserted-by":"publisher","unstructured":"Li Z, Ma P, Wang H, Wang S, Tang Q, Nie S, Wu S (2022d) Unleashing the power of compiler intermediate representation to enhance neural program embeddings. In: 44th IEEE\/ACM 44th international conference on software engineering, ICSE 2022, Pittsburgh, PA, USA, May 25-27, 2022, ACM, pp 2253\u2013226. https:\/\/doi.org\/10.1145\/3510003.3510217,","DOI":"10.1145\/3510003.3510217"},{"key":"10602_CR88","doi-asserted-by":"crossref","unstructured":"Lin J, Liu Y, Zeng Q, Jiang M, Cleland-Huang J (2021) Traceability transformed: generating more accurate links with pre-trained bert models. In: 2021 IEEE\/ACM 43rd international conference on software engineering (ICSE)","DOI":"10.1109\/ICSE43902.2021.00040"},{"key":"10602_CR89","doi-asserted-by":"publisher","unstructured":"Lin Z, Li G, Zhang J, Deng Y, Zeng X, Zhang Y, Wan Y (2022b) Xcode: towards cross-language code representation with large-scale pre-training. ACM Trans Softw Eng Methodol 31(3). https:\/\/doi.org\/10.1145\/3506696,","DOI":"10.1145\/3506696"},{"key":"10602_CR90","doi-asserted-by":"crossref","unstructured":"Lin T, Wang Y, Liu X, Qiu X (2022a) A survey of transformers. AI Open","DOI":"10.1016\/j.aiopen.2022.10.001"},{"key":"10602_CR91","doi-asserted-by":"crossref","unstructured":"Li P, Sun T, Tang Q, Yan H, Wu Y, Huang X, Qiu X (2023c) Codeie: large code generation models are better few-shot information extractors. arXiv:2305.05711","DOI":"10.18653\/v1\/2023.acl-long.855"},{"key":"10602_CR92","doi-asserted-by":"crossref","unstructured":"Li J, Tang T, Zhao WX, Nie JY, Wen JR (2022a) Pretrained language models for text generation: a survey. arXiv:2201.05273","DOI":"10.24963\/ijcai.2021\/612"},{"key":"10602_CR93","doi-asserted-by":"crossref","unstructured":"Liu MX, Sarkar A, Negreanu C, Zorn B, Williams J, Toronto N, Gordon AD (2023c) \u201cWhat it wants me to say\u201d: bridging the abstraction gap between end-user programmers and code-generating large language models. Association for Computing Machinery, New York, NY, USA, CHI \u201923","DOI":"10.1145\/3544548.3580817"},{"issue":"2","key":"10602_CR94","doi-asserted-by":"publisher","first-page":"1296","DOI":"10.1109\/TKDE.2021.3095196","volume":"35","author":"Z Liu","year":"2023","unstructured":"Liu Z, Qian P, Wang X, Zhuang Y, Qiu L, Wang X (2023) Combining graph neural networks with expert knowledge for smart contract vulnerability detection. IEEE Trans Knowl Data Eng 35(2):1296\u20131310. https:\/\/doi.org\/10.1109\/TKDE.2021.3095196","journal-title":"IEEE Trans Knowl Data Eng"},{"key":"10602_CR95","doi-asserted-by":"crossref","unstructured":"Liu Z, Chen C, Wang J, Chen M, Wu B, Che X, Wang D, Wang Q (2023f) Testing the limits: Unusual text inputs generation for mobile app crash detection with large language model. arXiv:2310.15657","DOI":"10.1145\/3597503.3639118"},{"key":"10602_CR96","doi-asserted-by":"crossref","unstructured":"Liu Y, Han T, Ma S, Zhang J, Yang Y, Tian J, He H, Li A, He M, Liu Z, Wu Z, Zhu D, Li X, Qiang N, Shen D, Liu T, Ge B (2023e) Summary of chatgpt\/gpt-4 research and perspective towards the future of large language models. arXiv:2304.01852","DOI":"10.1016\/j.metrad.2023.100017"},{"key":"10602_CR97","unstructured":"Liu A, Hu X, Wen L, Yu PS (2023a) A comprehensive evaluation of chatgpt\u2019s zero-shot text-to-sql capability. arXiv:2303.13547"},{"key":"10602_CR98","unstructured":"Liu F, Li G, Zhao Y, Jin Z (2021) Multi-task learning based pre-trained language model for code completion. In: Proceedings of the 37th IEEE\/ACM international conference on automated software engineering, Association for Computing Machinery, ASE \u201920"},{"key":"10602_CR99","unstructured":"Liu J, Xia CS, Wang Y, Zhang L (2023b) Is your code generated by chatgpt really correct? rigorous evaluation of large language models for code generation. arXiv:2305.01210"},{"key":"10602_CR100","doi-asserted-by":"crossref","unstructured":"Liu X, Yin D, Zhang C, Feng Y, Zhao D (2023d) The magic of if: investigating causal reasoning abilities in large language models of code. arXiv:2305.19213","DOI":"10.18653\/v1\/2023.findings-acl.574"},{"key":"10602_CR101","doi-asserted-by":"crossref","unstructured":"Li Z, Wang C, Liu Z, Wang H, Chen D, Wang S, Gao C (2023f) Cctest: testing and repairing code completion systems. arXiv:2208.08289","DOI":"10.1109\/ICSE48619.2023.00110"},{"key":"10602_CR102","doi-asserted-by":"crossref","unstructured":"Li Z, Wang C, Ma P, Liu C, Wang S, Wu D, Gao C, Liu Y (2023g) On extracting specialized code abilities from large language models: A feasibility study. arXiv:2303.03012","DOI":"10.1145\/3597503.3639091"},{"key":"10602_CR103","doi-asserted-by":"crossref","unstructured":"Li L, Yang L, Jiang H, Yan J, Luo T, Hua Z, Liang G, Zuo C (2022b) Auger: automatically generating review comments with pre-training models. In: Proceedings of the 30th ACM joint european software engineering conference and symposium on the foundations of software engineering, Association for Computing Machinery, ESEC\/FSE 2022","DOI":"10.1145\/3540250.3549099"},{"key":"10602_CR104","doi-asserted-by":"crossref","unstructured":"Luo X, Xue Y, Xing Z, Sun J (2022) Prcbert: prompt learning for requirement classification using bert-based pretrained language models. In: Proceedings of the 37th IEEE\/ACM international conference on automated software engineering, Association for Computing Machinery, ASE \u201922","DOI":"10.1145\/3551349.3560417"},{"key":"10602_CR105","doi-asserted-by":"crossref","unstructured":"Ma Z, Chen AR, Kim DJ, Chen THP, Wang S (2024a) Llmparser: an exploratory study on using large language models for log parsing. https:\/\/petertsehsun.github.io\/publication\/icse2024-llmparser\/","DOI":"10.1145\/3597503.3639150"},{"key":"10602_CR106","doi-asserted-by":"crossref","unstructured":"Ma Z, Chen AR, Kim DJ, Chen THP, Wang S (2024b) Llmparser: an exploratory study on using large language models for log parsing. https:\/\/petertsehsun.github.io\/publication\/icse2024-llmparser\/","DOI":"10.1145\/3597503.3639150"},{"key":"10602_CR107","doi-asserted-by":"crossref","unstructured":"MacNeil S, Tran A, Hellas A, Kim J, Sarsa S, Denny P, Bernstein S, Leinonen J (2022a) Experiences from using code explanations generated by large language models in a web software development e-book. arXiv:2211.02265","DOI":"10.1145\/3545945.3569785"},{"key":"10602_CR108","doi-asserted-by":"publisher","unstructured":"MacNeil S, Tran A, Leinonen J, Denny P, Kim J, Hellas A, Bernstein S, Sarsa S (2022b) Automatically generating CS learning materials with large language models. In: Proceedings of the 54th ACM technical symposium on computer science education V. 2, ACM. https:\/\/doi.org\/10.1145\/3545947.3569630,","DOI":"10.1145\/3545947.3569630"},{"key":"10602_CR109","doi-asserted-by":"crossref","unstructured":"MacNeil S, Tran A, Mogil D, Bernstein S, Ross E, Huang Z (2022c) Generating diverse code explanations using the gpt-3 large language model. In: Proceedings of the 2022 ACM conference on international computing education research - Volume 2, Association for Computing Machinery, New York, NY, USA","DOI":"10.1145\/3501709.3544280"},{"key":"10602_CR110","unstructured":"Madaan A, Shypula A, Alon U, Hashemi M, Ranganathan P, Yang Y, Neubig G, Yazdanbakhsh A (2023) Learning performance-improving code edits. arXiv:2302.07867"},{"key":"10602_CR111","doi-asserted-by":"crossref","unstructured":"Maddigan P, Susnjak T (2023) Chat2vis: generating data visualisations via natural language using chatgpt, codex and gpt-3 large language models. arXiv:2302.02094","DOI":"10.1109\/ACCESS.2023.3274199"},{"key":"10602_CR112","unstructured":"Ma W, Liu S, Wang W, Hu Q, Liu Y, Zhang C, Nie L, Liu Y (2023) The scope of chatgpt in software engineering: A thorough investigation. arXiv:2305.12138"},{"key":"10602_CR113","doi-asserted-by":"crossref","unstructured":"Manh DN, Hai NL, Dau ATV, Nguyen AM, Nghiem K, Guo J, Bui NDQ (2023) The vault: a comprehensive multilingual dataset for advancing code understanding and generation. arXiv:2305.06156","DOI":"10.18653\/v1\/2023.nlposs-1.25"},{"key":"10602_CR114","doi-asserted-by":"publisher","unstructured":"Maruf AA, Lambaria N, Abdelfattah AS, Cern\u00fd T (2021) Using version control and issue tickets to detect code debt and economical cost. In: 36th IEEE\/ACM international conference on automated software engineering, ASE 2021, Melbourne, Australia, November 15-19, 2021, IEEE, pp 1208\u20131209. https:\/\/doi.org\/10.1109\/ASE51524.2021.9678532,","DOI":"10.1109\/ASE51524.2021.9678532"},{"key":"10602_CR115","doi-asserted-by":"crossref","unstructured":"Mastropaolo A, Scalabrino S, Cooper N, Nader\u00a0Palacio D, Poshyvanyk D, Oliveto R, Bavota G (2021) Studying the usage of text-to-text transfer transformer to support code-related tasks. In: 2021 IEEE\/ACM 43rd international conference on software engineering (ICSE)","DOI":"10.1109\/ICSE43902.2021.00041"},{"key":"10602_CR116","doi-asserted-by":"crossref","unstructured":"Meade N, Poole-Dayan E, Reddy S (2022) An empirical survey of the effectiveness of debiasing techniques for pre-trained language models. arXiv:2110.08527","DOI":"10.18653\/v1\/2022.acl-long.132"},{"key":"10602_CR117","unstructured":"Mialon G, Dess\u00ec R, Lomeli M, Nalmpantis C, Pasunuru R, Raileanu R, Rozi\u00e8re B, Schick T, Dwivedi-Yu J, Celikyilmaz A, Grave E, LeCun Y, Scialom T (2023) Augmented language models: a survey. arXiv:2302.07842"},{"key":"10602_CR118","doi-asserted-by":"publisher","DOI":"10.1145\/3605943","author":"B Min","year":"2023","unstructured":"Min B, Ross H, Sulem E, Veyseh APB, Nguyen TH, Sainz O, Agirre E, Heintz I, Roth D (2023) Recent advances in natural language processing via large pre-trained language models: A survey. ACM Comput Surv. https:\/\/doi.org\/10.1145\/3605943","journal-title":"ACM Comput Surv"},{"key":"10602_CR119","doi-asserted-by":"crossref","unstructured":"Mouselinos S, Malinowski M, Michalewski H (2023) A simple, yet effective approach to finding biases in code generation. arXiv:2211.00609","DOI":"10.18653\/v1\/2023.findings-acl.718"},{"key":"10602_CR120","unstructured":"Murali V, Maddila C, Ahmad I, Bolin M, Cheng D, Ghorbani N, Fernandez R, Nagappan N (2023) Codecompose: a large-scale industrial deployment of ai-assisted code authoring. arXiv:2305.12050"},{"key":"10602_CR121","doi-asserted-by":"crossref","unstructured":"Nguyen S, Nguyen T, Li Y, Wang S (2019) Combining program analysis and statistical language model for code statement completion. In: 2019 34th IEEE\/ACM international conference on automated software engineering (ASE)","DOI":"10.1109\/ASE.2019.00072"},{"key":"10602_CR122","doi-asserted-by":"crossref","unstructured":"Nichols D, Marathe A, Menon H, Gamblin T, Bhatele A (2023) Modeling parallel programs using large language models. arXiv:2306.17281","DOI":"10.23919\/ISC.2024.10528929"},{"key":"10602_CR123","unstructured":"Ni A, Iyer S, Radev D, Stoyanov V, tau Yih W, Wang SI, Lin XV (2023) Lever: learning to verify language-to-code generation with execution. arXiv:2302.08468"},{"key":"10602_CR124","unstructured":"Nijkamp E, Pang B, Hayashi H, Tu L, Wang H, Zhou Y, Savarese S, Xiong C (2023) Codegen: an open large language model for code with multi-turn program synthesis. In: The eleventh international conference on learning representations, ICLR 2023, Kigali, Rwanda, May 1-5, 2023, OpenReview.net. https:\/\/openreview.net\/pdf?id=iaYcJKpY2B_"},{"key":"10602_CR125","doi-asserted-by":"crossref","unstructured":"Niu C, Li C, Ng V, Ge J, Huang L, Luo B (2022) Spt-code: sequence-to-sequence pre-training for learning source code representations. In: Proceedings of the 44th international conference on software engineering, Association for Computing Machinery, ICSE \u201922","DOI":"10.1145\/3510003.3510096"},{"key":"10602_CR126","doi-asserted-by":"crossref","unstructured":"Noever D (2023) Can large language models find and fix vulnerable software? arXiv:2308.10345","DOI":"10.5121\/ijaia.2023.14301"},{"key":"10602_CR127","unstructured":"Olausson TX, Inala JP, Wang C, Gao J, Solar-Lezama A (2023) Demystifying gpt self-repair for code generation. arXiv:2306.09896"},{"key":"10602_CR128","first-page":"27730","volume":"35","author":"L Ouyang","year":"2022","unstructured":"Ouyang L, Wu J, Jiang X, Almeida D, Wainwright C, Mishkin P, Zhang C, Agarwal S, Slama K, Ray A et al (2022) Training language models to follow instructions with human feedback. Adv Neural Inf Process Syst 35:27730\u201327744","journal-title":"Adv Neural Inf Process Syst"},{"issue":"3","key":"10602_CR129","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1109\/MS.2023.3248401","volume":"40","author":"I Ozkaya","year":"2023","unstructured":"Ozkaya I (2023) Application of large language models to software engineering tasks: Opportunities, risks, and implications. IEEE Softw 40(3):4\u20138. https:\/\/doi.org\/10.1109\/MS.2023.3248401","journal-title":"IEEE Softw"},{"key":"10602_CR130","unstructured":"Pan R, Ibrahimzada AR, Krishna R, Sankar D, Wassi LP, Merler M, Sobolev B, Pavuluri R, Sinha S, Jabbarvand R (2023) Understanding the effectiveness of large language models in code translation. arXiv:2308.03109"},{"key":"10602_CR131","doi-asserted-by":"crossref","unstructured":"Pan R, Ibrahimzada A, Krishna R, Sankar D, Wassi L, Merler M, Sobolev B, Pavuluri R, Sinha S, Jabbarvand R (2024) Lost in translation: a study of bugs introduced by large language models while translating code. In: 2024 IEEE\/ACM 46th international conference on software engineering (ICSE)","DOI":"10.1145\/3597503.3639226"},{"key":"10602_CR132","doi-asserted-by":"crossref","unstructured":"Pearce H, Tan B, Ahmad B, Karri R, Dolan-Gavitt B (2022a) Examining zero-shot vulnerability repair with large language models. arXiv:2112.02125","DOI":"10.1109\/SP46215.2023.10179324"},{"key":"10602_CR133","unstructured":"Pearce H, Tan B, Krishnamurthy P, Khorrami F, Karri R, Dolan-Gavitt B (2022b) Pop quiz! can a large language model help with reverse engineering?. arXiv:2202.01142"},{"key":"10602_CR134","unstructured":"Poesia G, Polozov O, Le V, Tiwari A, Soares G, Meek C, Gulwani S (2022) Synchromesh: reliable code generation from pre-trained language models. arXiv:2201.11227"},{"key":"10602_CR135","doi-asserted-by":"publisher","unstructured":"Potluri V, Pandey M, Begel A, Barnett M, Reitherman S (2022) Codewalk: Facilitating shared awareness in mixed-ability collaborative software development. In: Froehlich J, Shinohara K, Ludi S (eds) Proceedings of the 24th international ACM SIGACCESS conference on computers and accessibility, ASSETS 2022, Athens, Greece, October 23-26, 2022, ACM, pp 20:1\u201320:1. https:\/\/doi.org\/10.1145\/3517428.3544812,","DOI":"10.1145\/3517428.3544812"},{"key":"10602_CR136","doi-asserted-by":"crossref","unstructured":"Prenner JA, Babii H, Robbes R (2022) Can openai\u2019s codex fix bugs? an evaluation on quixbugs. In: Proceedings of the third international workshop on automated program repair, Association for Computing Machinery, New York, NY, USA, p 69-75","DOI":"10.1145\/3524459.3527351"},{"issue":"8","key":"10602_CR137","first-page":"9","volume":"1","author":"A Radford","year":"2019","unstructured":"Radford A, Wu J, Child R, Luan D, Amodei D, Sutskever I et al (2019) Language models are unsupervised multitask learners. OpenAI blog 1(8):9","journal-title":"OpenAI blog"},{"key":"10602_CR138","unstructured":"Radford A, Narasimhan K, Salimans T, Sutskever I, et\u00a0al (2018) Improving language understanding by generative pre-training"},{"issue":"1","key":"10602_CR139","first-page":"5485","volume":"21","author":"C Raffel","year":"2020","unstructured":"Raffel C, Shazeer N, Roberts A, Lee K, Narang S, Matena M, Zhou Y, Li W, Liu PJ (2020) Exploring the limits of transfer learning with a unified text-to-text transformer. J Mach Learn Res 21(1):5485\u20135551","journal-title":"J Mach Learn Res"},{"key":"10602_CR140","unstructured":"Rajkumar N, Li R, Bahdanau D (2022) Evaluating the text-to-sql capabilities of large language models. arXiv:2204.00498"},{"issue":"8","key":"10602_CR141","doi-asserted-by":"publisher","first-page":"1026","DOI":"10.1093\/jamia\/ocy045","volume":"25","author":"TJ Reese","year":"2018","unstructured":"Reese TJ, Segall N, Nesbitt P, Fiol GD, Waller R, Macpherson BC, Tonna JE, Wright MC (2018) Patient information organization in the intensive care setting: expert knowledge elicitation with card sorting methods. J Am Med Inform Assoc 25(8):1026\u2013103. https:\/\/doi.org\/10.1093\/jamia\/ocy045","journal-title":"J Am Med Inform Assoc"},{"key":"10602_CR142","doi-asserted-by":"crossref","unstructured":"Ross SI, Martinez F, Houde S, Muller M, Weisz JD (2023) The programmer\u2019s assistant: Conversational interaction with a large language model for software development. In: Proceedings of the 28th international conference on intelligent user interfaces, Association for Computing Machinery, New York, NY, USA, pp 491-514","DOI":"10.1145\/3581641.3584037"},{"key":"10602_CR143","unstructured":"Sadik AR, Ceravola A, Joublin F, Patra J (2023) Analysis of chatgpt on source code. arXiv:2306.00597"},{"key":"10602_CR144","unstructured":"Sandoval G, Pearce H, Nys T, Karri R, Garg S, Dolan-Gavitt B (2023) Lost at c: a user study on the security implications of large language model code assistants. arXiv:2208.09727"},{"key":"10602_CR145","unstructured":"Sanh V, Webson A, Raffel C, Bach SH, Sutawika L, Alyafeai Z, Chaffin A, Stiegler A, Scao TL, Raja A, et\u00a0al. (2021) Multitask prompted training enables zero-shot task generalization. arXiv:2110.08207"},{"key":"10602_CR146","unstructured":"Sarkar A, Gordon AD, Negreanu C, Poelitz C, Ragavan SS, Zorn B (2022) What is it like to program with artificial intelligence? arXiv:2208.06213"},{"key":"10602_CR147","doi-asserted-by":"crossref","unstructured":"Sarsa S, Denny P, Hellas A, Leinonen J (2022) Automatic generation of programming exercises and code explanations using large language models. In: Proceedings of the 2022 ACM conference on international computing education research - Volume 1, Association for Computing Machinery, New York, NY, USA","DOI":"10.1145\/3501385.3543957"},{"key":"10602_CR148","doi-asserted-by":"publisher","unstructured":"Savelka J, Agarwal A, An M, Bogart C, Sakr M (2023) Thrilled by your progress! large language models (GPT-4) no longer struggle to pass assessments in higher education programming courses. https:\/\/doi.org\/10.48550\/arXiv.2306.10073","DOI":"10.48550\/arXiv.2306.10073"},{"key":"10602_CR149","unstructured":"Scao TL, Fan A, Akiki C, Pavlick E, Ili\u0107 S, Hesslow D, Castagn\u00e9 R, Luccioni AS, Yvon F, Gall\u00e9 M, et\u00a0al. (2022) Bloom: a 176b-parameter open-access multilingual language model. arXiv:2211.05100"},{"key":"10602_CR150","unstructured":"Shanahan M (2022) Talking about large language models. arXiv:2212.03551"},{"key":"10602_CR151","unstructured":"Shirafuji A, Watanobe Y, Ito T, Morishita M, Nakamura Y, Oda Y, Suzuki J (2023) Exploring the robustness of large language models for solving programming problems. arXiv:2306.14583"},{"key":"10602_CR152","doi-asserted-by":"crossref","unstructured":"Shi J, Yang Z, Xu B, Kang HJ, Lo D (2022) Compressing pre-trained models of code into 3 mb. In: Proceedings of the 37th IEEE\/ACM international conference on automated software engineering, Association for Computing Machinery, ASE \u201922","DOI":"10.1145\/3551349.3556964"},{"key":"10602_CR153","unstructured":"Shrivastava D, Kocetkov D, de\u00a0Vries H, Bahdanau D, Scholak T (2023a) Repofusion: training code models to understand your repository. arXiv:2306.10998"},{"key":"10602_CR154","unstructured":"Shrivastava D, Larochelle H, Tarlow D (2023b) Repository-level prompt generation for large language models of code. arXiv:2206.12839"},{"key":"10602_CR155","unstructured":"Sridhara G, G RH, Mazumdar S (2023) Chatgpt: a study on its utility for ubiquitous software engineering tasks. arXiv:2305.16837"},{"key":"10602_CR156","unstructured":"Sun W, Fang C, You Y, Miao Y, Liu Y, Li Y, Deng G, Huang S, Chen Y, Zhang Q, Qian H, Liu Y, Chen Z (2023) Automatic code summarization via chatgpt: how far are we? arXiv:2305.12865"},{"key":"10602_CR157","unstructured":"Tanaka T, Emoto N, Yumibayashi T (2023) Inductive-bias learning: generating code models with large language model. arXiv:2308.09890"},{"key":"10602_CR158","unstructured":"Tang R, Chuang YN, Hu X (2023a) The science of detecting llm-generated texts. arXiv:2303.07205"},{"key":"10602_CR159","doi-asserted-by":"crossref","unstructured":"Tang Y, Liu Z, Zhou Z, Luo X (2023b) Chatgpt vs sbst: a comparative assessment of unit test suite generation. arXiv:2307.00588","DOI":"10.1109\/TSE.2024.3382365"},{"key":"10602_CR160","doi-asserted-by":"crossref","unstructured":"Tay Y, Wei J, Chung HW, Tran VQ, So DR, Shakeri S, Garcia X, Zheng HS, Rao J, Chowdhery A, et\u00a0al. (2022) Transcending scaling laws with 0.1% extra compute. arXiv:2210.11399","DOI":"10.18653\/v1\/2023.emnlp-main.91"},{"key":"10602_CR161","doi-asserted-by":"publisher","unstructured":"Thakur S, Ahmad B, Fan Z, Pearce H, Tan B, Karri R, Dolan-Gavitt B, Garg S (2023a) Benchmarking large language models for automated verilog rtl code generation. In: 2023 Design, automation & test in europe conference & Exhibition (DATE), pp 1\u20136. https:\/\/doi.org\/10.23919\/DATE56975.2023.10137086","DOI":"10.23919\/DATE56975.2023.10137086"},{"key":"10602_CR162","doi-asserted-by":"crossref","unstructured":"Thakur S, Ahmad B, Fan Z, Pearce H, Tan B, Karri R, Dolan-Gavitt B, Garg S (2023b) Benchmarking large language models for automated verilog rtl code generation. In: 2023 Design, automation & test in europe conference & exhibition (DATE), pp 1\u20136","DOI":"10.23919\/DATE56975.2023.10137086"},{"key":"10602_CR163","unstructured":"Thoppilan R, Freitas DD, Hall J, Shazeer N, Kulshreshtha A, Others (2022) Lamda: language models for dialog applications. arXiv:2201.08239"},{"key":"10602_CR164","unstructured":"Tian H, et\u00a0al. (2023) Is chatgpt the ultimate programming assistant \u2013 how far is it? arXiv:2304.11938"},{"key":"10602_CR165","unstructured":"Touvron H, Lavril T, Izacard G, Martinet X, Lachaux MA, Lacroix T, Rozi\u00e8re B, Goyal N, Hambro E, Azhar F, et\u00a0al (2023) Llama: open and efficient foundation language models. arXiv:2302.13971"},{"key":"10602_CR166","doi-asserted-by":"crossref","unstructured":"Treude C, Hata H (2023) She elicits requirements and he tests: software engineering gender bias in large language models. arXiv:2303.10131","DOI":"10.1109\/MSR59073.2023.00088"},{"key":"10602_CR167","unstructured":"tse Huang J, Lam MH, Li EJ, Ren S, Wang W, Jiao W, Tu Z, Lyu MR (2023) Emotionally numb or empathetic? evaluating how llms feel using emotionbench. arXiv:2308.03656"},{"key":"10602_CR168","doi-asserted-by":"crossref","unstructured":"Tufano R, Masiero S, Mastropaolo A, Pascarella L, Poshyvanyk D, Bavota G (2022) Using pre-trained models to boost code review automation. In: Proceedings of the 44th international conference on software engineering, association for computing machinery, ICSE \u201922","DOI":"10.1145\/3510003.3510621"},{"key":"10602_CR169","unstructured":"Tu H, Zhou Z, Jiang H, Yusuf INB, Li Y, Jiang L (2023) Llm4cbi: taming llms to generate effective test programs for compiler bug isolation. arXiv:2307.00593"},{"key":"10602_CR170","doi-asserted-by":"crossref","unstructured":"Vaithilingam P, Zhang T, Glassman EL (2022) Expectation vs. experience: evaluating the usability of code generation tools powered by large language models. In: Extended Abstracts of the 2022 CHI conference on human factors in computing systems, Association for Computing Machinery, New York, NY, USA","DOI":"10.1145\/3491101.3519665"},{"key":"10602_CR171","unstructured":"Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser \u0141, Polosukhin I (2017) Attention is all you need. Adv Neural Inf Process Syst 30"},{"issue":"2","key":"10602_CR172","doi-asserted-by":"publisher","first-page":"585","DOI":"10.1109\/TSE.2020.2998503","volume":"48","author":"C Wang","year":"2022","unstructured":"Wang C, Pastore F, Goknil A, Briand LC (2022) Automatic generation of acceptance test cases from use case specifications: An nlp-based approach. IEEE Trans Softw Eng 48(2):585\u2013616. https:\/\/doi.org\/10.1109\/TSE.2020.2998503","journal-title":"IEEE Trans Softw Eng"},{"key":"10602_CR173","unstructured":"Wang H, Gonzalez-Pumariega G, Sharma Y, Choudhury S (2023b) Demo2code: from summarizing demonstrations to synthesizing code via extended chain-of-thought. arXiv:2305.16744"},{"key":"10602_CR174","doi-asserted-by":"crossref","unstructured":"Wang D, Jia Z, Li S, Yu Y, Xiong Y, Dong W, Liao X (2022b) Bridging pre-trained models and downstream tasks for source code understanding. In: Proceedings of the 44th international conference on software engineering, Association for Computing Machinery, ICSE \u201922","DOI":"10.1145\/3510003.3510062"},{"key":"10602_CR175","doi-asserted-by":"crossref","unstructured":"Wang Y, Le H, Gotmare AD, Bui NDQ, Li J, Hoi SCH (2023f) Codet5+: open code large language models for code understanding and generation. arXiv:2305.07922","DOI":"10.18653\/v1\/2023.emnlp-main.68"},{"key":"10602_CR176","doi-asserted-by":"crossref","unstructured":"Wang Y, Le H, Gotmare AD, Bui ND, Li J, Hoi SCH (2023e) Codet5+: open code large language models for code understanding and generation","DOI":"10.18653\/v1\/2023.emnlp-main.68"},{"key":"10602_CR177","doi-asserted-by":"crossref","unstructured":"Wang X, Li S, Ji H (2023d) Code4struct: Code generation for few-shot event structure prediction. arXiv:2210.12810","DOI":"10.18653\/v1\/2023.acl-long.202"},{"key":"10602_CR178","doi-asserted-by":"crossref","unstructured":"Wang Y, Wang W, Joty S, Hoi SC (2021) Codet5: identifier-aware unified pre-trained encoder-decoder models for code understanding and generation. arXiv:2109.00859","DOI":"10.18653\/v1\/2021.emnlp-main.685"},{"key":"10602_CR179","doi-asserted-by":"crossref","unstructured":"Wang B, Xie Q, Pei J, Chen Z, Tiwari P, Li Z, fu J (2023a) Pre-trained language models in biomedical domain: A systematic survey. arXiv:2110.05006","DOI":"10.1145\/3611651"},{"key":"10602_CR180","unstructured":"Wang L, Yang W, Chen D, Zhou H, Lin Y, Meng F, Zhou J, Sun X (2023) Towards codable text watermarking for large language models. arXiv:3071.5992"},{"key":"10602_CR181","doi-asserted-by":"crossref","unstructured":"Wan Y, Zhao W, Zhang H, Sui Y, Xu G, Jin H (2022) What do they capture? a structural analysis of pre-trained language models for source code. In: Proceedings of the 44th international conference on software engineering, Association for Computing Machinery, ICSE \u201922","DOI":"10.1145\/3510003.3510050"},{"issue":"2","key":"10602_CR182","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3485275","volume":"31","author":"C Watson","year":"2022","unstructured":"Watson C, Cooper N, Palacio DN, Moran K, Poshyvanyk D (2022) A systematic literature review on the use of deep learning in software engineering research. ACM Trans Softw Eng Methodol (TOSEM) 31(2):1\u201358","journal-title":"ACM Trans Softw Eng Methodol (TOSEM)"},{"key":"10602_CR183","unstructured":"Wei J, Bosma M, Zhao VY, Guu K, Yu AW, Lester B, Du N, Dai AM, Le QV (2021) Finetuned language models are zero-shot learners. arXiv:2109.01652"},{"key":"10602_CR184","unstructured":"Wei J, Tay Y, Bommasani R, Raffel C, Zoph B, Borgeaud S, Yogatama D, Bosma M, Zhou D, Metzler D, et\u00a0al. (2022) Emergent abilities of large language models. arXiv:2206.07682"},{"key":"10602_CR185","doi-asserted-by":"crossref","unstructured":"Wei C, Wang YC, Wang B, Kuo CCJ (2023) An overview on language models: recent developments and outlook. arXiv:2303.05759","DOI":"10.1561\/116.00000010"},{"key":"10602_CR186","unstructured":"Welleck S, Kulikov I, Roller S, Dinan E, Cho K, Weston J (2020) Neural text generation with unlikelihood training. In: 8th International conference on learning representations, ICLR, OpenReview.net"},{"key":"10602_CR187","unstructured":"Weyssow M, Zhou X, Kim K, Lo D, Sahraoui H (2023) Exploring parameter-efficient fine-tuning techniques for code generation with large language models. arXiv:2308.10462"},{"key":"10602_CR188","unstructured":"White J, Fu Q, Hays S, Sandborn M, Olea C, Gilbert H, Elnashar A, Spencer-Smith J, Schmidt DC (2023a) A prompt pattern catalog to enhance prompt engineering with chatgpt. arXiv:2302.11382"},{"key":"10602_CR189","doi-asserted-by":"crossref","unstructured":"White J, Hays S, Fu Q, Spencer-Smith J, Schmidt DC (2023b) Chatgpt prompt patterns for improving code quality, refactoring, requirements elicitation, and software design. arXiv:2303.07839","DOI":"10.1007\/978-3-031-55642-5_4"},{"issue":"6","key":"10602_CR190","doi-asserted-by":"publisher","first-page":"88","DOI":"10.3390\/e25060888","volume":"25","author":"MF Wong","year":"2023","unstructured":"Wong MF, Guo S, Hang CN, Ho SW, Tan CW (2023) Natural language generation and understanding of big code for AI-assisted programming: A review. Entropy 25(6):88. https:\/\/doi.org\/10.3390\/e25060888","journal-title":"Entropy"},{"key":"10602_CR191","doi-asserted-by":"crossref","unstructured":"Wu L, Zheng Z, Qiu Z, Wang H, Gu H, Shen T, Qin C, Zhu C, Zhu H, Liu Q, Xiong H, Chen E (2023) A survey on large language models for recommendation. arXiv:2305.19860","DOI":"10.1007\/s11280-024-01291-2"},{"key":"10602_CR192","unstructured":"Xia CS, Wei Y, Zhang L (2022) Practical program repair in the era of large pre-trained language models. arXiv:2210.14179"},{"key":"10602_CR193","unstructured":"Xia CS, Zhang L (2023a) Conversational automated program repair. arXiv:2301.13246"},{"key":"10602_CR194","doi-asserted-by":"crossref","unstructured":"Xia CS, Zhang L (2023b) Keep the conversation going: Fixing 162 out of 337 bugs for \\$0.42 each using chatgpt. arXiv:2304.00385","DOI":"10.1145\/3650212.3680323"},{"key":"10602_CR195","doi-asserted-by":"publisher","unstructured":"Xiao Z, Yuan X, Liao QV, Abdelghani R, Oudeyer PY (2023) Supporting qualitative analysis with large language models: Combining codebook with GPT-3 for deductive coding. In: 28th International conference on intelligent user interfaces, ACM. https:\/\/doi.org\/10.1145\/3581754.3584136,","DOI":"10.1145\/3581754.3584136"},{"key":"10602_CR196","doi-asserted-by":"crossref","unstructured":"Xing Z, Huang Q, Cheng Y, Zhu L, Lu Q, Xu X (2023) Prompt sapper: Llm-empowered software engineering infrastructure for ai-native services. arXiv:2306.02230","DOI":"10.36227\/techrxiv.23298488.v1"},{"key":"10602_CR197","doi-asserted-by":"crossref","unstructured":"Xu J, Cui Z, Zhao Y, Zhang X, He S, He P, Li L, Kang Y, Lin Q, Dang Y, Rajmohan S, Zhang D (2024a) Unilog: automatic logging via llm and in-context learning. In: 2024 IEEE\/ACM 46th international conference on software engineering (ICSE)","DOI":"10.1145\/3597503.3623326"},{"key":"10602_CR198","doi-asserted-by":"publisher","unstructured":"Xu C, McAuley J (2023) A survey on model compression and acceleration for pretrained language models. Proc AAAI Conf Artif Intell 37(9):10566\u20131057. https:\/\/doi.org\/10.1609\/aaai.v37i9.26255https:\/\/ojs.aaai.org\/index.php\/AAAI\/article\/view\/26255","DOI":"10.1609\/aaai.v37i9.26255"},{"key":"10602_CR199","doi-asserted-by":"publisher","unstructured":"Xu B, Xing Z, Xia X, Lo D (2017) Answerbot: automated generation of answer summary to developers\u017a technical questions. In: Rosu G, Penta MD, Nguyen TN (Eds) Proceedings of the 32nd IEEE\/ACM international conference on automated software engineering, ASE 2017, Urbana, IL, USA, October 30 - November 03, 2017, IEEE Computer Society, pp 706\u2013716,https:\/\/doi.org\/10.1109\/ASE.2017.8115681","DOI":"10.1109\/ASE.2017.8115681"},{"key":"10602_CR200","doi-asserted-by":"crossref","unstructured":"Xu J, Yang R, Huo Y, Zhang C, He P (2024b) Divlog: log parsing with prompt enhanced in-context learning. In: 2024 IEEE\/ACM 46th international conference on software engineering (ICSE), IEEE Computer Society","DOI":"10.1145\/3597503.3639155"},{"key":"10602_CR201","unstructured":"Xu X, Zhang Z, Feng S, Ye Y, Su Z, Jiang N, Cheng S, Tan L, Zhang X (2023) Lmpa: Improving decompilation by synergy of large language model and program analysis. arXiv:2306.02546"},{"key":"10602_CR202","doi-asserted-by":"crossref","unstructured":"Yang AZH, Martins R, Goues CL, Hellendoorn VJ (2023a) Large language models for test-free fault localization. arXiv:2310.01726","DOI":"10.1145\/3597503.3623342"},{"key":"10602_CR203","unstructured":"Yang J, Prabhakar A, Narasimhan K, Yao S (2023b) Intercode: standardizing and benchmarking interactive coding with execution feedback. arXiv:2306.14898"},{"key":"10602_CR204","doi-asserted-by":"crossref","unstructured":"Yang Z, Shi J, He J, Lo D (2022) Natural attack for pre-trained models of code. In: Proceedings of the 44th international conference on software engineering, Association for Computing Machinery, ICSE \u201922","DOI":"10.1145\/3510003.3510146"},{"key":"10602_CR205","unstructured":"Yang Z, Zhao Z, Wang C, Shi J, Kim D, Han D, Lo D (2023c) Unveiling memorization in code models. https:\/\/api.semanticscholar.org\/CorpusID:261048934"},{"key":"10602_CR206","doi-asserted-by":"crossref","unstructured":"Yuan Z, Lou Y, Liu M, Ding S, Wang K, Chen Y, Peng X (2023) No more manual tests? evaluating and improving chatgpt for unit test generation. arXiv:2305.04207","DOI":"10.1145\/3660783"},{"key":"10602_CR207","doi-asserted-by":"crossref","unstructured":"Zamfirescu-Pereira J, Wong RY, Hartmann B, Yang Q (2023) Why johnny can\u2019t prompt: How non-ai experts try (and fail) to design llm prompts. In: Proceedings of the 2023 CHI conference on human factors in computing systems, Association for Computing Machinery, New York, NY, USA","DOI":"10.1145\/3544548.3581388"},{"key":"10602_CR208","doi-asserted-by":"crossref","unstructured":"Zan D, Chen B, Zhang F, Lu D, Wu B, Guan B, Wang Y, Lou JG (2023) Large language models meet nl2code: a survey. arXiv:2212.09420","DOI":"10.18653\/v1\/2023.acl-long.411"},{"key":"10602_CR209","doi-asserted-by":"publisher","DOI":"10.1145\/3533767.3534390","volume-title":"An extensive study on pre-trained models for program understanding and generation","author":"Z Zeng","year":"2022","unstructured":"Zeng Z, Tan H, Zhang H, Li J, Zhang Y, Zhang L (2022b) An extensive study on pre-trained models for program understanding and generation. Association for Computing Machinery, ISSTA"},{"key":"10602_CR210","unstructured":"Zeng A, Liu X, Du Z, Wang Z, Lai H, Ding M, Yang Z, Xu Y, Zheng W, Xia X, et\u00a0al (2022a) Glm-130b: an open bilingual pre-trained model. arXiv:2210.02414"},{"issue":"4","key":"10602_CR211","doi-asserted-by":"publisher","first-page":"1185","DOI":"10.1109\/TSE.2020.3016006","volume":"48","author":"N Zhang","year":"2022","unstructured":"Zhang N, Huang Q, Xia X, Zou Y, Lo D, Xing Z (2022) Chatbot4qr: Interactive query refinement for technical question retrieval. IEEE Trans Softw Eng 48(4):1185\u2013121. https:\/\/doi.org\/10.1109\/TSE.2020.3016006","journal-title":"IEEE Trans Softw Eng"},{"key":"10602_CR212","doi-asserted-by":"publisher","DOI":"10.1145\/3533767.3534396","volume-title":"Using pre-trained language models to resolve textual and semantic merge conflicts (experience paper)","author":"J Zhang","year":"2022","unstructured":"Zhang J, Mytkowicz T, Kaufman M, Piskac R, Lahiri SK (2022a) Using pre-trained language models to resolve textual and semantic merge conflicts (experience paper). Association for Computing Machinery, ISSTA"},{"key":"10602_CR213","doi-asserted-by":"crossref","unstructured":"Zhang R, Cahyawijaya S, Cruz JCB, Aji AF (2023c) Multilingual large language models are not (yet) code-switchers. arXiv:2305.14235","DOI":"10.18653\/v1\/2023.emnlp-main.774"},{"key":"10602_CR214","doi-asserted-by":"crossref","unstructured":"Zhang K, Li Z, Li J, Li G, Jin Z (2023a) Self-edit: fault-aware code editor for code generation. arXiv:2305.04087","DOI":"10.18653\/v1\/2023.acl-long.45"},{"key":"10602_CR215","unstructured":"Zhang S, Roller S, Goyal N, Artetxe M, Chen M, Chen S, Dewan C, Diab M, Li X, Lin XV, et\u00a0al (2022c) Opt: open pre-trained transformer language models. arXiv:2205.01068"},{"key":"10602_CR216","unstructured":"Zhang K, Wang D, Xia J, Wang WY, Li L (2023b) Algo: synthesizing algorithmic programs with generated oracle verifiers. arXiv:2305.14591"},{"key":"10602_CR217","doi-asserted-by":"publisher","unstructured":"Zhang Y, Zhang W, Ran D, Zhu Q, Dou C, Hao D, Xie T, Zhang L (2024) Learning-based widget matching for migrating gui test cases. In: Proceedings of the 46th IEEE\/ACM international conference on software engineering, ACM, ICSE \u201924. https:\/\/doi.org\/10.1145\/3597503.3623322","DOI":"10.1145\/3597503.3623322"},{"key":"10602_CR218","doi-asserted-by":"crossref","unstructured":"Zhang Z, Zhang H, Shen B, Gu X (2022d) Diet code is healthy: simplifying programs for pre-trained models of code. In: Proceedings of the 30th ACM joint european software engineering conference and symposium on the foundations of software engineering, Association for Computing Machinery, ESEC\/FSE 2022","DOI":"10.1145\/3540250.3549094"},{"key":"10602_CR219","unstructured":"Zhao WX, Zhou K, Li J, Tang T, Wang X, Hou Y, Min Y, Zhang B, Zhang J, Dong Z, et\u00a0al (2023b) A survey of large language models. arXiv:2303.18223"},{"key":"10602_CR220","doi-asserted-by":"crossref","unstructured":"Zhao J, Rong Y, Guo Y, He Y, Chen H (2023a) Understanding programs by exploiting (fuzzing) test cases. arXiv:2305.13592","DOI":"10.18653\/v1\/2023.findings-acl.678"},{"key":"10602_CR221","doi-asserted-by":"publisher","unstructured":"Zheng Q, Xia X, Zou X, Dong Y, Wang S, Xue Y, Wang Z, Shen L, Wang A, Li Y, Su T, Yang Z, Tang J (2023) Codegeex: a pre-trained model for code generation with multilingual evaluations on humaneval-x. https:\/\/doi.org\/10.48550\/arXiv.2303.17568,","DOI":"10.48550\/arXiv.2303.17568"},{"key":"10602_CR222","unstructured":"Zhong L, Wang Z (2023) A study on robustness and reliability of large language model code generation. arXiv:2308.10335"},{"key":"10602_CR223","doi-asserted-by":"crossref","unstructured":"Zhuo TY, Li Z, Huang Y, Shiri F, Wang W, Haffari G, Li YF (2023) On robustness of prompt-based semantic parsing with large pre-trained language model: An empirical study on codex. In: Proceedings of the 17th conference of the european chapter of the association for computational linguistics, Association for Computational Linguistics, Dubrovnik, Croatia, pp 1090\u20131102","DOI":"10.18653\/v1\/2023.eacl-main.77"},{"key":"10602_CR224","unstructured":"Zhuo TY (2023) Large language models are state-of-the-art evaluators of code generation. arXiv:2304.14317"},{"key":"10602_CR225","doi-asserted-by":"publisher","unstructured":"Zhu R, Zhang C (2023) How robust is a large pre-trained language model for code generationf a case on attacking gpt2. In: 2023 IEEE international conference on software analysis, evolution and reengineering (SANER), pp 708\u2013712. https:\/\/doi.org\/10.1109\/SANER56733.2023.00076","DOI":"10.1109\/SANER56733.2023.00076"}],"container-title":["Empirical Software Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-024-10602-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10664-024-10602-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-024-10602-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,5,2]],"date-time":"2025-05-02T13:48:38Z","timestamp":1746193718000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10664-024-10602-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,12,26]]},"references-count":225,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2025,3]]}},"alternative-id":["10602"],"URL":"https:\/\/doi.org\/10.1007\/s10664-024-10602-0","relation":{},"ISSN":["1382-3256","1573-7616"],"issn-type":[{"value":"1382-3256","type":"print"},{"value":"1573-7616","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,12,26]]},"assertion":[{"value":"3 December 2024","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"26 December 2024","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declared that they have no conflict of interest exits in the submission of this manuscript, and manuscript is approved by all authors for publication. I would like to declare on behalf of my co-authors that the work described was original research that has not been published previously and is not under consideration for publication elsewhere. All the authors listed have approved the manuscript. We declare that we do not have any commercial or associative interest that represents a conflict of interest in connection with the work submitted.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflicts of Interest"}}],"article-number":"50"}}