{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,10]],"date-time":"2026-07-10T12:16:55Z","timestamp":1783685815127,"version":"3.55.0"},"reference-count":74,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2026,3,30]],"date-time":"2026-03-30T00:00:00Z","timestamp":1774828800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,3,30]],"date-time":"2026-03-30T00:00:00Z","timestamp":1774828800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100004252","name":"Qatar University","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100004252","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Cluster Comput"],"published-print":{"date-parts":[[2026,5]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Test case generation is a time-consuming and labor-intensive task vital to ensuring software reliability. Automating this process is critical for increasing efficiency and reducing potential human errors in test case generation. This study systematically examined the applications and motivations of Large Language Models (LLMs) in test case generation. The Systematic Literature Review (SLR) method was chosen to identify gaps in the existing literature and comprehensively evaluate the impact of LLMs in this field. 38 peer-reviewed articles published between 2020 and 2025 in databases such as Science Direct, IEEE Xplore, ACM Digital Library, and SpringerLink, addressing the use of LLMs in test case generation, were systematically analyzed. The review evaluated the datasets used, LLM training and test generation techniques, targeted programming languages, preprocessing and postprocessing methods, and integration strategies with existing software workflows. The findings highlight the ability of LLMs to increase the speed and coverage of test case generation in test automation, highlight challenges such as dataset quality and integration complexities, and suggest potential solutions to address these issues. This review provides an important resource for researchers using LLMs in automated test generation, providing insights into their capabilities and encouraging further research in this area.<\/jats:p>","DOI":"10.1007\/s10586-026-06021-z","type":"journal-article","created":{"date-parts":[[2026,3,30]],"date-time":"2026-03-30T20:36:12Z","timestamp":1774902972000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Test case generation using large language models: a systematic literature review"],"prefix":"10.1007","volume":"29","author":[{"given":"Murat","family":"Tasarsu","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ahmet Vedat","family":"Tokmak","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Cagatay","family":"Catal","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2026,3,30]]},"reference":[{"issue":"5","key":"6021_CR1","doi-asserted-by":"publisher","first-page":"98","DOI":"10.1109\/MS.1996.536464","volume":"13","author":"B Beizer","year":"1996","unstructured":"Beizer, B., Wiley, J.: Black box testing: Techniques for functional testing of software and systems. IEEE Softw. 13(5), 98 (1996). https:\/\/doi.org\/10.1109\/MS.1996.536464","journal-title":"IEEE Softw."},{"key":"6021_CR2","volume-title":"The Art of Software Testing","author":"GJ Myers","year":"2011","unstructured":"Myers, G.J., Sandler, C., Badgett, T.: The Art of Software Testing. John Wiley & Sons, Hoboken, NJ (2011)"},{"key":"6021_CR3","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2021.115446","volume":"183","author":"M Esnaashari","year":"2021","unstructured":"Esnaashari, M., Damia, A.H.: Automation of software test data generation using genetic algorithm and reinforcement learning. Expert Syst. Appl. 183, 115446 (2021). https:\/\/doi.org\/10.1016\/j.eswa.2021.115446","journal-title":"Expert Syst. Appl."},{"issue":"2","key":"6021_CR4","doi-asserted-by":"publisher","first-page":"105","DOI":"10.1002\/stvr.294","volume":"14","author":"P McMinn","year":"2004","unstructured":"McMinn, P.: Search-based software test data generation: a survey: Research articles. Softw. Test. Verif. Reliab. 14(2), 105\u2013156 (2004)","journal-title":"Softw. Test. Verif. Reliab."},{"issue":"5","key":"6021_CR5","doi-asserted-by":"publisher","first-page":"297","DOI":"10.1002\/stvr.456","volume":"22","author":"M Utting","year":"2012","unstructured":"Utting, M., Pretschner, A., Legeard, B.: A taxonomy of model-based testing approaches. Software testing, verification and reliability 22(5), 297\u2013312 (2012)","journal-title":"Software testing, verification and reliability"},{"key":"6021_CR6","doi-asserted-by":"crossref","unstructured":"McMinn, P.: Search-based software testing: Past, present and future. In: 2011 IEEE Fourth International Conference on Software Testing, Verification and Validation Workshops, pp. 153\u2013163 (2011). IEEE","DOI":"10.1109\/ICSTW.2011.100"},{"issue":"3","key":"6021_CR7","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3182657","volume":"51","author":"R Baldoni","year":"2018","unstructured":"Baldoni, R., Coppa, E., D\u2019elia, D.C., Demetrescu, C., Finocchi, I.: A survey of symbolic execution techniques. ACM Computing Surveys (CSUR) 51(3), 1\u201339 (2018)","journal-title":"ACM Computing Surveys (CSUR)"},{"key":"6021_CR8","doi-asserted-by":"crossref","unstructured":"Ribeiro, M.T., Singh, S., Guestrin, C.: \"why should i trust you?\": Explaining the predictions of any classifier. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. KDD \u201916, pp. 1135\u20131144. Association for Computing Machinery, New York, NY, USA (2016). DOI: 10.1145\/2939672.2939778","DOI":"10.1145\/2939672.2939778"},{"key":"6021_CR9","doi-asserted-by":"crossref","unstructured":"Tian, Y., Pei, K., Jana, S., Ray, B.: Deeptest: automated testing of deep-neural-network-driven autonomous cars. In: Proceedings of the 40th International Conference on Software Engineering. ICSE \u201918, pp. 303\u2013314. Association for Computing Machinery, New York, NY, USA (2018). DOI: 10.1145\/3180155.3180220","DOI":"10.1145\/3180155.3180220"},{"key":"6021_CR10","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., Polosukhin, I.: Attention is all you need. In: Proceedings of the 31st International Conference on Neural Information Processing Systems. NIPS\u201917, pp. 6000\u20136010. Curran Associates Inc., Red Hook, NY, USA (2017)"},{"key":"6021_CR11","unstructured":"Brown, T.B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., Agarwal, S., Herbert-Voss, A., Krueger, G., Henighan, T., Child, R., Ramesh, A., Ziegler, D.M., Wu, J., Winter, C., Hesse, C., Chen, M., Sigler, E., Litwin, M., Gray, S., Chess, B., Clark, J., Berner, C., McCandlish, S., Radford, A., Sutskever, I., Amodei, D.: Language models are few-shot learners. In: Proceedings of the 34th International Conference on Neural Information Processing Systems. NIPS \u201920. Curran Associates Inc., Red Hook, NY, USA (2020)"},{"key":"6021_CR12","unstructured":"Malfa, E.L., Weinhuber, C., Torre, O., Lin, F., Marro, S., Cohn, A., Shadbolt, N., Wooldridge, M.: Code Simulation Challenges for Large Language Models (2024). https:\/\/arxiv.org\/abs\/2401.09074"},{"key":"6021_CR13","unstructured":"Chen, M., Tworek, J., Jun, H., Yuan, Q., Pinto, H.P.D.O., Kaplan, J., Edwards, H., Burda, Y., Joseph, N., Brockman, G., et al.: Evaluating large language models trained on code. arXiv preprint arXiv:2107.03374 (2021)"},{"key":"6021_CR14","unstructured":"Allamanis, M., Brockschmidt, M., Khademi, M.: Learning to represent programs with graphs. In: International Conference on Learning Representations (2018). https:\/\/openreview.net\/forum?id=BJOFETxR-"},{"key":"6021_CR15","doi-asserted-by":"crossref","unstructured":"Wang, Z., Chu, Z., Doan, T.V., Ni, S., Yang, M., Zhang, W.: History, development, and principles of large language models: an introductory survey. AI and Ethics, 1\u201317 (2024)","DOI":"10.1007\/s43681-024-00583-7"},{"key":"6021_CR16","doi-asserted-by":"crossref","unstructured":"Warudkar, S., Jalit, R.: Unlocking the potential of generative ai in large language models. In: 2024 Parul International Conference on Engineering and Technology (PICET), pp. 1\u20135 (2024). IEEE","DOI":"10.1109\/PICET60765.2024.10716156"},{"key":"6021_CR17","unstructured":"Min, B., Ross, H., Sulem, E., Veyseh, A.P.B., Nguyen, T.H., Sainz, O., Agirre, E., Heinz, I., Roth, D.: Recent advances in natural language processing via large pre-trained language models: a survey (2021). arXiv preprint arXiv:2111.01243 (2021)"},{"key":"6021_CR18","doi-asserted-by":"publisher","first-page":"681","DOI":"10.1007\/s11023-020-09548-1","volume":"30","author":"L Floridi","year":"2020","unstructured":"Floridi, L., Chiriatti, M.: Gpt-3: Its nature, scope, limits, and consequences. Mind. Mach. 30, 681\u2013694 (2020)","journal-title":"Mind. Mach."},{"key":"6021_CR19","unstructured":"Zhang, Q., Fang, C., Xie, Y., Ma, Y., Sun, W., Yang, Y., Chen, Z.: A systematic literature review on large language models for automated program repair (2024). arXiv preprint arXiv:2405.01466 (2024)"},{"key":"6021_CR20","doi-asserted-by":"crossref","unstructured":"Sobania, D., Briesch, M., Hanna, C., Petke, J.: An analysis of the automatic bug fixing performance of chatgpt. In: 2023 IEEE\/ACM International Workshop on Automated Program Repair (APR), pp. 23\u201330 (2023). IEEE","DOI":"10.1109\/APR59189.2023.00012"},{"key":"6021_CR21","doi-asserted-by":"crossref","unstructured":"Fan, A., Gokkaya, B., Harman, M., Lyubarskiy, M., Sengupta, S., Yoo, S., Zhang, J.M.: Large language models for software engineering: Survey and open problems. In: 2023 IEEE\/ACM International Conference on Software Engineering: Future of Software Engineering (ICSE-FoSE), pp. 31\u201353 (2023). IEEE","DOI":"10.1109\/ICSE-FoSE59343.2023.00008"},{"key":"6021_CR22","doi-asserted-by":"crossref","unstructured":"Fakhoury, S., Naik, A., Sakkas, G., Chakraborty, S., Lahiri, S.K.: Llm-based test-driven interactive code generation: User study and empirical evaluation. IEEE Transactions on Software Engineering (2024)","DOI":"10.1109\/TSE.2024.3428972"},{"key":"6021_CR23","doi-asserted-by":"crossref","unstructured":"Fraser, G., Arcuri, A.: Evosuite: On the challenges of test case generation in the real world. In: 2013 IEEE Sixth International Conference on Software Testing, Verification and Validation, pp. 362\u2013369 (2013). IEEE","DOI":"10.1109\/ICST.2013.51"},{"issue":"8","key":"6021_CR24","doi-asserted-by":"publisher","first-page":"1978","DOI":"10.1016\/j.jss.2013.02.061","volume":"86","author":"S Anand","year":"2013","unstructured":"Anand, S., Burke, E.K., Chen, T.Y., Clark, J., Cohen, M.B., Grieskamp, W., Harman, M., Harrold, M.J., McMinn, P., Bertolino, A.: An orchestrated survey of methodologies for automated software test case generation. J. Syst. Softw. 86(8), 1978\u20132001 (2013)","journal-title":"J. Syst. Softw."},{"issue":"8","key":"6021_CR25","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3695988","volume":"33","author":"X Hou","year":"2024","unstructured":"Hou, X., Zhao, Y., Liu, Y., Yang, Z., Wang, K., Li, L., Luo, X., Lo, D., Grundy, J., Wang, H.: Large language models for software engineering: A systematic literature review. ACM Transactions on Software Engineering and Methodology 33(8), 1\u201379 (2024)","journal-title":"ACM Transactions on Software Engineering and Methodology"},{"key":"6021_CR26","doi-asserted-by":"crossref","unstructured":"Husein, R.A., Aburajouh, H., Catal, C.: Large language models for code completion: A systematic literature review. Computer Standards & Interfaces, 103917 (2024)","DOI":"10.1016\/j.csi.2024.103917"},{"key":"6021_CR27","doi-asserted-by":"crossref","unstructured":"Zhou, X., Cao, S., Sun, X., Lo, D.: Large language model for vulnerability detection and repair: Literature review and the road ahead. ACM Transactions on Software Engineering and Methodology (2024)","DOI":"10.1145\/3708522"},{"issue":"2","key":"6021_CR28","doi-asserted-by":"publisher","first-page":"293","DOI":"10.33889\/IJMEMS.2023.8.2.018","volume":"8","author":"AS Verma","year":"2023","unstructured":"Verma, A.S., Choudhary, A., Tiwari, S.: Software test case generation tools and techniques: A review. International Journal of Mathematical, Engineering and Management Sciences 8(2), 293 (2023)","journal-title":"International Journal of Mathematical, Engineering and Management Sciences"},{"issue":"4","key":"6021_CR29","doi-asserted-by":"publisher","first-page":"911","DOI":"10.1109\/TSE.2024.3368208","volume":"50","author":"J Wang","year":"2024","unstructured":"Wang, J., Huang, Y., Chen, C., Liu, Z., Wang, S., Wang, Q.: Software testing with large language models: Survey, landscape, and vision. IEEE Trans. Software Eng. 50(4), 911\u2013936 (2024)","journal-title":"IEEE Trans. Software Eng."},{"key":"6021_CR30","unstructured":"Zhang, Q., Fang, C., Gu, S., Shang, Y., Chen, Z., Xiao, L.: Large language models for unit testing: A systematic literature review. arXiv preprint arXiv:2506.15227 (2025)"},{"key":"6021_CR31","doi-asserted-by":"crossref","unstructured":"Qi, F., Hou, Y., Lin, N., Bao, S., Xu, N.: A survey of testing techniques based on large language models. In: Proceedings of the 2024 International Conference on Computer and Multimedia Technology, pp. 280\u2013284 (2024)","DOI":"10.1145\/3675249.3675298"},{"key":"6021_CR32","doi-asserted-by":"crossref","unstructured":"Boukhlif, M., Kharmoum, N., Hanine, M.: Llms for intelligent software testing: a comparative study. In: Proceedings of the 7th International Conference on Networking, Intelligent Systems and Security, pp. 1\u20138 (2024)","DOI":"10.1145\/3659677.3659749"},{"key":"6021_CR33","doi-asserted-by":"crossref","unstructured":"Edirisinghe, H., Wickramaarachchi, D.: Quality assurance for llm-generated test cases: A systematic literature review. In: 2024 8th SLAAI International Conference on Artificial Intelligence (SLAAI-ICAI), pp. 1\u20136 (2024). IEEE","DOI":"10.1109\/SLAAI-ICAI63667.2024.10844968"},{"issue":"3","key":"6021_CR34","doi-asserted-by":"publisher","first-page":"97","DOI":"10.3390\/make7030097","volume":"7","author":"A Celik","year":"2025","unstructured":"Celik, A., Mahmoud, Q.H.: A review of large language models for automated test case generation. Machine Learning and Knowledge Extraction 7(3), 97 (2025)","journal-title":"Machine Learning and Knowledge Extraction"},{"key":"6021_CR35","unstructured":"Kitchenham, B.: Procedures for performing systematic reviews. Keele, UK, Keele Univ. 33 (2004)"},{"issue":"1","key":"6021_CR36","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1177\/001316446002000104","volume":"20","author":"J Cohen","year":"1960","unstructured":"Cohen, J.: A coefficient of agreement for nominal scales. Educ. Psychol. Measur. 20(1), 37\u201346 (1960)","journal-title":"Educ. Psychol. Measur."},{"key":"6021_CR37","doi-asserted-by":"publisher","unstructured":"Naimi, L., Bouziane, E.M., Manaouch, M., Jakimi, A.: A new approach for automatic test case generation from use case diagram using llms and prompt engineering. In: 2024 International Conference on Circuit, Systems and Communication (ICCSC), pp. 1\u20135 (2024). https:\/\/doi.org\/10.1109\/ICCSC62074.2024.10616548","DOI":"10.1109\/ICCSC62074.2024.10616548"},{"issue":"1","key":"6021_CR38","doi-asserted-by":"publisher","first-page":"85","DOI":"10.1109\/TSE.2023.3334955","volume":"50","author":"M Sch\u00e4fer","year":"2024","unstructured":"Sch\u00e4fer, M., Nadi, S., Eghbali, A., Tip, F.: An empirical evaluation of using large language models for automated unit test generation. IEEE Trans. Software Eng. 50(1), 85\u2013105 (2024). https:\/\/doi.org\/10.1109\/TSE.2023.3334955","journal-title":"IEEE Trans. Software Eng."},{"key":"6021_CR39","doi-asserted-by":"publisher","unstructured":"Guilherme, V., Vincenzi, A.: An initial investigation of chatgpt unit test generation capability. In: Proceedings of the 8th Brazilian Symposium on Systematic and Automated Software Testing. SAST \u201923, pp. 15\u201324. Association for Computing Machinery, New York, NY, USA (2023). https:\/\/doi.org\/10.1145\/3624032.3624035","DOI":"10.1145\/3624032.3624035"},{"key":"6021_CR40","doi-asserted-by":"crossref","unstructured":"Koziolek, H., Ashiwal, V., Bandyopadhyay, S., R, C.K.: Automated Control Logic Test Case Generation using Large Language Models (2024). https:\/\/arxiv.org\/abs\/2405.01874","DOI":"10.1109\/ETFA61755.2024.10711016"},{"key":"6021_CR41","doi-asserted-by":"crossref","unstructured":"Alshahwan, N., Chheda, J., Finegenova, A., Gokkaya, B., Harman, M., Harper, I., Marginean, A., Sengupta, S., Wang, E.: Automated Unit Test Improvement using Large Language Models at Meta (2024). https:\/\/arxiv.org\/abs\/2402.09171","DOI":"10.1145\/3663529.3663839"},{"key":"6021_CR42","doi-asserted-by":"publisher","unstructured":"Chen, Y., Hu, Z., Zhi, C., Han, J., Deng, S., Yin, J.: Chatunitest: A framework for llm-based test generation. In: Companion Proceedings of the 32nd ACM International Conference on the Foundations of Software Engineering. FSE 2024, pp. 572\u2013576. Association for Computing Machinery, New York, NY, USA (2024).https:\/\/doi.org\/10.1145\/3663529.3663801","DOI":"10.1145\/3663529.3663801"},{"key":"6021_CR43","doi-asserted-by":"crossref","unstructured":"Mali, B., Maddala, K., Gupta, V., Reddy, S., Karfa, C., Karri, R.: ChIRAAG: ChatGPT Informed Rapid and Automated Assertion Generation (2024). https:\/\/arxiv.org\/abs\/2402.00093","DOI":"10.1109\/ISVLSI61997.2024.00130"},{"key":"6021_CR44","doi-asserted-by":"crossref","unstructured":"Ryan, G., Jain, S., Shang, M., Wang, S., Ma, X., Ramanathan, M.K., Ray, B.: Code-Aware Prompting: A study of Coverage Guided Test Generation in Regression Setting using LLM (2024). https:\/\/arxiv.org\/abs\/2402.00097","DOI":"10.1145\/3643769"},{"key":"6021_CR45","doi-asserted-by":"crossref","unstructured":"Dakhel, A.M., Nikanjam, A., Majdinasab, V., Khomh, F., Desmarais, M.C.: Effective Test Generation Using Pre-trained Large Language Models and Mutation Testing (2023). https:\/\/arxiv.org\/abs\/2308.16557","DOI":"10.1016\/j.infsof.2024.107468"},{"key":"6021_CR46","doi-asserted-by":"crossref","unstructured":"Wang, Z., Liu, K., Li, G., Jin, Z.: HITS: High-coverage LLM-based Unit Test Generation via Method Slicing (2024). https:\/\/arxiv.org\/abs\/2408.11324","DOI":"10.1145\/3691620.3695501"},{"key":"6021_CR47","doi-asserted-by":"crossref","unstructured":"Wang, Y., Fan, M., Zhang, X., Shi, J., Qiu, Z., Wang, H., Liu, T.: Liredroid: Llm-enhanced test case generation for static sensitive behavior replication. In: Proceedings of the 15th Asia-Pacific Symposium on Internetware. Internetware \u201924, pp. 81\u201384. Association for Computing Machinery, New York, NY, USA (2024). DOI: 10.1145\/3671016.3671404","DOI":"10.1145\/3671016.3671404"},{"key":"6021_CR48","unstructured":"Yu, S., Fang, C., Ling, Y., Wu, C., Chen, Z.: LLM for Test Script Generation and Migration: Challenges, Capabilities, and Opportunities (2023). https:\/\/arxiv.org\/abs\/2309.13574"},{"key":"6021_CR49","doi-asserted-by":"crossref","unstructured":"Xue, Z., Li, L., Tian, S., Chen, X., Li, P., Chen, L., Jiang, T., Zhang, M.: Llm4fin: Fully automating llm-powered test case generation for fintech software acceptance testing. In: Proceedings of the 33rd ACM SIGSOFT International Symposium on Software Testing and Analysis. ISSTA 2024, pp. 1643\u20131655. Association for Computing Machinery, New York, NY, USA (2024). DOI: 10.1145\/3650212.3680388","DOI":"10.1145\/3650212.3680388"},{"key":"6021_CR50","doi-asserted-by":"crossref","unstructured":"Piya, S., Sullivan, A.: LLM4TDD: Best Practices for Test Driven Development Using Large Language Models (2023). https:\/\/arxiv.org\/abs\/2312.04687","DOI":"10.1145\/3643795.3648382"},{"key":"6021_CR51","doi-asserted-by":"publisher","unstructured":"Liu, Z., Chen, C., Wang, J., Chen, M., Wu, B., Che, X., Wang, D., Wang, Q.: Make llm a testing expert: Bringing human-like interaction to mobile gui testing via functionality-aware decisions. In: Proceedings of the IEEE\/ACM 46th International Conference on Software Engineering. ICSE \u201924. Association for Computing Machinery, New York, NY, USA (2024). https:\/\/doi.org\/10.1145\/3597503.3639180","DOI":"10.1145\/3597503.3639180"},{"key":"6021_CR52","doi-asserted-by":"publisher","unstructured":"Karmarkar, H., Agrawal, S., Chauhan, A., Shete, P.: Navigating Confidentiality in Test Automation: A Case Study in LLM Driven Test Data Generation. In: 2024 IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER), pp. 337\u2013348. IEEE Computer Society, Los Alamitos, CA, USA (2024). https:\/\/doi.org\/10.1109\/SANER60148.2024.00041","DOI":"10.1109\/SANER60148.2024.00041"},{"key":"6021_CR53","doi-asserted-by":"publisher","unstructured":"Deljouyi, A.: Understandable test generation through capture\/replay and llms. In: Proceedings of the 2024 IEEE\/ACM 46th International Conference on Software Engineering: Companion Proceedings. ICSE-Companion \u201924, pp. 261\u2013263. Association for Computing Machinery, New York, NY, USA (2024). https:\/\/doi.org\/10.1145\/3639478.3639789","DOI":"10.1145\/3639478.3639789"},{"key":"6021_CR54","doi-asserted-by":"publisher","unstructured":"Bhatia, S., Gandhi, T., Kumar, D., Jalote, P.: Unit test generation using generative ai: A comparative performance analysis of autogeneration tools. In: Proceedings of the 1st International Workshop on Large Language Models for Code. LLM4Code \u201924, pp. 54\u201361. Association for Computing Machinery, New York, NY, USA (2024). https:\/\/doi.org\/10.1145\/3643795.3648396","DOI":"10.1145\/3643795.3648396"},{"key":"6021_CR55","doi-asserted-by":"crossref","unstructured":"Haji, K.E., Brandt, C., Zaidman, A.: Using github copilot for test generation in python: An empirical study. In: 2024 IEEE\/ACM International Conference on Automation of Software Test (AST), pp. 45\u201355 (2024)","DOI":"10.1145\/3644032.3644443"},{"key":"6021_CR56","doi-asserted-by":"crossref","unstructured":"Yuan, Z., Liu, M., Ding, S., Wang, K., Chen, Y., Peng, X., Lou, Y.: Evaluating and improving chatgpt for unit test generation. Proc. ACM Softw. Eng. 1(FSE) (2024) 10.1145\/3660783","DOI":"10.1145\/3660783"},{"key":"6021_CR57","doi-asserted-by":"publisher","unstructured":"Yi, G., Chen, Z., Chen, Z., Wong, W.E., Chau, N.: Exploring the capability of chatgpt in test generation. In: 2023 IEEE 23rd International Conference on Software Quality, Reliability, and Security Companion (QRS-C), pp. 72\u201380 (2023). https:\/\/doi.org\/10.1109\/QRS-C60940.2023.00013","DOI":"10.1109\/QRS-C60940.2023.00013"},{"key":"6021_CR58","doi-asserted-by":"publisher","unstructured":"Li, Y., Liu, P., Wang, H., Chu, J., Wong, W.E.: Evaluating large language models for software testing. Computer Standards & Interfaces 93, 103942 (2025) https:\/\/doi.org\/10.1016\/j.csi.2024.103942","DOI":"10.1016\/j.csi.2024.103942"},{"issue":"06","key":"6021_CR59","doi-asserted-by":"publisher","first-page":"1340","DOI":"10.1109\/TSE.2024.3382365","volume":"50","author":"Y Tang","year":"2024","unstructured":"Tang, Y., Liu, Z., Zhou, Z., Luo, X.: ChatGPT vs SBST: A Comparative Assessment of Unit Test Suite Generation. IEEE Trans. Software Eng. 50(06), 1340\u20131359 (2024). https:\/\/doi.org\/10.1109\/TSE.2024.3382365","journal-title":"IEEE Trans. Software Eng."},{"key":"6021_CR60","doi-asserted-by":"publisher","unstructured":"Kang, S., Yoon, J., Yoo, S.: Large language models are few-shot testers: Exploring llm-based general bug reproduction. In: Proceedings of the 45th International Conference on Software Engineering. ICSE \u201923, pp. 2312\u20132323. IEEE Press (2023). https:\/\/doi.org\/10.1109\/ICSE48619.2023.00194","DOI":"10.1109\/ICSE48619.2023.00194"},{"key":"6021_CR61","doi-asserted-by":"publisher","unstructured":"Jorgensen, S., Nadizar, G., Pietropolli, G., Manzoni, L., Medvet, E., O\u2019Reilly, U.-M., Hemberg, E.: Large language model-based test case generation for gp agents. In: Proceedings of the Genetic and Evolutionary Computation Conference. GECCO \u201924, pp. 914\u2013923. Association for Computing Machinery, New York, NY, USA (2024). https:\/\/doi.org\/10.1145\/3638529.3654056","DOI":"10.1145\/3638529.3654056"},{"key":"6021_CR62","doi-asserted-by":"publisher","unstructured":"Kouemo Ngassom, S., Moradi Dakhel, A., Tambon, F., Khomh, F.: Chain of targeted verification questions to improve the reliability of code generated by llms. In: Proceedings of the 1st ACM International Conference on AI-Powered Software. AIware 2024, pp. 122\u2013130. Association for Computing Machinery, New York, NY, USA (2024). https:\/\/doi.org\/10.1145\/3664646.3664772","DOI":"10.1145\/3664646.3664772"},{"key":"6021_CR63","doi-asserted-by":"publisher","unstructured":"Munley, C., Jarmusch, A., Chandrasekaran, S.: Llm4vv: Developing llm-driven testsuite for compiler validation. Future Generation Computer Systems 160, 1\u201313 (2024) https:\/\/doi.org\/10.1016\/j.future.2024.05.034","DOI":"10.1016\/j.future.2024.05.034"},{"key":"6021_CR64","doi-asserted-by":"crossref","unstructured":"Paduraru, C., Staicu, A., Stefanescu, A.: Llm-based methods for the creation of unit tests in game development. Procedia Computer Science 246, 2459\u20132468 (2024) 10.1016\/j.procs.2024.09.473. 28th International Conference on Knowledge Based and Intelligent information and Engineering Systems (KES 2024)","DOI":"10.1016\/j.procs.2024.09.473"},{"key":"6021_CR65","doi-asserted-by":"publisher","unstructured":"Lemieux, C., Inala, J.P., Lahiri, S.K., Sen, S.: Codamosa: Escaping coverage plateaus in test generation with pre-trained large language models. In: 2023 IEEE\/ACM 45th International Conference on Software Engineering (ICSE), pp. 919\u2013931 (2023). https:\/\/doi.org\/10.1109\/ICSE48619.2023.00085","DOI":"10.1109\/ICSE48619.2023.00085"},{"key":"6021_CR66","first-page":"24","volume-title":"Advances in Smart Medical, IoT & Artificial Intelligence","author":"M Boukhlif","year":"2024","unstructured":"Boukhlif, M., Kharmoum, N., Hanine, M., Kodad, M., Lagmiri, S.N.: Towards an intelligent test case generation framework using llms and prompt engineering. In: Serrhini, M., Ghoumid, K. (eds.) Advances in Smart Medical, IoT & Artificial Intelligence, pp. 24\u201331. Springer, Cham (2024)"},{"key":"6021_CR67","doi-asserted-by":"publisher","unstructured":"Santos, R., Santos, I., Magalhaes, C., Souza Santos, R.: Are We Testing or Being Tested? Exploring the Practical Applications of Large Language Models in Software Testing. In: 2024 IEEE Conference on Software Testing, Verification and Validation (ICST), pp. 353\u2013360. IEEE Computer Society, Los Alamitos, CA, USA (2024). https:\/\/doi.org\/10.1109\/ICST60714.2024.00039","DOI":"10.1109\/ICST60714.2024.00039"},{"key":"6021_CR68","doi-asserted-by":"publisher","unstructured":"Dinella, E., Ryan, G., Mytkowicz, T., Lahiri, S.K.: Toga: a neural method for test oracle generation. In: Proceedings of the 44th International Conference on Software Engineering. ICSE \u201922, pp. 2130\u20132141. Association for Computing Machinery, New York, NY, USA (2022). https:\/\/doi.org\/10.1145\/3510003.3510141","DOI":"10.1145\/3510003.3510141"},{"key":"6021_CR69","doi-asserted-by":"crossref","unstructured":"Yang, L., Yang, C., Gao, S., Wang, W., Wang, B., Zhu, Q., Chu, X., Zhou, J., Liang, G., Wang, Q., Chen, J.: On the Evaluation of Large Language Models in Unit Test Generation. In: 2024 39th IEEE\/ACM International Conference on Automated Software Engineering (ASE), pp. 1607\u20131619. IEEE Computer Society, Los Alamitos, CA, USA (2024). https:\/\/doi.ieeecomputersociety.org\/","DOI":"10.1145\/3691620.3695529"},{"key":"6021_CR70","doi-asserted-by":"publisher","unstructured":"Lops, A., Narducci, F., Ragone, A., Trizio, M.: Agonetest: Automated creation and assessment of unit tests leveraging large language models. In: Proceedings of the 39th IEEE\/ACM International Conference on Automated Software Engineering. ASE \u201924, pp. 2440\u20132441. Association for Computing Machinery, New York, NY, USA (2024). https:\/\/doi.org\/10.1145\/3691620.3695318","DOI":"10.1145\/3691620.3695318"},{"key":"6021_CR71","doi-asserted-by":"publisher","unstructured":"Boukhlif, M., Kharmoum, N., Hanine, M.: Llms for intelligent software testing: A comparative study. In: Proceedings of the 7th International Conference on Networking, Intelligent Systems and Security. NISS \u201924. Association for Computing Machinery, New York, NY, USA (2024). https:\/\/doi.org\/10.1145\/3659677.3659749","DOI":"10.1145\/3659677.3659749"},{"key":"6021_CR72","doi-asserted-by":"publisher","unstructured":"Xiao, D., Guo, Y., Li, Y., Chen, L.: Optimizing search-based unit test generation with large language models: An empirical study. In: Proceedings of the 15th Asia-Pacific Symposium on Internetware. Internetware \u201924, pp. 71\u201380. Association for Computing Machinery, New York, NY, USA (2024). https:\/\/doi.org\/10.1145\/3671016.3674813","DOI":"10.1145\/3671016.3674813"},{"issue":"2","key":"6021_CR73","doi-asserted-by":"publisher","first-page":"36","DOI":"10.1007\/s10664-022-10248-w","volume":"28","author":"S Lukasczyk","year":"2023","unstructured":"Lukasczyk, S., Kroi\u00df, F., Fraser, G.: An empirical study of automated unit test generation for python. Empir. Softw. Eng. 28(2), 36 (2023). https:\/\/doi.org\/10.1007\/s10664-022-10248-w","journal-title":"Empir. Softw. Eng."},{"key":"6021_CR74","doi-asserted-by":"publisher","unstructured":"Gu, Q.: Llm-based code generation method for golang compiler testing. In: Proceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering. ESEC\/FSE 2023, pp. 2201\u20132203. Association for Computing Machinery, New York, NY, USA (2023). https:\/\/doi.org\/10.1145\/3611643.3617850","DOI":"10.1145\/3611643.3617850"}],"container-title":["Cluster Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10586-026-06021-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10586-026-06021-z","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10586-026-06021-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,7,10]],"date-time":"2026-07-10T11:41:15Z","timestamp":1783683675000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10586-026-06021-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,3,30]]},"references-count":74,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2026,5]]}},"alternative-id":["6021"],"URL":"https:\/\/doi.org\/10.1007\/s10586-026-06021-z","relation":{},"ISSN":["1386-7857","1573-7543"],"issn-type":[{"value":"1386-7857","type":"print"},{"value":"1573-7543","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,3,30]]},"assertion":[{"value":"30 May 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 February 2026","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"7 February 2026","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"30 March 2026","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval"}}],"article-number":"227"}}