{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,6]],"date-time":"2026-04-06T14:43:56Z","timestamp":1775486636906,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":39,"publisher":"ACM","license":[{"start":{"date-parts":[[2023,9,25]],"date-time":"2023-09-25T00:00:00Z","timestamp":1695600000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,9,25]]},"DOI":"10.1145\/3624032.3624035","type":"proceedings-article","created":{"date-parts":[[2023,10,17]],"date-time":"2023-10-17T18:15:18Z","timestamp":1697566518000},"page":"15-24","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":52,"title":["An initial investigation of ChatGPT unit test generation capability"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0009-0005-5868-290X","authenticated-orcid":false,"given":"Vitor","family":"Guilherme","sequence":"first","affiliation":[{"name":"Federal University of Sao Carlos - UFSCar, Brazil"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5902-1672","authenticated-orcid":false,"given":"Auri","family":"Vincenzi","sequence":"additional","affiliation":[{"name":"Universidade Federal de S\u00e3o Carlos, Brazil"}]}],"member":"320","published-online":{"date-parts":[[2023,10,17]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"21st Belgium-Netherlands Software Evolution Workshop \u2013 BENEVOL\u20192022(CEUR Workshop Proceedings, Vol.\u00a01). Mons, 10","author":"Abdi Mehrdad","year":"2022","unstructured":"Mehrdad Abdi and Serge Demeyer . 2022 . Steps towards zero-touch mutation testing in Pharo . In 21st Belgium-Netherlands Software Evolution Workshop \u2013 BENEVOL\u20192022(CEUR Workshop Proceedings, Vol.\u00a01). Mons, 10 . Mehrdad Abdi and Serge Demeyer. 2022. Steps towards zero-touch mutation testing in Pharo. In 21st Belgium-Netherlands Software Evolution Workshop \u2013 BENEVOL\u20192022(CEUR Workshop Proceedings, Vol.\u00a01). Mons, 10."},{"key":"e_1_3_2_1_2_1","volume-title":"XXVII International Conference on Software Engineering \u2013 ICSE\u201905","author":"Andrews H.","unstructured":"J.\u00a0 H. Andrews , L.\u00a0 C. Briand , and Y. Labiche . 2005. Is mutation an appropriate tool for testing experiments? . In XXVII International Conference on Software Engineering \u2013 ICSE\u201905 . ACM Press, St. Louis, MO, USA, 402\u2013411. https:\/\/doi.org\/10.1145\/1062455.1062530 10.1145\/1062455.1062530 J.\u00a0H. Andrews, L.\u00a0C. Briand, and Y. Labiche. 2005. Is mutation an appropriate tool for testing experiments?. In XXVII International Conference on Software Engineering \u2013 ICSE\u201905. ACM Press, St. Louis, MO, USA, 402\u2013411. https:\/\/doi.org\/10.1145\/1062455.1062530"},{"key":"#cr-split#-e_1_3_2_1_3_1.1","doi-asserted-by":"crossref","unstructured":"Filipe\u00a0Santos Araujo and Auri Vincenzi. 2020. How far are we from testing a program in a completely automated way considering the mutation testing criterion at unit level?. In Anais do Simp\u00f3sio Brasileiro de Qualidade de Software (SBQS). SBC 151-159. https:\/\/doi.org\/10.1145\/3439961.3439977 10.1145\/3439961.3439977","DOI":"10.1145\/3439961.3439977"},{"key":"#cr-split#-e_1_3_2_1_3_1.2","doi-asserted-by":"crossref","unstructured":"Filipe\u00a0Santos Araujo and Auri Vincenzi. 2020. How far are we from testing a program in a completely automated way considering the mutation testing criterion at unit level?. In Anais do Simp\u00f3sio Brasileiro de Qualidade de Software (SBQS). SBC 151-159. https:\/\/doi.org\/10.1145\/3439961.3439977","DOI":"10.1145\/3439961.3439977"},{"key":"e_1_3_2_1_4_1","volume-title":"IntelliJ and Jenkins. In 2016 IEEE International Conference on Software Testing, Verification and Validation (ICST). 401\u2013408","author":"Arcuri Andrea","year":"2016","unstructured":"Andrea Arcuri , Jos\u00e9 Campos , and Gordon Fraser . 2016 . Unit Test Generation During Software Development: EvoSuite Plugins for Maven , IntelliJ and Jenkins. In 2016 IEEE International Conference on Software Testing, Verification and Validation (ICST). 401\u2013408 . https:\/\/doi.org\/10.1109\/ICST.2016.44 10.1109\/ICST.2016.44 Andrea Arcuri, Jos\u00e9 Campos, and Gordon Fraser. 2016. Unit Test Generation During Software Development: EvoSuite Plugins for Maven, IntelliJ and Jenkins. In 2016 IEEE International Conference on Software Testing, Verification and Validation (ICST). 401\u2013408. https:\/\/doi.org\/10.1109\/ICST.2016.44"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2014.2372785"},{"key":"e_1_3_2_1_6_1","unstructured":"Henry Coles. 2015. PITest: real world mutation testing. Dispon\u00edvel em: http:\/\/pitest.org\/. Acesso em: 04\/07\/2016. bibtex*[howpublished=P\u00e1gina Web].  Henry Coles. 2015. PITest: real world mutation testing. Dispon\u00edvel em: http:\/\/pitest.org\/. Acesso em: 04\/07\/2016. bibtex*[howpublished=P\u00e1gina Web]."},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/C-M.1978.218136"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3555228.3555233"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/2025113.2025179"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2685612"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2897010.2897020"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2010.62"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2635868.2635929"},{"key":"e_1_3_2_1_14_1","unstructured":"Tsz-On Li Wenxi Zong Yibo Wang Haoye Tian Ying Wang Shing-Chi Cheung and Jeff Kramer. 2023. Finding Failure-Inducing Test Cases with ChatGPT.  Tsz-On Li Wenxi Zong Yibo Wang Haoye Tian Ying Wang Shing-Chi Cheung and Jeff Kramer. 2023. Finding Failure-Inducing Test Cases with ChatGPT."},{"key":"#cr-split#-e_1_3_2_1_15_1.1","unstructured":"Zhe Liu Chunyang Chen Junjie Wang Mengzhuo Chen Boyu Wu Xing Che Dandan Wang and Qing Wang. 2023. Chatting with GPT-3 for Zero-Shot Human-Like Mobile Automated GUI Testing. https:\/\/doi.org\/10.48550\/arXiv.2305.09434 10.48550\/arXiv.2305.09434"},{"key":"#cr-split#-e_1_3_2_1_15_1.2","unstructured":"Zhe Liu Chunyang Chen Junjie Wang Mengzhuo Chen Boyu Wu Xing Che Dandan Wang and Qing Wang. 2023. Chatting with GPT-3 for Zero-Shot Human-Like Mobile Automated GUI Testing. https:\/\/doi.org\/10.48550\/arXiv.2305.09434"},{"key":"#cr-split#-e_1_3_2_1_16_1.1","doi-asserted-by":"crossref","unstructured":"Wei Ma Shangqing Liu Wenhan Wang Qiang Hu Ye Liu Cen Zhang Liming Nie and Yang Liu. 2023. The Scope of ChatGPT in Software Engineering: A Thorough Investigation. https:\/\/doi.org\/10.48550\/arXiv.2305.12138 10.48550\/arXiv.2305.12138","DOI":"10.1109\/ACCESS.2022.3168842"},{"key":"#cr-split#-e_1_3_2_1_16_1.2","unstructured":"Wei Ma Shangqing Liu Wenhan Wang Qiang Hu Ye Liu Cen Zhang Liming Nie and Yang Liu. 2023. The Scope of ChatGPT in Software Engineering: A Thorough Investigation. https:\/\/doi.org\/10.48550\/arXiv.2305.12138"},{"key":"e_1_3_2_1_17_1","unstructured":"OpenAI. 2023. OpenAI GTP-3.5 Models Documentation. (July 2023). https:\/\/platform.openai.com\/docs\/models\/gpt-3-5  OpenAI. 2023. OpenAI GTP-3.5 Models Documentation. (July 2023). https:\/\/platform.openai.com\/docs\/models\/gpt-3-5"},{"key":"#cr-split#-e_1_3_2_1_18_1.1","doi-asserted-by":"crossref","unstructured":"Carlos Pacheco and Michael\u00a0D. Ernst. 2007. Randoop: Feedback-directed Random Testing for Java. In Companion to the 22Nd ACM SIGPLAN Conference on Object-oriented Programming Systems and Applications Companion(OOPSLA '07). ACM 815-816. https:\/\/doi.org\/10.1145\/1297846.1297902 bibtex*[acmid=1297902;numpages=2] event-place: Montreal Quebec Canada. 10.1145\/1297846.1297902","DOI":"10.1145\/1297846.1297902"},{"key":"#cr-split#-e_1_3_2_1_18_1.2","doi-asserted-by":"crossref","unstructured":"Carlos Pacheco and Michael\u00a0D. Ernst. 2007. Randoop: Feedback-directed Random Testing for Java. In Companion to the 22Nd ACM SIGPLAN Conference on Object-oriented Programming Systems and Applications Companion(OOPSLA '07). ACM 815-816. https:\/\/doi.org\/10.1145\/1297846.1297902 bibtex*[acmid=1297902;numpages=2] event-place: Montreal Quebec Canada.","DOI":"10.1145\/1297846.1297902"},{"key":"e_1_3_2_1_19_1","volume-title":"Testing Language Models (and Prompts) Like We Test Software. (May","author":"Ribeiro Marco\u00a0Tulio","year":"2023","unstructured":"Marco\u00a0Tulio Ribeiro . 2023. Testing Language Models (and Prompts) Like We Test Software. (May 2023 ). https:\/\/towardsdatascience.com\/testing-large-language-models-like-we-test-software-92745d28a359 Marco\u00a0Tulio Ribeiro. 2023. Testing Language Models (and Prompts) Like We Test Software. (May 2023). https:\/\/towardsdatascience.com\/testing-large-language-models-like-we-test-software-92745d28a359"},{"key":"e_1_3_2_1_20_1","unstructured":"M. Roper. 1994. Software Testing. McGrall Hill.  M. Roper. 1994. Software Testing. McGrall Hill."},{"key":"#cr-split#-e_1_3_2_1_21_1.1","doi-asserted-by":"crossref","unstructured":"Abdelilah Sakti Gilles Pesant and Yann-Ga\u00ebl Gu\u00e9h\u00e9neuc. 2015. JTExpert at the Third Unit Testing Tool Competition. 52-55. https:\/\/doi.org\/10.1109\/SBST.2015.20 10.1109\/SBST.2015.20","DOI":"10.1109\/SBST.2015.20"},{"key":"#cr-split#-e_1_3_2_1_21_1.2","doi-asserted-by":"crossref","unstructured":"Abdelilah Sakti Gilles Pesant and Yann-Ga\u00ebl Gu\u00e9h\u00e9neuc. 2015. JTExpert at the Third Unit Testing Tool Competition. 52-55. https:\/\/doi.org\/10.1109\/SBST.2015.20","DOI":"10.1109\/SBST.2015.20"},{"key":"e_1_3_2_1_22_1","volume-title":"Proceedings of the 15th Workshop on Search-Based Software Testing(SBST \u201922)","author":"Schweikl Sebastian","year":"2023","unstructured":"Sebastian Schweikl , Gordon Fraser , and Andrea Arcuri . 2023 . EvoSuite at the SBST 2022 Tool Competition . In Proceedings of the 15th Workshop on Search-Based Software Testing(SBST \u201922) . Association for Computing Machinery, New York, NY, USA, 33\u201334. https:\/\/doi.org\/10.1145\/3526072.3527526 event-place: Pittsburgh, Pennsylvania. 10.1145\/3526072.3527526 Sebastian Schweikl, Gordon Fraser, and Andrea Arcuri. 2023. EvoSuite at the SBST 2022 Tool Competition. In Proceedings of the 15th Workshop on Search-Based Software Testing(SBST \u201922). Association for Computing Machinery, New York, NY, USA, 33\u201334. https:\/\/doi.org\/10.1145\/3526072.3527526 event-place: Pittsburgh, Pennsylvania."},{"key":"#cr-split#-e_1_3_2_1_23_1.1","unstructured":"Mohammed\u00a0Latif Siddiq Joanna C.\u00a0S. Santos Ridwanul\u00a0Hasan Tanvir Noshin Ulfat Fahmid\u00a0Al Rifat and Vinicius\u00a0Carvalho Lopes. 2023. Exploring the Effectiveness of Large Language Models in Generating Unit Tests. https:\/\/doi.org\/10.48550\/arXiv.2305.00418 10.48550\/arXiv.2305.00418"},{"key":"#cr-split#-e_1_3_2_1_23_1.2","unstructured":"Mohammed\u00a0Latif Siddiq Joanna C.\u00a0S. Santos Ridwanul\u00a0Hasan Tanvir Noshin Ulfat Fahmid\u00a0Al Rifat and Vinicius\u00a0Carvalho Lopes. 2023. Exploring the Effectiveness of Large Language Models in Generating Unit Tests. https:\/\/doi.org\/10.48550\/arXiv.2305.00418"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.5555\/3295222.3295349"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/2994291.2994295"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/SBST52555.2021.00012"},{"key":"#cr-split#-e_1_3_2_1_27_1.1","unstructured":"Jules White Sam Hays Quchen Fu Jesse Spencer-Smith and Douglas\u00a0C. Schmidt. 2023. ChatGPT Prompt Patterns for Improving Code Quality Refactoring Requirements Elicitation and Software Design. https:\/\/doi.org\/10.48550\/arXiv.2303.07839 10.48550\/arXiv.2303.07839"},{"key":"#cr-split#-e_1_3_2_1_27_1.2","unstructured":"Jules White Sam Hays Quchen Fu Jesse Spencer-Smith and Douglas\u00a0C. Schmidt. 2023. ChatGPT Prompt Patterns for Improving Code Quality Refactoring Requirements Elicitation and Software Design. https:\/\/doi.org\/10.48550\/arXiv.2303.07839"},{"key":"#cr-split#-e_1_3_2_1_28_1.1","unstructured":"Zhuokui Xie Yinghao Chen Chen Zhi Shuiguang Deng and Jianwei Yin. 2023. ChatUniTest: a ChatGPT-based automated unit test generation tool. https:\/\/doi.org\/10.48550\/arXiv.2305.04764 10.48550\/arXiv.2305.04764"},{"key":"#cr-split#-e_1_3_2_1_28_1.2","unstructured":"Zhuokui Xie Yinghao Chen Chen Zhi Shuiguang Deng and Jianwei Yin. 2023. ChatUniTest: a ChatGPT-based automated unit test generation tool. https:\/\/doi.org\/10.48550\/arXiv.2305.04764"},{"key":"#cr-split#-e_1_3_2_1_29_1.1","unstructured":"Zhiqiang Yuan Yiling Lou Mingwei Liu Shiji Ding Kaixin Wang Yixuan Chen and Xin Peng. 2023. No More Manual Tests? Evaluating and Improving ChatGPT for Unit Test Generation. https:\/\/doi.org\/10.48550\/arXiv.2305.04207 10.48550\/arXiv.2305.04207"},{"key":"#cr-split#-e_1_3_2_1_29_1.2","unstructured":"Zhiqiang Yuan Yiling Lou Mingwei Liu Shiji Ding Kaixin Wang Yixuan Chen and Xin Peng. 2023. No More Manual Tests? Evaluating and Improving ChatGPT for Unit Test Generation. https:\/\/doi.org\/10.48550\/arXiv.2305.04207"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/1985793.1986036"}],"event":{"name":"SAST 2023: 8th Brazilian Symposium on Systematic and Automated Software Testing","location":"Campo Grande, MS Brazil","acronym":"SAST 2023"},"container-title":["8th Brazilian Symposium on Systematic and Automated Software Testing"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3624032.3624035","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3624032.3624035","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:36:06Z","timestamp":1750178166000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3624032.3624035"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,25]]},"references-count":39,"alternative-id":["10.1145\/3624032.3624035","10.1145\/3624032"],"URL":"https:\/\/doi.org\/10.1145\/3624032.3624035","relation":{},"subject":[],"published":{"date-parts":[[2023,9,25]]},"assertion":[{"value":"2023-10-17","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}