{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,22]],"date-time":"2026-07-22T16:46:32Z","timestamp":1784738792827,"version":"3.55.0"},"publisher-location":"New York, NY, USA","reference-count":44,"publisher":"ACM","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2025,6,23]]},"DOI":"10.1145\/3696630.3728608","type":"proceedings-article","created":{"date-parts":[[2025,7,28]],"date-time":"2025-07-28T19:08:09Z","timestamp":1753729689000},"page":"1193-1197","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["A Tool for Generating Exceptional Behavior Tests With Large Language Models"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0009-0005-7119-4134","authenticated-orcid":false,"given":"Linghan","family":"Zhong","sequence":"first","affiliation":[{"name":"University of Texas Austin, Austin, Texas, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-7004-3075","authenticated-orcid":false,"given":"Samuel","family":"Yuan","sequence":"additional","affiliation":[{"name":"The University of Texas at Austin, Austin, Texas, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8211-3321","authenticated-orcid":false,"given":"Jiyang","family":"Zhang","sequence":"additional","affiliation":[{"name":"The University of Texas at Austin, Austin, Texas, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0697-663X","authenticated-orcid":false,"given":"Yu","family":"Liu","sequence":"additional","affiliation":[{"name":"UT Austin, Austin, Texas, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1529-3216","authenticated-orcid":false,"given":"Pengyu","family":"Nie","sequence":"additional","affiliation":[{"name":"University of Waterloo, Waterloo, Ontario, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2550-5262","authenticated-orcid":false,"given":"Junyi Jessy","family":"Li","sequence":"additional","affiliation":[{"name":"The University of Texas at Austin, Austin, Texas, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5894-7649","authenticated-orcid":false,"given":"Milos","family":"Gligoric","sequence":"additional","affiliation":[{"name":"The University of Texas at Austin, Austin, Texas, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2025,7,28]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICST46399.2020.00017"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/SBES.2011.28"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"crossref","unstructured":"Arianna Blasi Alessandra Gorla Michael D Ernst and Mauro Pezz\u00e8. 2022. Call me maybe: Using NLP to automatically generate unit test cases respecting temporal constraints. In Automated Software Engineering. 1\u201311.","DOI":"10.1145\/3551349.3556961"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE48619.2023.00081"},{"key":"e_1_3_2_1_5_1","unstructured":"Conda. 2024. Conda. https:\/\/docs.conda.io\/projects\/conda\/en\/stable."},{"key":"e_1_3_2_1_6_1","volume-title":"Improving readability in automatic unit test generation. Ph. D. Dissertation","author":"Daka Ermira","unstructured":"Ermira Daka. 2018. Improving readability in automatic unit test generation. Ph. D. Dissertation. University of Sheffield."},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3092703.3092727"},{"key":"e_1_3_2_1_8_1","volume-title":"International Conference on Evaluation and Assessment in Software Engineering. 170\u2013179","author":"Dalton Francisco","year":"2020","unstructured":"Francisco Dalton, M\u00e1rcio Ribeiro, Gustavo Pinto, Leo Fernandes, Rohit Gheyi, and Baldoino Fonseca. 2020. Is exceptional behavior testing an exception? An empirical assessment using Java automated tests. In International Conference on Evaluation and Assessment in Software Engineering. 170\u2013179."},{"key":"e_1_3_2_1_9_1","volume-title":"International Conference on Neural Information Processing Systems.","author":"Dettmers Tim","year":"2024","unstructured":"Tim Dettmers, Mike Lewis, Younes Belkada, and Luke Zettlemoyer. 2024. LLM.int8(): 8-bit matrix multiplication for transformers at scale. In International Conference on Neural Information Processing Systems."},{"key":"e_1_3_2_1_10_1","volume-title":"International Workshop on Automation of Software Test, 45\u201355","author":"Haji Khalid El","year":"2024","unstructured":"Khalid El Haji, Carolin Brandt, and Andy Zaidman. 2024. Using GitHub Copilot for test generation in Python: An empirical study. International Workshop on Automation of Software Test, 45\u201355."},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"crossref","unstructured":"Michael D Ernst Jeff H Perkins Philip J Guo Stephen McCamant Carlos Pacheco Matthew S Tschantz and Chen Xiao. 2007. The Daikon system for dynamic detection of likely invariants. Science of computer programming 69 1-3 35\u201345.","DOI":"10.1016\/j.scico.2007.01.015"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2025113.2025179"},{"key":"e_1_3_2_1_13_1","volume-title":"Annual Conference on Foundations of Software Technology and Theoretical Computer Science.","author":"Godefroid Patrice","year":"2012","unstructured":"Patrice Godefroid. 2012. Test generation using symbolic execution. In Annual Conference on Foundations of Software Technology and Theoretical Computer Science."},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2931037.2931061"},{"key":"e_1_3_2_1_15_1","volume-title":"The Java language specification","author":"Gosling James","unstructured":"James Gosling. 2000. The Java language specification. Addison-Wesley Professional."},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2009.71"},{"key":"e_1_3_2_1_17_1","volume-title":"Addison-Wesley Longman Publishing Co","author":"Hejlsberg Anders","unstructured":"Anders Hejlsberg, Scott Wiltamuth, and Peter Golde. 2003. C# language specification. Addison-Wesley Longman Publishing Co., Inc."},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3408896"},{"key":"e_1_3_2_1_19_1","unstructured":"Hamel Husain Ho-Hsiang Wu Tiferet Gazit Miltiadis Allamanis and Marc Brockschmidt. 2019. CodeSearchNet challenge: Evaluating the state of semantic code search. arXiv preprint arXiv:1909.09436."},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE48619.2023.00085"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-021-09983-3"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3597926.3598149"},{"key":"e_1_3_2_1_23_1","volume-title":"ExLi: An Inline-Test Generation Tool for Java. In International Symposium on Software Testing and Analysis. 1\u20135.","author":"Liu Yu","year":"2024","unstructured":"Yu Liu, Aditya Thimmaiah, Owolabi Legunsen, and Milos Gligoric. 2024. ExLi: An Inline-Test Generation Tool for Java. In International Symposium on Software Testing and Analysis. 1\u20135."},{"key":"e_1_3_2_1_24_1","volume-title":"International Working Conference on Mining Software Repositories. 207\u2013218","author":"Marcilio Diego","unstructured":"Diego Marcilio and Carlo A. Furia. 2021. How Java programmers test exceptional behavior. In International Working Conference on Mining Software Repositories. 207\u2013218."},{"key":"e_1_3_2_1_25_1","volume-title":"Machine learning for executable code in software testing and verification. Ph. D. Dissertation","author":"Nie Pengyu","unstructured":"Pengyu Nie. 2023. Machine learning for executable code in software testing and verification. Ph. D. Dissertation. The University of Texas at Austin."},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE48619.2023.00178"},{"key":"e_1_3_2_1_27_1","unstructured":"OpenAI. 2024. GPT-3.5-turbo. https:\/\/platform.openai.com\/docs\/models\/gpt-3-5-turbo."},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2007.37"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-022-10207-5"},{"key":"e_1_3_2_1_30_1","volume-title":"Claire Le Goues, and Vincent J. Hellendoorn","author":"Rao Nikitha","year":"2023","unstructured":"Nikitha Rao, Kush Jain, Uri Alon, Claire Le Goues, and Vincent J. Hellendoorn. 2023. CAT-LM: Training language models on aligned code and tests. In Automated Software Engineering. 409\u2013420."},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"crossref","unstructured":"Brian Robinson Michael D Ernst Jeff H Perkins Vinay Augustine and Nuo Li. 2011. Scaling up automated test generation: Automatically generating maintainable regression unit tests for programs. In Automated Software Engineering. 23\u201332.","DOI":"10.1109\/ASE.2011.6100059"},{"key":"e_1_3_2_1_32_1","volume-title":"Yossi Adi, Jingyu Liu, Tal Remez, J\u00e9r\u00e9my Rapin, et al.","author":"Roziere Baptiste","year":"2023","unstructured":"Baptiste Roziere, Jonas Gehring, Fabian Gloeckle, Sten Sootla, Itai Gat, Xiaoqing Ellen Tan, Yossi Adi, Jingyu Liu, Tal Remez, J\u00e9r\u00e9my Rapin, et al. 2023. Code Llama: Open foundation models for code. arXiv preprint arXiv:2308.12950."},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3643769"},{"key":"e_1_3_2_1_34_1","volume-title":"Arun Raja, et al.","author":"Sanh Victor","year":"2021","unstructured":"Victor Sanh, Albert Webson, Colin Raffel, Stephen H Bach, Lintang Sutawika, Zaid Alyafeai, Antoine Chaffin, Arnaud Stiegler, Teven Le Scao, Arun Raja, et al. 2021. Multitask prompted training enables zero-shot task generalization. arXiv preprint arXiv:2110.08207."},{"key":"e_1_3_2_1_35_1","article-title":"An empirical evaluation of using large language models for automated unit test generation","author":"Sch\u00e4fer Max","year":"2023","unstructured":"Max Sch\u00e4fer, Sarah Nadi, Aryaz Eghbali, and Frank Tip. 2023. An empirical evaluation of using large language models for automated unit test generation. Transactions on Software Engineering.","journal-title":"Transactions on Software Engineering."},{"key":"e_1_3_2_1_36_1","volume-title":"Shao Kun Deng, and Neel Sundaresan","author":"Tufano Michele","year":"2020","unstructured":"Michele Tufano, Dawn Drain, Alexey Svyatkovskiy, Shao Kun Deng, and Neel Sundaresan. 2020. Unit test case generation with transformers and focal context. arXiv preprint arXiv:2009.05617."},{"key":"e_1_3_2_1_37_1","volume-title":"The Python language reference","author":"VanRossum Guido","unstructured":"Guido VanRossum and Fred L Drake. 2010. The Python language reference. Vol. 561. Python Software Foundation Amsterdam, The Netherlands."},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2024.3368208"},{"key":"e_1_3_2_1_39_1","volume-title":"Self-Instruct: Aligning Language Models with Self-Generated Instructions. In Annual Meeting of the Association for Computational Linguistics. 13484\u201313508","author":"Wang Yizhong","year":"2023","unstructured":"Yizhong Wang, Yeganeh Kordi, Swaroop Mishra, Alisa Liu, Noah A Smith, Daniel Khashabi, and Hannaneh Hajishirzi. 2023. Self-Instruct: Aligning Language Models with Self-Generated Instructions. In Annual Meeting of the Association for Computational Linguistics. 13484\u201313508."},{"key":"e_1_3_2_1_40_1","volume-title":"Brian Lester, Nan Du, Andrew M Dai, and Quoc V Le.","author":"Wei Jason","year":"2021","unstructured":"Jason Wei, Maarten Bosma, Vincent Y Zhao, Kelvin Guu, Adams Wei Yu, Brian Lester, Nan Du, Andrew M Dai, and Quoc V Le. 2021. Finetuned language models are zero-shot learners. arXiv preprint arXiv:2109.01652."},{"key":"e_1_3_2_1_41_1","unstructured":"Michael Yang Jeffrey Morgan Daniel Hiltgen Bruce MacDonald Matt Williams Patrick Devine Blake Mizerany Michael Jesse Gross Josh royjhan Jeremy frob Dane Madsen Parth Sareen Eva H Mark Ward James Braza Arne M\u00fcller Hernan Martinez Ikko Eltociear Ashimine Rapid Architect Sam Timothy Jaeryang Baek slouffka Alexander F. R\u00f8dseth tusharhero Eli Bendersky Lei Jitang and Mraiser. 2025. Ollama. https:\/\/github.com\/ollama\/ollama"},{"key":"e_1_3_2_1_42_1","volume-title":"Conference on Neural Information Processing Systems.","author":"Yao Zhewei","year":"2022","unstructured":"Zhewei Yao, Reza Yazdani Aminabadi, Minjia Zhang, Xiaoxia Wu, Conglong Li, and Yuxiong He. 2022. ZeroQuant: Efficient and affordable post-training quantization for large-scale transformers. In Conference on Neural Information Processing Systems."},{"key":"e_1_3_2_1_43_1","unstructured":"Zhiqiang Yuan Yiling Lou Mingwei Liu Shiji Ding Kaixin Wang Yixuan Chen and Xin Peng. 2023. No more manual tests? Evaluating and improving ChatGPT for unit test generation. arXiv preprint arXiv:2305.04207."},{"key":"e_1_3_2_1_44_1","volume-title":"International Conference on Software Engineering.","author":"Zhang Jiyang","year":"2025","unstructured":"Jiyang Zhang, Yu Liu, Pengyu Nie, Junyi Jessy Li, and Milos Gligoric. 2025. exLong: Generating exceptional behavior tests with large language models. In International Conference on Software Engineering."}],"event":{"name":"FSE Companion '25: 33rd ACM International Conference on the Foundations of Software Engineering","location":"Clarion Hotel Trondheim Trondheim Norway","acronym":"FSE Companion '25","sponsor":["SIGSOFT ACM Special Interest Group on Software Engineering"]},"container-title":["Proceedings of the 33rd ACM International Conference on the Foundations of Software Engineering"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3696630.3728608","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,28]],"date-time":"2025-07-28T19:08:33Z","timestamp":1753729713000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3696630.3728608"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,23]]},"references-count":44,"alternative-id":["10.1145\/3696630.3728608","10.1145\/3696630"],"URL":"https:\/\/doi.org\/10.1145\/3696630.3728608","relation":{},"subject":[],"published":{"date-parts":[[2025,6,23]]},"assertion":[{"value":"2025-07-28","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}