{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,20]],"date-time":"2026-02-20T15:40:38Z","timestamp":1771602038771,"version":"3.50.1"},"reference-count":60,"publisher":"Association for Computing Machinery (ACM)","issue":"ISSTA","license":[{"start":{"date-parts":[[2025,6,22]],"date-time":"2025-06-22T00:00:00Z","timestamp":1750550400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001711","name":"Swiss National Science Foundation","doi-asserted-by":"crossref","award":["200021_215487"],"award-info":[{"award-number":["200021_215487"]}],"id":[{"id":"10.13039\/501100001711","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100000001","name":"NSF","doi-asserted-by":"publisher","award":["CNS-2120070"],"award-info":[{"award-number":["CNS-2120070"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000185","name":"DARPA","doi-asserted-by":"crossref","award":["FA8750-20-C-0226"],"award-info":[{"award-number":["FA8750-20-C-0226"]}],"id":[{"id":"10.13039\/100000185","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. ACM Softw. Eng."],"published-print":{"date-parts":[[2025,6,22]]},"abstract":"<jats:p>This paper presents Tratto, a neuro-symbolic approach that generates assertions (boolean expressions) that can serve as axiomatic oracles, from source code and documentation. The symbolic module of Tratto takes advantage of the grammar of the programming language, the unit under test, and the context of the unit (its class and available APIs) to restrict the search space of the tokens that can be successfully used to generate valid oracles. The neural module of Tratto uses transformers fine-tuned for both deciding whether to output an oracle or not and selecting the next lexical token to incrementally build the oracle from the set of tokens returned by the symbolic module. Our experiments show that Tratto outperforms the state-of-the-art axiomatic oracle generation approaches, with 73% accuracy, 72% precision, and 61% F1-score, largely higher than the best results of the symbolic and neural approaches considered in our study (61%, 62%, and 37%, respectively). Tratto can generate three times more axiomatic oracles than current symbolic approaches, while generating 10 times less false positives than GPT4 complemented with few-shot learning and Chain-of-Thought prompting.<\/jats:p>","DOI":"10.1145\/3728960","type":"journal-article","created":{"date-parts":[[2025,6,22]],"date-time":"2025-06-22T10:52:56Z","timestamp":1750589576000},"page":"1887-1909","source":"Crossref","is-referenced-by-count":3,"title":["Tratto: A Neuro-Symbolic Approach to Deriving Axiomatic Test Oracles"],"prefix":"10.1145","volume":"2","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3995-8529","authenticated-orcid":false,"given":"Davide","family":"Molinelli","sequence":"first","affiliation":[{"name":"Constructor Institute, Schaffhausen, Switzerland"},{"name":"Universit\u00e0 della Svizzera italiana, Lugano, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5501-9225","authenticated-orcid":false,"given":"Alberto","family":"Martin-Lopez","sequence":"additional","affiliation":[{"name":"Universit\u00e0 della Svizzera italiana, Lugano, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-3071-0480","authenticated-orcid":false,"given":"Elliott","family":"Zackrone","sequence":"additional","affiliation":[{"name":"University of Washington, Seattle, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6824-2765","authenticated-orcid":false,"given":"Beyza","family":"Eken","sequence":"additional","affiliation":[{"name":"Universit\u00e0 della Svizzera italiana, Lugano, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9379-277X","authenticated-orcid":false,"given":"Michael D.","family":"Ernst","sequence":"additional","affiliation":[{"name":"University of Washington, Seattle, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5193-7379","authenticated-orcid":false,"given":"Mauro","family":"Pezz\u00e8","sequence":"additional","affiliation":[{"name":"Constructor Institute, Schaffhausen, Switzerland"},{"name":"Universit\u00e0 della Svizzera italiana, Lugano, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2025,6,22]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"[n.d.]. Dataset of procedure specifications by Blasi et al.. https:\/\/github.com\/albertogoffi\/toradocu\/tree\/master\/src\/test\/resources\/goal-output"},{"key":"e_1_2_1_2_1","unstructured":"Anonymous. 2025. [Replication Package] Tratto: A Neuro-Symbolic Approach to Deriving Axiomatic Test Oracles. https:\/\/anonymous.4open.science\/r\/tratto-replication-package-31F6"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.825766"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2014.2372785"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3540250.3558968"},{"key":"e_1_2_1_6_1","volume-title":"Proceedings of the International Symposium on Software Testing and Analysis (ISSTA \u201918)","author":"Blasi Arianna","year":"2018","unstructured":"Arianna Blasi, Alberto Goffi, Konstantin Kuznetsov, Alessandra Gorla, Michael D. Ernst, Mauro Pezz\u00e8, and Sergio Delgado Castellanos. 2018. Translating Code Comments to Procedure Specifications. In Proceedings of the International Symposium on Software Testing and Analysis (ISSTA \u201918). ACM."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3551349.3556961"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2021.111041"},{"key":"e_1_2_1_9_1","volume-title":"Proceedings of the ACM on Programming Languages, 7, POPL","author":"Cambronero Jos\u00e9","year":"2023","unstructured":"Jos\u00e9 Cambronero, Sumit Gulwani, Vu Le, Daniel Perelman, Arjun Radhakrishna, Clint Simon, and Ashish Tiwari. 2023. FlashFill++: Scaling programming by example by cutting to the chase. Proceedings of the ACM on Programming Languages, 7, POPL (2023), 952\u2013981."},{"key":"e_1_2_1_10_1","unstructured":"T. Y. Chen S. C. Cheung and S. M. Yiu. 1998. Metamorphic testing: A new approach for generating next test cases. HKUST Department of Computer Science Hong Kong."},{"key":"e_1_2_1_11_1","doi-asserted-by":"crossref","unstructured":"Betty HC Cheng and Joanne M Atlee. 2007. Research directions in requirements engineering. Future of software engineering (FOSE\u201907) 285\u2013303.","DOI":"10.1109\/FOSE.2007.17"},{"key":"e_1_2_1_12_1","volume-title":"Proceedings of the European Conference on Object-Oriented Programming (ECOOP \u201902)","author":"Cheon Yoonsik","unstructured":"Yoonsik Cheon and Gary T. Leavens. 2002. A Simple and Practical Approach to Unit Testing: The JML and JUnit Way. In Proceedings of the European Conference on Object-Oriented Programming (ECOOP \u201902). 231\u2013255."},{"key":"e_1_2_1_13_1","volume-title":"ECOOP 2002 \u2014 Object-Oriented Programming, 16th European Conference","author":"Cheon Yoonsik","unstructured":"Yoonsik Cheon and Gary T. Leavens. 2002. A simple and practical approach to unit testing: The JML and JUnit way. In ECOOP 2002 \u2014 Object-Oriented Programming, 16th European Conference. M\u00e1laga, Spain. 231\u2013255."},{"key":"e_1_2_1_14_1","volume-title":"ICFP 2000: Proceedings of the fifth ACM SIGPLAN International Conference on Functional Programming","author":"Claessen Koen","year":"2000","unstructured":"Koen Claessen and John Hughes. 2000. QuickCheck: A lightweight tool for random testing of Haskell programs. In ICFP 2000: Proceedings of the fifth ACM SIGPLAN International Conference on Functional Programming. Montreal, Canada. 268\u2013279."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/2931037.2948707"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2009.28"},{"key":"e_1_2_1_17_1","volume-title":"Proceedings of the International Conference on Software Engineering (ICSE \u201908)","author":"Csallner Christoph","year":"2008","unstructured":"Christoph Csallner, Nikolai Tillmann, and Yannis Smaragdakis. 2008. DySy: Dynamic Symbolic Execution for Invariant Inference. In Proceedings of the International Conference on Software Engineering (ICSE \u201908). ACM, 281\u2013290."},{"key":"e_1_2_1_18_1","volume-title":"Proceedings of the Conference on Software Development Tools, Techniques, and Alternatives (SOFTAIR \u201985)","author":"Day J. D.","unstructured":"J. D. Day and J. D. Gannon. 1985. A Test Oracle Based on Formal Specifications. In Proceedings of the Conference on Software Development Tools, Techniques, and Alternatives (SOFTAIR \u201985). 126\u2013130."},{"key":"e_1_2_1_19_1","volume-title":"TOGA: A Neural Method for Test Oracle Generation. In ICSE","author":"Dinella Elizabeth","year":"2022","unstructured":"Elizabeth Dinella, Gabriel Ryan, Todd Mytkowicz, and Shuvendu Lahiri. 2022. TOGA: A Neural Method for Test Oracle Generation. In ICSE 2022. https:\/\/www.microsoft.com\/en-us\/research\/publication\/toga-a-neural-method-for-test-oracle-generation\/"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.scico.2007.01.015"},{"key":"e_1_2_1_21_1","unstructured":"Roy Thomas Fielding. 2000. Architectural Styles and the Design of Network-based Software Architectures. Ph. D. Dissertation. isbn:0-599-87118-0"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/263244.263267"},{"key":"e_1_2_1_23_1","unstructured":"Apache Software Foundation. 2023. Apache Commons Collections: The Apache Commons Collections Library. https:\/\/commons.apache.org\/proper\/commons-collections\/ Accessed: 2024-06-07"},{"key":"e_1_2_1_24_1","unstructured":"Apache Software Foundation. 2023. Apache Commons Math: The Apache Commons Mathematics Library. https:\/\/commons.apache.org\/proper\/commons-math\/ Accessed: 2024-06-07"},{"key":"e_1_2_1_25_1","volume-title":"Proceedings of the European Software Engineering Conference held jointly with the ACM SIGSOFT International Symposium on Foundations of Software Engineering (ESEC\/FSE \u201911)","author":"Fraser Gordon","year":"2011","unstructured":"Gordon Fraser and Andrea Arcuri. 2011. EvoSuite: Automatic Test Suite Generation for Object-Oriented Software. In Proceedings of the European Software Engineering Conference held jointly with the ACM SIGSOFT International Symposium on Foundations of Software Engineering (ESEC\/FSE \u201911). ACM, 416\u2013419."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2012.14"},{"key":"e_1_2_1_27_1","volume-title":"Proceedings of the International Symposium on Software Testing and Analysis (ISSTA \u201916)","author":"Goffi Alberto","year":"2016","unstructured":"Alberto Goffi, Alessandra Gorla, Michael D. Ernst, and Mauro Pezz\u00e8. 2016. Automatic Generation of Oracles for Exceptional Behaviors. In Proceedings of the International Symposium on Software Testing and Analysis (ISSTA \u201916). ACM, 213\u2013224."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3611643.3616265"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2010.62"},{"key":"e_1_2_1_30_1","volume-title":"Proceedings of the International Symposium on Software Testing and Analysis (ISSTA \u201914)","author":"Just Ren\u00e9","unstructured":"Ren\u00e9 Just, Darioush Jalali, and Michael D. Ernst. 2014. Defects4J: A Database of Existing Faults to Enable Controlled Testing Studies for Java Programs. In Proceedings of the International Symposium on Software Testing and Analysis (ISSTA \u201914). ACM, 437\u2013440."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSEA.2009.26"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE43902.2021.00026"},{"key":"e_1_2_1_33_1","volume-title":"A brief account of runtime verification. The journal of logic and algebraic programming, 78, 5","author":"Leucker Martin","year":"2009","unstructured":"Martin Leucker and Christian Schallhart. 2009. A brief account of runtime verification. The journal of logic and algebraic programming, 78, 5 (2009), 293\u2013303."},{"key":"e_1_2_1_34_1","unstructured":"Anton Lozhkov Raymond Li Loubna Ben Allal Federico Cassano Joel Lamy-Poirier Nouamane Tazi Ao Tang Dmytro Pykhtar Jiawei Liu Yuxiang Wei Tianyang Liu Max Tian Denis Kocetkov Arthur Zucker Younes Belkada Zijian Wang Qian Liu Dmitry Abulkhanov Indraneil Paul Zhuang Li Wen-Ding Li Megan Risdal Jia Li Jian Zhu Terry Yue Zhuo Evgenii Zheltonozhskii Nii Osae Osae Dade Wenhao Yu Lucas Krau\u00df Naman Jain Yixuan Su Xuanli He Manan Dey Edoardo Abati Yekun Chai Niklas Muennighoff Xiangru Tang Muhtasham Oblokulov Christopher Akiki Marc Marone Chenghao Mou Mayank Mishra Alex Gu Binyuan Hui Tri Dao Armel Zebaze Olivier Dehaene Nicolas Patry Canwen Xu Julian McAuley Han Hu Torsten Scholak Sebastien Paquet Jennifer Robinson Carolyn Jane Anderson Nicolas Chapados Mostofa Patwary Nima Tajbakhsh Yacine Jernite Carlos Mu\u00f1oz Ferrandis Lingming Zhang Sean Hughes Thomas Wolf Arjun Guha Leandro von Werra and Harm de Vries. 2024. StarCoder 2 and The Stack v2: The Next Generation. arxiv:2402.19173. arxiv:2402.19173"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2022.3183297"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF02295996"},{"key":"e_1_2_1_37_1","volume-title":"2021 IEEE\/ACM 43rd International Conference on Software Engineering (ICSE). 1223\u20131235","author":"Molina Facundo","year":"2021","unstructured":"Facundo Molina, Pablo Ponzio, Nazareno Aguirre, and Marcelo Frias. 2021. EvoSpex: An evolutionary algorithm for learning postconditions. In 2021 IEEE\/ACM 43rd International Conference on Software Engineering (ICSE). 1223\u20131235."},{"key":"e_1_2_1_38_1","unstructured":"OpenAI. 2023. ChatGPT: An AI Language Model. https:\/\/www.openai.com\/chatgpt Accessed: 2024-06-07"},{"key":"e_1_2_1_39_1","unstructured":"OpenAI. 2023. GPT-4 Technical Report. CoRR abs\/2303.08774 (2023) https:\/\/doi.org\/10.48550\/ARXIV.2303.08774 arXiv:2303.08774. 10.48550\/ARXIV.2303.08774"},{"key":"e_1_2_1_40_1","unstructured":"OpenAI. 2024. GPT-4 | OpenAI. https:\/\/openai.com\/index\/gpt-4\/ Accessed: 2024-10-07"},{"key":"e_1_2_1_41_1","volume-title":"Proceedings of the International Conference on Software Engineering (ICSE \u201907)","author":"Pacheco Carlos","year":"2007","unstructured":"Carlos Pacheco, Shuvendu K. Lahiri, Michael D. Ernst, and Thomas Ball. 2007. Feedback-Directed Random Test Generation. In Proceedings of the International Conference on Software Engineering (ICSE \u201907). ACM, 75\u201384."},{"key":"e_1_2_1_42_1","volume-title":"2012 34th international conference on software engineering (ICSE). 815\u2013825","author":"Pandita Rahul","year":"2012","unstructured":"Rahul Pandita, Xusheng Xiao, Hao Zhong, Tao Xie, Stephen Oney, and Amit Paradkar. 2012. Inferring method specifications from natural language API descriptions. In 2012 34th international conference on software engineering (ICSE). 815\u2013825."},{"key":"e_1_2_1_43_1","volume-title":"International Conference on Learning Representations.","author":"Parisotto Emilio","year":"2016","unstructured":"Emilio Parisotto, Abdel-rahman Mohamed, Rishabh Singh, Lihong Li, Dengyong Zhou, and Pushmeet Kohli. 2016. Neuro-symbolic program synthesis. In International Conference on Learning Representations."},{"key":"e_1_2_1_44_1","article-title":"Using test oracles generated from program documentation","volume":"24","author":"Peters Dennis K.","year":"1998","unstructured":"Dennis K. Peters and David Lorge Parnas. 1998. Using test oracles generated from program documentation. IEEE Transactions on Software Engineering, 24, 3 (1998), 3, 161\u2013173.","journal-title":"IEEE Transactions on Software Engineering"},{"key":"e_1_2_1_45_1","volume-title":"Advances in Computers. 95","author":"Pezz\u00e8 Mauro","unstructured":"Mauro Pezz\u00e8 and Cheng Zhang. 2015. Automated Test Oracles: A Survey. In Advances in Computers. 95, Elsevier, 1\u201348."},{"key":"e_1_2_1_46_1","volume-title":"RESTful Web APIs. O\u2019Reilly Media","author":"Richardson Leonard","unstructured":"Leonard Richardson, Mike Amundsen, and Sam Ruby. 2013. RESTful Web APIs. O\u2019Reilly Media, Inc.. isbn:1449358063, 9781449358068"},{"key":"e_1_2_1_47_1","unstructured":"Baptiste Rozi\u00e8re Jonas Gehring Fabian Gloeckle Sten Sootla Itai Gat Xiaoqing Ellen Tan Yossi Adi Jingyu Liu Romain Sauvestre Tal Remez J\u00e9r\u00e9my Rapin Artyom Kozhevnikov Ivan Evtimov Joanna Bitton Manish Bhatt Cristian Canton Ferrer Aaron Grattafiori Wenhan Xiong Alexandre D\u00e9fossez Jade Copet Faisal Azhar Hugo Touvron Louis Martin Nicolas Usunier Thomas Scialom and Gabriel Synnaeve. 2024. Code Llama: Open Foundation Models for Code. arxiv:2308.12950. arxiv:2308.12950"},{"key":"e_1_2_1_48_1","volume-title":"Theory-infected: Or how I learned to stop worrying and love universal quantification. In OOPSLA Companion: Object-Oriented Programming Systems, Languages, and Applications. Montreal, Canada. 846\u2013847.","author":"Saff David","year":"2007","unstructured":"David Saff. 2007. Theory-infected: Or how I learned to stop worrying and love universal quantification. In OOPSLA Companion: Object-Oriented Programming Systems, Languages, and Applications. Montreal, Canada. 846\u2013847."},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1109\/MSR52588.2021.00045"},{"key":"e_1_2_1_50_1","volume-title":"Proceedings of the International Conference on Software Testing, Verification and Validation (ICST \u201912)","author":"Tan Shin Hwei","unstructured":"Shin Hwei Tan, Darko Marinov, Lin Tan, and Gary T. Leavens. 2012. @tComment: Testing Javadoc Comments to Detect Comment-Code Inconsistencies. In Proceedings of the International Conference on Software Testing, Verification and Validation (ICST \u201912). IEEE Computer Society, 260\u2013269."},{"key":"e_1_2_1_51_1","volume-title":"Bin Ni, Kathy Korevec, Kelly Schaefer, and Scott Huffman.","author":"Team CodeGemma","year":"2024","unstructured":"CodeGemma Team, Heri Zhao, Jeffrey Hui, Joshua Howland, Nam Nguyen, Siqi Zuo, Andrea Hu, Christopher A. Choquette-Choo, Jingyue Shen, Joe Kelley, Kshitij Bansal, Luke Vilnis, Mateo Wirth, Paul Michel, Peter Choy, Pratik Joshi, Ravin Kumar, Sarmad Hashmi, Shubham Agrawal, Zhitao Gong, Jane Fine, Tris Warkentin, Ale Jakse Hartman, Bin Ni, Kathy Korevec, Kelly Schaefer, and Scott Huffman. 2024. CodeGemma: Open Code Models Based on Gemma. arxiv:2406.11409. arxiv:2406.11409"},{"key":"e_1_2_1_52_1","volume-title":"Proceedings of the Joint Meeting on Foundations of Software Engineering (ESEC\/FSE \u201920)","author":"Terragni Valerio","year":"2020","unstructured":"Valerio Terragni, Gunel Jahangirova, Paolo Tonella, and Mauro Pezz\u00e8. 2020. Evolutionary Improvement of Assertion Oracles. In Proceedings of the Joint Meeting on Foundations of Software Engineering (ESEC\/FSE \u201920). ACM, 1178\u20131189."},{"key":"e_1_2_1_53_1","volume-title":"ESEC\/FSE 2005: Proceedings of the 10th European Software Engineering Conference and the 13th ACM SIGSOFT Symposium on the Foundations of Software Engineering. Lisbon, Portugal. 253\u2013262.","author":"Tillmann Nikolai","unstructured":"Nikolai Tillmann and Wolfram Schulte. 2005. Parameterized unit tests. In ESEC\/FSE 2005: Proceedings of the 10th European Software Engineering Conference and the 13th ACM SIGSOFT Symposium on the Foundations of Software Engineering. Lisbon, Portugal. 253\u2013262."},{"key":"e_1_2_1_54_1","volume-title":"Shao Kun Deng, and Neel Sundaresan","author":"Tufano Michele","year":"2021","unstructured":"Michele Tufano, Dawn Drain, Alexey Svyatkovskiy, Shao Kun Deng, and Neel Sundaresan. 2021. Unit Test Case Generation with Transformers and Focal Context. arxiv:2009.05617."},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/3524481.3527220"},{"key":"e_1_2_1_56_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3280987","article-title":"Oracles for testing software timeliness with uncertainty","volume":"28","author":"Wang Chunhui","year":"2018","unstructured":"Chunhui Wang, Fabrizio Pastore, and Lionel Briand. 2018. Oracles for testing software timeliness with uncertainty. ACM Transactions on Software Engineering and Methodology (TOSEM), 28, 1 (2018), 1\u201330.","journal-title":"ACM Transactions on Software Engineering and Methodology (TOSEM)"},{"key":"e_1_2_1_57_1","volume-title":"Formal Techniques for Networked and Distributed Systems \u2013 FORTE","author":"Wang Xin","year":"2004","unstructured":"Xin Wang, Ji Wang, and Zhi-Chang Qi. 2004. Automatic Generation of Run-Time Test Oracles for Distributed Real-Time Systems. In Formal Techniques for Networked and Distributed Systems \u2013 FORTE 2004, David de Frutos-Escrig and Manuel N\u00fa\u00f1ez (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg. 199\u2013212."},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/3386252"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/3377811.3380429"},{"key":"e_1_2_1_60_1","volume-title":"Fei Xia, Ed Chi, Quoc V Le, and Denny Zhou.","author":"Wei Jason","year":"2022","unstructured":"Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, brian ichter, Fei Xia, Ed Chi, Quoc V Le, and Denny Zhou. 2022. Chain-of-Thought Prompting Elicits Reasoning in Large Language Models. In Advances in Neural Information Processing Systems, S. Koyejo, S. Mohamed, A. Agarwal, D. Belgrave, K. Cho, and A. Oh (Eds.). 35, Curran Associates, Inc., 24824\u201324837. https:\/\/proceedings.neurips.cc\/paper_files\/paper\/2022\/file\/9d5609613524ecf4f15af0f7b31abca4-Paper-Conference.pdf"}],"container-title":["Proceedings of the ACM on Software Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3728960","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3728960","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,16]],"date-time":"2025-07-16T16:47:17Z","timestamp":1752684437000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3728960"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,22]]},"references-count":60,"journal-issue":{"issue":"ISSTA","published-print":{"date-parts":[[2025,6,22]]}},"alternative-id":["10.1145\/3728960"],"URL":"https:\/\/doi.org\/10.1145\/3728960","relation":{},"ISSN":["2994-970X"],"issn-type":[{"value":"2994-970X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,6,22]]}}}