{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,14]],"date-time":"2026-06-14T07:54:02Z","timestamp":1781423642838,"version":"3.54.1"},"reference-count":50,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2026,6,14]],"date-time":"2026-06-14T00:00:00Z","timestamp":1781395200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/legalcode"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["62472062, 62202079, 62132020"],"award-info":[{"award-number":["62472062, 62202079, 62132020"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100017683","name":"Dalian Science and Technology Innovation Fund","doi-asserted-by":"crossref","award":["2024JJ12GX022"],"award-info":[{"award-number":["2024JJ12GX022"]}],"id":[{"id":"10.13039\/501100017683","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Applied Basic Research Project of Liaoning Province","award":["2025JH2\/101330109"],"award-info":[{"award-number":["2025JH2\/101330109"]}]},{"DOI":"10.13039\/501100012226","name":"Fundamental Research Funds for the Central Universities","doi-asserted-by":"crossref","award":["DUT24LAB126"],"award-info":[{"award-number":["DUT24LAB126"]}],"id":[{"id":"10.13039\/501100012226","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Des. Autom. Electron. Syst."],"published-print":{"date-parts":[[2026,11,30]]},"abstract":"<jats:p>Analog circuits play a vital role in electronic design and are key in connecting digital circuits with the physical environment. Ensuring the accuracy and reliability of analog circuit simulation tools (i.e., Simulation Program with Integrated Circuit Emphasis (SPICE)) is crucial; any errors in analog circuit simulation tools may lead to defects in analog circuit design, which may cause major problems and losses in the design and production process. Due to the lack of complete and unified specifications for analog circuit design, existing simulation tool testing works face the challenge of how to generate more effective analog circuits and improve test efficiency. To overcome these challenges, we propose a new fuzz testing method called SpiceFuzz, which is the first to use training-free LLMs to generate effective and diverse SPICE netlists to test SPICE simulators. First, SpiceFuzz combines carefully constructed mutation prompts with a flow with feedback to automatically generate effective analog circuits. Then, SpiceFuzz guides mutation selection by memorizing the historical selections and their results, thereby selecting mutations that are more likely to trigger bugs for the specific analog circuits. Finally, the differential testing component compares the simulation results of generated SPICE netlists to find potential bugs in the simulators. Experimental results show that SpiceFuzz outperforms the state-of-the-art methods, in terms of the number and simulation success rate of SPICE netlists generated. Meanwhile, in one month, SpiceFuzz reports 12 discovered bugs in NgSPICE and LtSPICE, 7 of which are confirmed by the developers.<\/jats:p>","DOI":"10.1145\/3797154","type":"journal-article","created":{"date-parts":[[2026,3,9]],"date-time":"2026-03-09T21:23:51Z","timestamp":1773091431000},"page":"1-22","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["SpiceFuzz: LLM-Based Fuzzing for Spice Circuit Simulator Tools Bug Detection"],"prefix":"10.1145","volume":"31","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1511-2158","authenticated-orcid":false,"given":"Zhilei","family":"Ren","sequence":"first","affiliation":[{"name":"School of Software, Dalian University of Technology","place":["Dalian, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-5693-9693","authenticated-orcid":false,"given":"Huijiang","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Software, Dalian University of Technology","place":["Dalian, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8554-6365","authenticated-orcid":false,"given":"Shikai","family":"Guo","sequence":"additional","affiliation":[{"name":"Information Science and Technology College, Dalian Maritime University","place":["Dalian, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-8844-4040","authenticated-orcid":false,"given":"Yi","family":"Guo","sequence":"additional","affiliation":[{"name":"School of Software, Dalian University of Technology","place":["Dalian, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5068-1938","authenticated-orcid":false,"given":"Xiaochen","family":"Li","sequence":"additional","affiliation":[{"name":"School of Software, Dalian University of Technology","place":["Dalian, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8674-4948","authenticated-orcid":false,"given":"He","family":"Jiang","sequence":"additional","affiliation":[{"name":"School of Software, Dalian University of Technology","place":["Dalian, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2026,6,14]]},"reference":[{"key":"e_1_3_1_2_2","article-title":"A comprehensive study of open-source printed circuit board (PCB) design software bugs","author":"Zhao Xu","year":"2024","unstructured":"Xu Zhao, He Jiang, Shikai Guo, Dong Liu, Hui Liu, Chongyang Shi, and Xiaochen Li. 2024. A comprehensive study of open-source printed circuit board (PCB) design software bugs. IEEE Transactions on Instrumentation and Measurement 73 (2024), 1\u201316.","journal-title":"IEEE Transactions on Instrumentation and Measurement"},{"key":"e_1_3_1_3_2","doi-asserted-by":"publisher","DOI":"10.1109\/TR.2025.3529303"},{"key":"e_1_3_1_4_2","article-title":"Foreword for fuzz testing book","author":"Miller Barton","year":"2008","unstructured":"Barton Miller. 2008. Foreword for fuzz testing book. The University of Wisconsin Madison, April (2008).","journal-title":"The University of Wisconsin Madison, April"},{"key":"e_1_3_1_5_2","doi-asserted-by":"crossref","first-page":"46","DOI":"10.1007\/978-3-319-51738-4_4","volume-title":"Proceedings of the International Workshop on Design, Modeling, and Evaluation of Cyber Physical Systems","author":"Chowdhury Shafiul Azam","year":"2017","unstructured":"Shafiul Azam Chowdhury, Taylor T. Johnson, and Christoph Csallner. 2017. CyFuzz: A differential testing framework for cyber-physical systems development environments. In Proceedings of the International Workshop on Design, Modeling, and Evaluation of Cyber Physical Systems. Springer, 46\u201360."},{"key":"e_1_3_1_6_2","doi-asserted-by":"publisher","DOI":"10.1145\/3373087.3375310"},{"key":"e_1_3_1_7_2","doi-asserted-by":"publisher","DOI":"10.1145\/3705730"},{"key":"e_1_3_1_8_2","doi-asserted-by":"publisher","DOI":"10.1145\/3377811.3380381"},{"key":"e_1_3_1_9_2","unstructured":"Wayne Xin Zhao Kun Zhou Junyi Li Tianyi Tang Xiaolei Wang Yupeng Hou Yingqian Min Beichen Zhang Junjie Zhang Zican Dong et\u00a0al. 2023. A survey of large language models. arXiv:2303.18223. Retrieved from https:\/\/arxiv.org\/abs\/2303.18223"},{"key":"e_1_3_1_10_2","unstructured":"Josh Achiam Steven Adler Sandhini Agarwal Lama Ahmad Ilge Akkaya Florencia Leoni Aleman Diogo Almeida Janko Altenschmidt Sam Altman Shyamal Anadkat et\u00a0al. 2023. Gpt-4 technical report. arXiv:2303.08774. Retrieved from https:\/\/arxiv.org\/abs\/2303.08774"},{"key":"e_1_3_1_11_2","unstructured":"Ruizhe Zhong Xingbo Du Shixiong Kai Zhentao Tang Siyuan Xu Hui-Ling Zhen Jianye Hao Qiang Xu Mingxuan Yuan and Junchi Yan. 2023. Llm4eda: Emerging progress in large language models for electronic design automation. arXiv:2401.12224. Retrieved from https:\/\/arxiv.org\/abs\/2401.12224"},{"key":"e_1_3_1_12_2","first-page":"379","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence","author":"Lai Yao","year":"2025","unstructured":"Yao Lai, Sungyoung Lee, Guojin Chen, Souradip Poddar, Mengkang Hu, David Z. Pan, and Ping Luo. 2025. Analogcoder: Analog circuit design via training-free code generation. In Proceedings of the AAAI Conference on Artificial Intelligence. 379\u2013387."},{"key":"e_1_3_1_13_2","unstructured":"ngspice (regression) test circuits. Retrieved March 5 2025 from https:\/\/sourceforge.net\/p\/ngspice\/ngspice\/ci\/master\/tree\/tests\/. ([n. d.])."},{"key":"e_1_3_1_14_2","unstructured":"Inc. Analog Devices. LTspice Demo Circuits. Retrieved March 5 2025 from https:\/\/www.analog.com\/en\/resources\/design-tools-and-calculators\/ltspice-simulator\/lt-spice-demo-circuits.html. ([n. d.])."},{"key":"e_1_3_1_15_2","unstructured":"SpiceFuzz. https:\/\/github.com\/liuhuijiang\/SpiceFuzz. ([n. d.])."},{"key":"e_1_3_1_16_2","doi-asserted-by":"crossref","DOI":"10.1201\/9781003199489","volume-title":"Electronic Circuit Analysis using LTSPICE XVII Simulator: A Practical Guide for Beginners","author":"Mohindru Pooja","year":"2021","unstructured":"Pooja Mohindru and Pankaj Mohindru. 2021. Electronic Circuit Analysis using LTSPICE XVII Simulator: A Practical Guide for Beginners. CRC Press."},{"key":"e_1_3_1_17_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2023.3313989"},{"key":"e_1_3_1_18_2","doi-asserted-by":"publisher","DOI":"10.1145\/3637226"},{"key":"e_1_3_1_19_2","doi-asserted-by":"publisher","DOI":"10.5555\/1538260"},{"key":"e_1_3_1_20_2","volume-title":"SPICE (Simulation Program with Integrated Circuit Emphasis)","author":"Nagel Laurence W.","year":"1973","unstructured":"Laurence W. Nagel and D.O. Pederson. 1973. SPICE (Simulation Program with Integrated Circuit Emphasis). Technical Report UCB\/ERL M382. Retrieved from http:\/\/www2.eecs.berkeley.edu\/Pubs\/TechRpts\/1973\/22871.html"},{"key":"e_1_3_1_21_2","doi-asserted-by":"publisher","DOI":"10.1145\/3643677"},{"key":"e_1_3_1_22_2","volume-title":"SPICE2: A Computer Program to Simulate Semiconductor Circuits","author":"Nagel Laurence W.","year":"1975","unstructured":"Laurence W. Nagel. 1975. SPICE2: A Computer Program to Simulate Semiconductor Circuits. Ph.D. Dissertation. EECS Department, University of California, Berkeley. Retrieved from http:\/\/www2.eecs.berkeley.edu\/Pubs\/TechRpts\/1975\/9602.html"},{"key":"e_1_3_1_23_2","unstructured":"The Spice Home Page \u2014 bwrcs.eecs.berkeley.edu. Retrieved March 5 2025 from http:\/\/bwrcs.eecs.berkeley.edu\/Classes\/IcBook\/SPICE\/. ([n. d.])."},{"key":"e_1_3_1_24_2","unstructured":"Holger Vogt. Ngspice the open source Spice circuit simulator - Intro \u2014 ngspice.sourceforge.io. Retrieved March 5 2025 from https:\/\/ngspice.sourceforge.io\/. ([n. d.])."},{"key":"e_1_3_1_25_2","unstructured":"LTspice. Retrieved March 5 2025 from https:\/\/www.analog.com\/en\/resources\/design-tools-and-calculators\/ltspice-simulator.html. ([n. d.])."},{"key":"e_1_3_1_26_2","doi-asserted-by":"publisher","DOI":"10.5555\/528264"},{"key":"e_1_3_1_27_2","doi-asserted-by":"publisher","DOI":"10.52202\/075280-0943"},{"key":"e_1_3_1_28_2","unstructured":"Yang Liu. 2019. Fine-tune BERT for extractive summarization. arXiv:1903.10318. Retrieved from https:\/\/arxiv.org\/abs\/1903.10318"},{"key":"e_1_3_1_29_2","article-title":"Xlnet: Generalized autoregressive pretraining for language understanding","volume":"32","author":"Yang Zhilin","year":"2019","unstructured":"Zhilin Yang, Zihang Dai, Yiming Yang, Jaime Carbonell, Russ R. Salakhutdinov, and Quoc V. Le. 2019. Xlnet: Generalized autoregressive pretraining for language understanding. Advances in Neural Information Processing Systems 32 (2019), 5754\u20135764.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_1_30_2","doi-asserted-by":"publisher","DOI":"10.1145\/3611643.3617850"},{"key":"e_1_3_1_31_2","unstructured":"Daya Guo Qihao Zhu Dejian Yang Zhenda Xie Kai Dong Wentao Zhang Guanting Chen Xiao Bi Yu Wu YK Li et\u00a0al. 2024. DeepSeek-Coder: When the large language model meets programming\u2013The rise of code intelligence. arXiv:2401.14196. Retrieved from https:\/\/arxiv.org\/abs\/2401.14196"},{"key":"e_1_3_1_32_2","first-page":"1","volume-title":"Proceedings of the 2024 IEEE Physical Assurance and Inspection of Electronics.","author":"Chaudhuri Jayeeta","year":"2024","unstructured":"Jayeeta Chaudhuri, Dhruv Thapar, Arjun Chaudhuri, Farshad Firouzi, and Krishnendu Chakrabarty. 2024. Spiced: Syntactical bug and trojan pattern identification in a\/ms circuits using llm-enhanced detection. In Proceedings of the 2024 IEEE Physical Assurance and Inspection of Electronics. IEEE, 1\u20137."},{"key":"e_1_3_1_33_2","article-title":"Spiced+: Syntactical bug pattern identification and correction of trojans in a\/ms circuits using llm-enhanced detection","author":"Chaudhuri Jayeeta","year":"2025","unstructured":"Jayeeta Chaudhuri, Dhruv Thapar, Arjun Chaudhuri, Farshad Firouzi, and Krishnendu Chakrabarty. 2025. Spiced+: Syntactical bug pattern identification and correction of trojans in a\/ms circuits using llm-enhanced detection. IEEE Transactions on Very Large Scale Integration Systems 33, 4 (2025), 1118\u20131131.","journal-title":"IEEE Transactions on Very Large Scale Integration Systems"},{"key":"e_1_3_1_34_2","doi-asserted-by":"crossref","unstructured":"Qingxiu Dong Lei Li Damai Dai Ce Zheng Jingyuan Ma Rui Li Heming Xia Jingjing Xu Zhiyong Wu Baobao Chang et\u00a0al. 2024. A survey on in-context learning. In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing. 1107\u20131128.","DOI":"10.18653\/v1\/2024.emnlp-main.64"},{"key":"e_1_3_1_35_2","doi-asserted-by":"publisher","DOI":"10.1145\/3643681"},{"key":"e_1_3_1_36_2","doi-asserted-by":"publisher","DOI":"10.1145\/3649329.3657353"},{"key":"e_1_3_1_37_2","unstructured":"Theo X. Olausson Jeevana Priya Inala Chenglong Wang Jianfeng Gao and Armando Solar-Lezama. 2024. Is self-repair a silver bullet for code generation? In International Conference on Learning Representations B. Kim Y. Yue S. Chaudhuri K. Fragkiadaki M. Khan and Y. Sun (Eds.). 2024 (2024) 36545\u201336593. Retrieved from https:\/\/proceedings.iclr.cc\/paper_files\/paper\/2024\/file\/9ddc141bdbf9d1db510cefff56c586ad-Paper-Conference.pdf"},{"key":"e_1_3_1_38_2","unstructured":"Xinyun Chen Maxwell Lin Nathanael Schaerli and Denny Zhou. 2024. Teaching large language models to self-debug. In International Conference on Learning Representations B. Kim Y. Yue S. Chaudhuri K. Fragkiadaki M. Khan and Y. Sun (Eds.). 2024 (2024) 8746\u20138825. Retrieved from https:\/\/proceedings.iclr.cc\/paper_files\/paper\/2024\/file\/2460396f2d0d421885997dd1612ac56b-Paper-Conference.pdf"},{"key":"e_1_3_1_39_2","volume-title":"Proceedings of the 12th International Conference on Learning Representations","author":"Hong Sirui","year":"2023","unstructured":"Sirui Hong, Mingchen Zhuge, Jonathan Chen, Xiawu Zheng, Yuheng Cheng, Jinlin Wang, Ceyao Zhang, Zili Wang, Steven Ka Shing Yau, Zijuan Lin, et\u00a0al. 2023. MetaGPT: Meta programming for a multi-agent collaborative framework. In Proceedings of the 12th International Conference on Learning Representations."},{"key":"e_1_3_1_40_2","doi-asserted-by":"publisher","DOI":"10.1145\/3324884.3416570"},{"key":"e_1_3_1_41_2","article-title":"Actor-critic algorithms","volume":"12","author":"Konda Vijay","year":"1999","unstructured":"Vijay Konda and John Tsitsiklis. 1999. Actor-critic algorithms. Advances in Neural Information Processing Systems 12 (1999), 1008\u20131014.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_1_42_2","first-page":"1928","volume-title":"Proceedings of the 33nd International Conference on Machine Learning.","volume":"48","author":"Mnih Volodymyr","year":"2016","unstructured":"Volodymyr Mnih, Adri\u00e0 Puigdom\u00e8nech Badia, Mehdi Mirza, Alex Graves, Timothy P. Lillicrap, Tim Harley, David Silver, and Koray Kavukcuoglu. 2016. Asynchronous methods for deep reinforcement learning. In Proceedings of the 33nd International Conference on Machine Learning.Maria-Florina Balcan and Kilian Q. Weinberger (Eds.), Vol. 48, JMLR.org, 1928\u20131937. Retrieved from https:\/\/proceedings.mlr.press\/v48\/mniha16.html"},{"key":"e_1_3_1_43_2","doi-asserted-by":"crossref","unstructured":"Zhangyin Feng Daya Guo Duyu Tang Nan Duan Xiaocheng Feng Ming Gong Linjun Shou Bing Qin Ting Liu Daxin Jiang et\u00a0al. 2020. Codebert: A pre-trained model for programming and natural languages. In Findings of the Association for Computational Linguistics: EMNLP. 1536\u20131547.","DOI":"10.18653\/v1\/2020.findings-emnlp.139"},{"key":"e_1_3_1_44_2","volume-title":"Proceedings of the Soviet Physics-Doklady","author":"Lcvenshtcin VI","year":"1966","unstructured":"VI Lcvenshtcin. 1966. Binary coors capable or \u2018correcting deletions, insertions, and reversals. In Proceedings of the Soviet Physics-Doklady."},{"key":"e_1_3_1_45_2","unstructured":"Volodymyr Mnih Adria Puigdomenech Badia Mehdi Mirza Alex Graves Timothy Lillicrap Tim Harley David Silver and Koray Kavukcuoglu. 2016. Asynchronous methods for deep reinforcement learning. In International Conference on Machine Learning. PmLR 1928\u20131937."},{"key":"e_1_3_1_46_2","unstructured":"KiCad. https:\/\/www.kicad.org\/. ([n. d.])."},{"key":"e_1_3_1_47_2","first-page":"1257","volume-title":"Proceedings of the 2019 IEEE\/ACM 41st International Conference on Software Engineering","author":"Chen Yuting","year":"2019","unstructured":"Yuting Chen, Ting Su, and Zhendong Su. 2019. Deep differential testing of JVM implementations. In Proceedings of the 2019 IEEE\/ACM 41st International Conference on Software Engineering. IEEE, 1257\u20131268."},{"key":"e_1_3_1_48_2","doi-asserted-by":"publisher","DOI":"10.1145\/2908080.2908095"},{"key":"e_1_3_1_49_2","doi-asserted-by":"publisher","DOI":"10.1145\/3510003.3510059"},{"key":"e_1_3_1_50_2","first-page":"1","volume-title":"Proceedings of the 2023 60th ACM\/IEEE Design Automation Conference.","author":"Jiang He","year":"2023","unstructured":"He Jiang, Hongyi Cheng, Shikai Guo, and Xiaochen Li. 2023. Partition based differential testing for finding embedded code generation bugs in simulink. In Proceedings of the 2023 60th ACM\/IEEE Design Automation Conference. IEEE, 1\u20136."},{"key":"e_1_3_1_51_2","unstructured":"API pricing. Retrieved March 5 2025 from https:\/\/openai.com\/api\/pricing\/. ([n. d.])."}],"container-title":["ACM Transactions on Design Automation of Electronic Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3797154","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,14]],"date-time":"2026-06-14T07:51:19Z","timestamp":1781423479000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3797154"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,6,14]]},"references-count":50,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2026,11,30]]}},"alternative-id":["10.1145\/3797154"],"URL":"https:\/\/doi.org\/10.1145\/3797154","relation":{},"ISSN":["1084-4309","1557-7309"],"issn-type":[{"value":"1084-4309","type":"print"},{"value":"1557-7309","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,6,14]]},"assertion":[{"value":"2025-03-05","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-01-27","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-06-14","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}