{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,29]],"date-time":"2025-12-29T18:45:39Z","timestamp":1767033939667,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":38,"publisher":"ACM","license":[{"start":{"date-parts":[[2023,12,4]],"date-time":"2023-12-04T00:00:00Z","timestamp":1701648000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,12,4]]},"DOI":"10.1145\/3617574.3622747","type":"proceedings-article","created":{"date-parts":[[2023,12,1]],"date-time":"2023-12-01T03:26:25Z","timestamp":1701401185000},"page":"1-5","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["Rule-Based Testing of Neural Networks"],"prefix":"10.1145","author":[{"given":"Muhammad","family":"Usman","sequence":"first","affiliation":[{"name":"University of Texas, Austin, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Youcheng","family":"Sun","sequence":"additional","affiliation":[{"name":"University of Manchester, Manchester, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Divya","family":"Gopinath","sequence":"additional","affiliation":[{"name":"KBR @ NASA Ames Research Center, Mountain View, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Corina S.","family":"P\u0103s\u0103reanu","sequence":"additional","affiliation":[{"name":"KBR @ NASA Ames Research Center, Mountain View, USA \/ Carnegie Mellon University, Mountain View, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2023,12,4]]},"reference":[{"key":"e_1_3_2_1_1_1","unstructured":"2016. Google Auto Waymo Disengagement Report for Autonomous Driving.. https:\/\/www.dmv.ca.gov\/portal\/wcm\/connect\/946b3502-c959-4e3b-b119-91319c27788f\/GoogleAutoWaymo_disengage_report_2016.pdf?MOD=AJPERES \t\t\t\t  2016. Google Auto Waymo Disengagement Report for Autonomous Driving.. https:\/\/www.dmv.ca.gov\/portal\/wcm\/connect\/946b3502-c959-4e3b-b119-91319c27788f\/GoogleAutoWaymo_disengage_report_2016.pdf?MOD=AJPERES"},{"key":"e_1_3_2_1_2_1","unstructured":"2016. Google\u2019s Self-Driving Car Caused Its First Crash.. https:\/\/www.wired.com\/2016\/02\/googles-self-driving-car-may-caused-first-crash\/ \t\t\t\t  2016. Google\u2019s Self-Driving Car Caused Its First Crash.. https:\/\/www.wired.com\/2016\/02\/googles-self-driving-car-may-caused-first-crash\/"},{"key":"e_1_3_2_1_3_1","unstructured":"2016. Who\u2019s responsible when an autonomous car crashes? http:\/\/money.cnn.com\/2016\/07\/07\/technology\/tesla-liability-risk\/index.html \t\t\t\t  2016. Who\u2019s responsible when an autonomous car crashes? http:\/\/money.cnn.com\/2016\/07\/07\/technology\/tesla-liability-risk\/index.html"},{"key":"e_1_3_2_1_4_1","unstructured":"2017. Inside Waymo\u2019s Secret World for Training Self-Driving Cars.. https:\/\/www.theatlantic.com\/technology\/archive\/2017\/08\/inside-waymos-secret-testing-and-simulation-facilities\/537648\/ \t\t\t\t  2017. Inside Waymo\u2019s Secret World for Training Self-Driving Cars.. https:\/\/www.theatlantic.com\/technology\/archive\/2017\/08\/inside-waymos-secret-testing-and-simulation-facilities\/537648\/"},{"key":"e_1_3_2_1_5_1","volume-title":"Progress Towards the Assurance of Non - Traditional Software. The Twenty-fifth Safety-Critical Systems Symposium.","author":"Ashmore Rob","year":"2017","unstructured":"Rob Ashmore and Elizabeth Lennon . 2017 . Progress Towards the Assurance of Non - Traditional Software. The Twenty-fifth Safety-Critical Systems Symposium. Rob Ashmore and Elizabeth Lennon. 2017. Progress Towards the Assurance of Non - Traditional Software. The Twenty-fifth Safety-Critical Systems Symposium."},{"volume-title":"The MNIST database of handwritten digit images for machine learning research","author":"Deng Li","key":"e_1_3_2_1_6_1","unstructured":"Li Deng . 2012. The MNIST database of handwritten digit images for machine learning research . IEEE Signal Processing Magazine . Li Deng. 2012. The MNIST database of handwritten digit images for machine learning research. IEEE Signal Processing Magazine."},{"key":"e_1_3_2_1_7_1","volume-title":"Seshia","author":"Fremont Daniel J.","year":"2020","unstructured":"Daniel J. Fremont , Edward Kim , Tommaso Dreossi , Shromona Ghosh , Xiangyu Yue , Alberto L. Sangiovanni-Vincentelli , and Sanjit A . Seshia . 2020 . Scenic : A Language for Scenario Specification and Data Generation. CoRR , abs\/2010.06580 (2020). Daniel J. Fremont, Edward Kim, Tommaso Dreossi, Shromona Ghosh, Xiangyu Yue, Alberto L. Sangiovanni-Vincentelli, and Sanjit A. Seshia. 2020. Scenic: A Language for Scenario Specification and Data Generation. CoRR, abs\/2010.06580 (2020)."},{"volume-title":"Deep learning","author":"Goodfellow Ian","key":"e_1_3_2_1_8_1","unstructured":"Ian Goodfellow , Yoshua Bengio , and Aaron Courville . 2016. Deep learning . MIT press . Ian Goodfellow, Yoshua Bengio, and Aaron Courville. 2016. Deep learning. MIT press."},{"key":"e_1_3_2_1_9_1","unstructured":"Ian J. Goodfellow Jonathon Shlens and Christian Szegedy. 2014. Explaining and Harnessing Adversarial Examples. arxiv:1412.6572 \t\t\t\t  Ian J. Goodfellow Jonathon Shlens and Christian Szegedy. 2014. Explaining and Harnessing Adversarial Examples. arxiv:1412.6572"},{"key":"e_1_3_2_1_10_1","unstructured":"Ian J. Goodfellow Jonathon Shlens and Christian Szegedy. 2014. Explaining and Harnessing Adversarial Examples. arxiv:1412.6572 \t\t\t\t  Ian J. Goodfellow Jonathon Shlens and Christian Szegedy. 2014. Explaining and Harnessing Adversarial Examples. arxiv:1412.6572"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.2019.00079"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISSRE.2019.00039"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2019.2909068"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3236024.3264835"},{"key":"e_1_3_2_1_15_1","volume-title":"Synthetic Data for Text Localisation in Natural Images. In 2016 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2016","author":"Gupta Ankush","year":"2016","unstructured":"Ankush Gupta , Andrea Vedaldi , and Andrew Zisserman . 2016 . Synthetic Data for Text Localisation in Natural Images. In 2016 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2016 , Las Vegas, NV, USA , June 27-30, 2016. Ankush Gupta, Andrea Vedaldi, and Andrew Zisserman. 2016. Synthetic Data for Text Localisation in Natural Images. In 2016 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2016, Las Vegas, NV, USA, June 27-30, 2016."},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cosrev.2020.100270"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"crossref","unstructured":"Xiaowei Huang Marta Kwiatkowska Sen Wang and Min Wu. 2017. Safety verification of deep neural networks. In CAV. \t\t\t\t  Xiaowei Huang Marta Kwiatkowska Sen Wang and Min Wu. 2017. Safety verification of deep neural networks. In CAV.","DOI":"10.1007\/978-3-319-63387-9_1"},{"key":"e_1_3_2_1_18_1","volume-title":"Synthetic Data and Artificial Neural Networks for Natural Scene Text Recognition. CoRR, abs\/1406.2227","author":"Jaderberg Max","year":"2014","unstructured":"Max Jaderberg , Karen Simonyan , Andrea Vedaldi , and Andrew Zisserman . 2014. Synthetic Data and Artificial Neural Networks for Natural Scene Text Recognition. CoRR, abs\/1406.2227 ( 2014 ). Max Jaderberg, Karen Simonyan, Andrea Vedaldi, and Andrew Zisserman. 2014. Synthetic Data and Artificial Neural Networks for Natural Scene Text Recognition. CoRR, abs\/1406.2227 (2014)."},{"key":"e_1_3_2_1_19_1","volume-title":"Sharath Nittur Sridhar, and Ram Vasudevan","author":"Johnson-Roberson Matthew","year":"2016","unstructured":"Matthew Johnson-Roberson , Charles Barto , Rounak Mehta , Sharath Nittur Sridhar, and Ram Vasudevan . 2016 . Driving in the Matrix : Can Virtual Worlds Replace Human-Generated Annotations for Real World Tasks? CoRR , abs\/1610.01983 (2016). Matthew Johnson-Roberson, Charles Barto, Rounak Mehta, Sharath Nittur Sridhar, and Ram Vasudevan. 2016. Driving in the Matrix: Can Virtual Worlds Replace Human-Generated Annotations for Real World Tasks? CoRR, abs\/1610.01983 (2016)."},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-25540-4_26"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2019.00108"},{"key":"e_1_3_2_1_22_1","unstructured":"Alex Krizhevsky and Geoffrey Hinton. 2009. Learning multiple layers of features from tiny images. \t\t\t\t  Alex Krizhevsky and Geoffrey Hinton. 2009. Learning multiple layers of features from tiny images."},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3395363.3397346"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-32304-2_15"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3238147.3238202"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISSRE.2018.00021"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3377811.3380363"},{"key":"e_1_3_2_1_28_1","volume-title":"International Conference on Machine Learning. 4901\u20134911","author":"Odena Augustus","year":"2019","unstructured":"Augustus Odena , Catherine Olsson , David Andersen , and Ian Goodfellow . 2019 . Tensorfuzz: Debugging neural networks with coverage-guided fuzzing . In International Conference on Machine Learning. 4901\u20134911 . Augustus Odena, Catherine Olsson, David Andersen, and Ian Goodfellow. 2019. Tensorfuzz: Debugging neural networks with coverage-guided fuzzing. In International Conference on Machine Learning. 4901\u20134911."},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"crossref","unstructured":"Nicolas Papernot Patrick D. McDaniel Ian J. Goodfellow Somesh Jha Z. Berkay Celik and Ananthram Swami. 2016. Practical Black-Box Attacks against Deep Learning Systems using Adversarial Examples. CoRR. \t\t\t\t  Nicolas Papernot Patrick D. McDaniel Ian J. Goodfellow Somesh Jha Z. Berkay Celik and Ananthram Swami. 2016. Practical Black-Box Attacks against Deep Learning Systems using Adversarial Examples. CoRR.","DOI":"10.1145\/3052973.3053009"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/3132747.3132785"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3358233"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3238147.3238172"},{"key":"e_1_3_2_1_33_1","volume-title":"DeepTest: Automated Testing of Deep-Neural-Network-driven Autonomous Cars. CoRR, abs\/1708.08559","author":"Tian Yuchi","year":"2017","unstructured":"Yuchi Tian , Kexin Pei , Suman Jana , and Baishakhi Ray . 2017. DeepTest: Automated Testing of Deep-Neural-Network-driven Autonomous Cars. CoRR, abs\/1708.08559 ( 2017 ). Yuchi Tian, Kexin Pei, Suman Jana, and Baishakhi Ray. 2017. DeepTest: Automated Testing of Deep-Neural-Network-driven Autonomous Cars. CoRR, abs\/1708.08559 (2017)."},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"crossref","unstructured":"Cumhur Erkan Tuncali Georgios Fainekos Hisahiro Ito and James Kapinski. 2018. Simulation-based Adversarial Test Generation for Autonomous Vehicles with Machine Learning Components. CoRR. \t\t\t\t  Cumhur Erkan Tuncali Georgios Fainekos Hisahiro Ito and James Kapinski. 2018. Simulation-based Adversarial Test Generation for Autonomous Vehicles with Machine Learning Components. CoRR.","DOI":"10.1109\/IVS.2018.8500421"},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE43902.2021.00046"},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-89960-2_22"},{"key":"e_1_3_2_1_37_1","unstructured":"Xiaofei Xie Lei Ma Felix Juefei-Xu Hongxu Chen Minhui Xue Bo Li Yang Liu Jianjun Zhao Jianxiong Yin and Simon See. 2018. DeepHunter: Hunting deep neural network defects via coverage-guided fuzzing. arXiv preprint arXiv:1809.01266. \t\t\t\t  Xiaofei Xie Lei Ma Felix Juefei-Xu Hongxu Chen Minhui Xue Bo Li Yang Liu Jianjun Zhao Jianxiong Yin and Simon See. 2018. DeepHunter: Hunting deep neural network defects via coverage-guided fuzzing. arXiv preprint arXiv:1809.01266."},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3238147.3238187"}],"event":{"name":"SE4SafeML '23: 1st International Workshop on Dependability and Trustworthiness of Safety-Critical Systems with Machine Learned Components","sponsor":["SIGSOFT ACM Special Interest Group on Software Engineering"],"location":"San Francisco CA USA","acronym":"SE4SafeML '23"},"container-title":["Proceedings of the 1st International Workshop on Dependability and Trustworthiness of Safety-Critical Systems with Machine Learned Components"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3617574.3622747","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:45:59Z","timestamp":1750178759000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3617574.3622747"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,12,4]]},"references-count":38,"alternative-id":["10.1145\/3617574.3622747","10.1145\/3617574"],"URL":"https:\/\/doi.org\/10.1145\/3617574.3622747","relation":{},"subject":[],"published":{"date-parts":[[2023,12,4]]},"assertion":[{"value":"2023-12-04","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}