{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:10:13Z","timestamp":1750219813154,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":42,"publisher":"ACM","license":[{"start":{"date-parts":[[2023,12,4]],"date-time":"2023-12-04T00:00:00Z","timestamp":1701648000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["2124039"],"award-info":[{"award-number":["2124039"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,12,4]]},"DOI":"10.1145\/3617574.3617862","type":"proceedings-article","created":{"date-parts":[[2023,12,1]],"date-time":"2023-12-01T03:26:25Z","timestamp":1701401185000},"page":"22-25","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["The Case for Scalable Quantitative Neural Network Analysis"],"prefix":"10.1145","author":[{"given":"Mara","family":"Downing","sequence":"first","affiliation":[{"name":"University of California at Santa Barbara, Santa Barbara, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tevfik","family":"Bultan","sequence":"additional","affiliation":[{"name":"University of California at Santa Barbara, Santa Barbara, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2023,12,4]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/TASLP.2014.2339736"},{"key":"e_1_3_2_1_2_1","unstructured":"Ron Amadeo. 2023. NYPD robocops: Hulking 400-lb robots will start patrolling New York City. https:\/\/arstechnica.com\/gadgets\/2023\/04\/nypd-robocops-hulking-400-lb-robots-will-start-patrolling-new-york-city\/ \t\t\t\t  Ron Amadeo. 2023. NYPD robocops: Hulking 400-lb robots will start patrolling New York City. https:\/\/arstechnica.com\/gadgets\/2023\/04\/nypd-robocops-hulking-400-lb-robots-will-start-patrolling-new-york-city\/"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE43902.2021.00039"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3319535.3354245"},{"key":"e_1_3_2_1_5_1","volume-title":"Davide Del Testa","author":"Bojarski Mariusz","year":"2016","unstructured":"Mariusz Bojarski , Davide Del Testa , Daniel Dworakowski, Bernhard Firner , Beat Flepp, Prasoon Goyal, Lawrence D Jackel, Mathew Monfort, Urs Muller, and Jiakai Zhang. 2016 . End to end learning for self-driving cars. arXiv preprint arXiv:1604.07316. Mariusz Bojarski, Davide Del Testa, Daniel Dworakowski, Bernhard Firner, Beat Flepp, Prasoon Goyal, Lawrence D Jackel, Mathew Monfort, Urs Muller, and Jiakai Zhang. 2016. End to end learning for self-driving cars. arXiv preprint arXiv:1604.07316."},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.33013240"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.23919\/acc.2018.8431048"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.01164"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/tpami.2017.2699184"},{"key":"e_1_3_2_1_10_1","volume-title":"Fire chief warns against \u2018unleashing","author":"Clayton Aben\u00e9","year":"2023","unstructured":"Aben\u00e9 Clayton . 2023. Fire chief warns against \u2018unleashing \u2019 self-driving taxis in San Francisco . https:\/\/www.theguardian.com\/us-news\/ 2023 \/jun\/23\/self-driving-taxis-fire-chief-san-francisco Aben\u00e9 Clayton. 2023. Fire chief warns against \u2018unleashing\u2019 self-driving taxis in San Francisco. https:\/\/www.theguardian.com\/us-news\/2023\/jun\/23\/self-driving-taxis-fire-chief-san-francisco"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/IJCNN48605.2020.9207173"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-98938-9_6"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-77935-5_9"},{"key":"e_1_3_2_1_14_1","first-page":"3","article-title":"A Dual Approach to Scalable Verification of Deep Networks","volume":"1","author":"Dvijotham Krishnamurthy","year":"2018","unstructured":"Krishnamurthy Dvijotham , Robert Stanforth , Sven Gowal , Timothy A Mann , and Pushmeet Kohli . 2018 . A Dual Approach to Scalable Verification of Deep Networks . In UAI. 1 , 3 . Krishnamurthy Dvijotham, Robert Stanforth, Sven Gowal, Timothy A Mann, and Pushmeet Kohli. 2018. A Dual Approach to Scalable Verification of Deep Networks. In UAI. 1, 3.","journal-title":"UAI."},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-68167-2_19"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/SP.2018.00058"},{"key":"e_1_3_2_1_17_1","unstructured":"Divya Gopinath Kaiyuan Wang Mengshi Zhang Corina S Pasareanu and Sarfraz Khurshid. 2018. Symbolic execution for deep neural networks. arXiv preprint arXiv:1807.10439. \t\t\t\t  Divya Gopinath Kaiyuan Wang Mengshi Zhang Corina S Pasareanu and Sarfraz Khurshid. 2018. Symbolic execution for deep neural networks. arXiv preprint arXiv:1807.10439."},{"key":"e_1_3_2_1_18_1","volume-title":"International conference on machine learning. 1764\u20131772","author":"Graves Alex","year":"2014","unstructured":"Alex Graves and Navdeep Jaitly . 2014 . Towards end-to-end speech recognition with recurrent neural networks . In International conference on machine learning. 1764\u20131772 . Alex Graves and Navdeep Jaitly. 2014. Towards end-to-end speech recognition with recurrent neural networks. In International conference on machine learning. 1764\u20131772."},{"key":"e_1_3_2_1_19_1","unstructured":"Chris Isidore. 2021. Another Tesla reportedly using Autopilot hits a parked police car. https:\/\/www.cnn.com\/2021\/08\/30\/business\/tesla-crash-police-car\/index.html \t\t\t\t  Chris Isidore. 2021. Another Tesla reportedly using Autopilot hits a parked police car. https:\/\/www.cnn.com\/2021\/08\/30\/business\/tesla-crash-police-car\/index.html"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-63387-9_5"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-25540-4_26"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3065386"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10940-011-9137-7"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE-NIER.2019.00032"},{"key":"e_1_3_2_1_25_1","unstructured":"Erin Marquis. 2023. Whistleblower Drops 100 Gigabytes of Tesla Secrets to German News Site: Report. https:\/\/jalopnik.com\/whistleblower-drops-100-gigabytes-of-tesla-secrets-to-g-1850476542 \t\t\t\t  Erin Marquis. 2023. Whistleblower Drops 100 Gigabytes of Tesla Secrets to German News Site: Report. https:\/\/jalopnik.com\/whistleblower-drops-100-gigabytes-of-tesla-secrets-to-g-1850476542"},{"key":"e_1_3_2_1_26_1","unstructured":"OpenAI. 2022. ChatGPT. https:\/\/chat.openai.com \t\t\t\t  OpenAI. 2022. ChatGPT. https:\/\/chat.openai.com"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3387939.3391594"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.91"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/MALWARE.2015.7413680"},{"key":"e_1_3_2_1_30_1","volume-title":"Deep learning in medical image analysis. Annual review of biomedical engineering, 19","author":"Shen Dinggang","year":"2017","unstructured":"Dinggang Shen , Guorong Wu , and Heung-Il Suk . 2017. Deep learning in medical image analysis. Annual review of biomedical engineering, 19 ( 2017 ), 221\u2013248. Dinggang Shen, Guorong Wu, and Heung-Il Suk. 2017. Deep learning in medical image analysis. Annual review of biomedical engineering, 19 (2017), 221\u2013248."},{"key":"e_1_3_2_1_31_1","volume-title":"Merrill","author":"Siddiqui Faiz","year":"2023","unstructured":"Faiz Siddiqui and Jeremy B . Merrill . 2023 . 17 fatalities, 736 crashes: The shocking toll of Tesla\u2019s Autopilot . https:\/\/www.washingtonpost.com\/technology\/2023\/06\/10\/tesla-autopilot-crashes-elon-musk\/ Faiz Siddiqui and Jeremy B. Merrill. 2023. 17 fatalities, 736 crashes: The shocking toll of Tesla\u2019s Autopilot. https:\/\/www.washingtonpost.com\/technology\/2023\/06\/10\/tesla-autopilot-crashes-elon-musk\/"},{"key":"e_1_3_2_1_32_1","volume-title":"International Conference on Learning Representations.","author":"Singh Gagandeep","year":"2018","unstructured":"Gagandeep Singh , Timon Gehr , Markus P\u00fcschel , and Martin Vechev . 2018 . Boosting robustness certification of neural networks . In International Conference on Learning Representations. Gagandeep Singh, Timon Gehr, Markus P\u00fcschel, and Martin Vechev. 2018. Boosting robustness certification of neural networks. In International Conference on Learning Representations."},{"key":"e_1_3_2_1_33_1","volume-title":"US air force denies running simulation in which AI drone \u2018killed","author":"Staff Guardian","year":"2023","unstructured":"Guardian Staff . 2023. US air force denies running simulation in which AI drone \u2018killed \u2019 operator. https:\/\/www.theguardian.com\/us-news\/ 2023 \/jun\/01\/us-military-drone-ai-killed-operator-simulated-test Guardian Staff. 2023. US air force denies running simulation in which AI drone \u2018killed\u2019 operator. https:\/\/www.theguardian.com\/us-news\/2023\/jun\/01\/us-military-drone-ai-killed-operator-simulated-test"},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.14722\/ndss.2016.23368"},{"key":"e_1_3_2_1_35_1","unstructured":"Brad Templeton. 2023. Tesla Again Paints A Crash Data Story That Misleads Many Readers. https:\/\/www.forbes.com\/sites\/bradtempleton\/2023\/04\/26\/tesla-again-paints-a-very-misleading-story-with-their-crash-data\/?sh=7c533ab8feda \t\t\t\t  Brad Templeton. 2023. Tesla Again Paints A Crash Data Story That Misleads Many Readers. https:\/\/www.forbes.com\/sites\/bradtempleton\/2023\/04\/26\/tesla-again-paints-a-very-misleading-story-with-their-crash-data\/?sh=7c533ab8feda"},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/3180155.3180220"},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"crossref","unstructured":"Muhammad Usman Divya Gopinath and Corina S P\u0103s\u0103reanu. 2021. QuantifyML: How Good is my Machine Learning Model? arXiv preprint arXiv:2110.12588. \t\t\t\t  Muhammad Usman Divya Gopinath and Corina S P\u0103s\u0103reanu. 2021. QuantifyML: How Good is my Machine Learning Model? arXiv preprint arXiv:2110.12588.","DOI":"10.4204\/EPTCS.348.6"},{"key":"e_1_3_2_1_38_1","unstructured":"Pranshu Verma and Will Oremus. 2023. ChatGPT invented a sexual harassment scandal and named a real law prof as the accused. The Washington Post Apr https:\/\/www.washingtonpost.com\/technology\/2023\/04\/05\/chatgpt-lies\/ \t\t\t\t  Pranshu Verma and Will Oremus. 2023. ChatGPT invented a sexual harassment scandal and named a real law prof as the accused. The Washington Post Apr https:\/\/www.washingtonpost.com\/technology\/2023\/04\/05\/chatgpt-lies\/"},{"volume-title":"27th $USENIX$ Security Symposium ($USENIX$ Security 18). 1599\u20131614.","author":"Wang Shiqi","key":"e_1_3_2_1_39_1","unstructured":"Shiqi Wang , Kexin Pei , Justin Whitehouse , Junfeng Yang , and Suman Jana . 2018. Formal security analysis of neural networks using symbolic intervals . In 27th $USENIX$ Security Symposium ($USENIX$ Security 18). 1599\u20131614. Shiqi Wang, Kexin Pei, Justin Whitehouse, Junfeng Yang, and Suman Jana. 2018. Formal security analysis of neural networks using symbolic intervals. In 27th $USENIX$ Security Symposium ($USENIX$ Security 18). 1599\u20131614."},{"key":"e_1_3_2_1_40_1","volume-title":"Yee Whye Teh, and M Pawan Kumar","author":"Webb Stefan","year":"2018","unstructured":"Stefan Webb , Tom Rainforth , Yee Whye Teh, and M Pawan Kumar . 2018 . A statistical approach to assessing neural network robustness. arXiv preprint arXiv:1811.07209. Stefan Webb, Tom Rainforth, Yee Whye Teh, and M Pawan Kumar. 2018. A statistical approach to assessing neural network robustness. arXiv preprint arXiv:1811.07209."},{"key":"e_1_3_2_1_41_1","unstructured":"Huan Zhang Tsui-Wei Weng Pin-Yu Chen Cho-Jui Hsieh and Luca Daniel. 2018. Efficient neural network robustness certification with general activation functions. arXiv preprint arXiv:1811.00866. \t\t\t\t  Huan Zhang Tsui-Wei Weng Pin-Yu Chen Cho-Jui Hsieh and Luca Daniel. 2018. Efficient neural network robustness certification with general activation functions. arXiv preprint arXiv:1811.00866."},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.14722\/ndss.2019.23504"}],"event":{"name":"SE4SafeML '23: 1st International Workshop on Dependability and Trustworthiness of Safety-Critical Systems with Machine Learned Components","sponsor":["SIGSOFT ACM Special Interest Group on Software Engineering"],"location":"San Francisco CA USA","acronym":"SE4SafeML '23"},"container-title":["Proceedings of the 1st International Workshop on Dependability and Trustworthiness of Safety-Critical Systems with Machine Learned Components"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3617574.3617862","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/abs\/10.1145\/3617574.3617862","content-type":"text\/html","content-version":"vor","intended-application":"syndication"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:45:59Z","timestamp":1750178759000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3617574.3617862"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,12,4]]},"references-count":42,"alternative-id":["10.1145\/3617574.3617862","10.1145\/3617574"],"URL":"https:\/\/doi.org\/10.1145\/3617574.3617862","relation":{},"subject":[],"published":{"date-parts":[[2023,12,4]]},"assertion":[{"value":"2023-12-04","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}