{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,27]],"date-time":"2025-10-27T11:03:06Z","timestamp":1761562986057,"version":"3.40.3"},"publisher-location":"Cham","reference-count":108,"publisher":"Springer Nature Switzerland","isbn-type":[{"type":"print","value":"9783031377020"},{"type":"electronic","value":"9783031377037"}],"license":[{"start":{"date-parts":[[2023,1,1]],"date-time":"2023-01-01T00:00:00Z","timestamp":1672531200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,7,18]],"date-time":"2023-07-18T00:00:00Z","timestamp":1689638400000},"content-version":"vor","delay-in-days":198,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2023]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Deep neural networks (DNNs) are the workhorses of deep learning, which constitutes the state of the art in numerous application domains. However, DNN-based decision rules are notoriously prone to poor<jats:italic>generalization<\/jats:italic>, i.e., may prove inadequate on inputs not encountered during training. This limitation poses a significant obstacle to employing deep learning for mission-critical tasks, and also in real-world environments that exhibit high variability. We propose a novel, verification-driven methodology for identifying DNN-based decision rules that generalize well to new input domains. Our approach quantifies generalization to an input domain by the extent to which decisions reached by<jats:italic>independently trained<\/jats:italic>DNNs are in agreement for inputs in this domain. We show how, by harnessing the power of DNN verification, our approach can be efficiently and effectively realized. We evaluate our verification-based approach on three deep reinforcement learning (DRL) benchmarks, including a system for Internet congestion control. Our results establish the usefulness of our approach. More broadly, our work puts forth a novel objective for formal verification, with the potential for mitigating the risks associated with deploying DNN-based systems in the wild.<\/jats:p>","DOI":"10.1007\/978-3-031-37703-7_21","type":"book-chapter","created":{"date-parts":[[2023,7,17]],"date-time":"2023-07-17T17:02:15Z","timestamp":1689613335000},"page":"438-455","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Verifying Generalization in\u00a0Deep Learning"],"prefix":"10.1007","author":[{"given":"Guy","family":"Amir","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Osher","family":"Maayan","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tom","family":"Zelazny","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Guy","family":"Katz","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michael","family":"Schapira","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2023,7,18]]},"reference":[{"key":"21_CR1","doi-asserted-by":"publisher","first-page":"243","DOI":"10.1016\/j.inffus.2021.05.008","volume":"76","author":"M Abdar","year":"2021","unstructured":"Abdar, M., et al.: A review of uncertainty quantification in deep learning: techniques, applications and challenges. Inf. Fusion 76, 243\u2013297 (2021)","journal-title":"Inf. Fusion"},{"key":"21_CR2","unstructured":"Alamdari, P., Avni, G., Henzinger, T., Lukina, A.: Formal methods with a touch of magic. In: Proceedings 20th International Conference on Formal Methods in Computer-Aided Design (FMCAD), pp. 138\u2013147 (2020)"},{"key":"21_CR3","doi-asserted-by":"crossref","unstructured":"Albarghouthi, A.: Introduction to Neural Network Verification (2021). verifieddeeplearning.com","DOI":"10.1561\/9781680839111"},{"issue":"22","key":"21_CR4","doi-asserted-by":"publisher","first-page":"4862","DOI":"10.1093\/bioinformatics\/btz422","volume":"35","author":"M AlQuraishi","year":"2019","unstructured":"AlQuraishi, M.: AlphaFold at CASP13. Bioinformatics 35(22), 4862\u20134865 (2019)","journal-title":"Bioinformatics"},{"key":"21_CR5","doi-asserted-by":"publisher","unstructured":"Amir, G., et al.: Verifying learning-based robotic navigation systems. In: Sankaranarayanan, S., Sharygina, N. (eds.) Proceedings 29th International Conference on Tools and Algorithms for the Construction and Analysis of Systems (TACAS), pp. 607\u2013627. Springer, Cham (2023). https:\/\/doi.org\/10.1007\/978-3-031-30823-9_31","DOI":"10.1007\/978-3-031-30823-9_31"},{"key":"21_CR6","doi-asserted-by":"publisher","unstructured":"Amir, G., Freund, Z., Katz, G., Mandelbaum, E., Refaeli, I.: veriFIRE: verifying an industrial, learning-based wildfire detection system. In: Proceedings 25th International Symposium on Formal Methods (FM), pp. 648\u2013656. Springer, Cham (2023). https:\/\/doi.org\/10.1007\/978-3-031-27481-7_38","DOI":"10.1007\/978-3-031-27481-7_38"},{"key":"21_CR7","doi-asserted-by":"crossref","unstructured":"Amir, G., Maayan, O., Zelazny, O., Katz, G., Schapira, M.: Verifying generalization in deep learning. Technical report (2023). https:\/\/arxiv.org\/abs\/2302.05745","DOI":"10.1007\/978-3-031-37703-7_21"},{"key":"21_CR8","doi-asserted-by":"crossref","unstructured":"Amir, G., Maayan, O., Zelazny, T., Katz, G., Schapira, M.: Verifying generalization in deep learning: artifact (2023). https:\/\/zenodo.org\/record\/7884514#.ZFAz_3ZBy3B","DOI":"10.1007\/978-3-031-37703-7_21"},{"key":"21_CR9","unstructured":"Amir, G., Schapira, M., Katz, G.: Towards scalable verification of deep reinforcement learning. In: Proceedings 21st Internationl Conference on Formal Methods in Computer-Aided Design (FMCAD), pp. 193\u2013203 (2021)"},{"key":"21_CR10","series-title":"Lecture Notes in Computer Science","doi-asserted-by":"publisher","first-page":"203","DOI":"10.1007\/978-3-030-72013-1_11","volume-title":"Tools and Algorithms for the Construction and Analysis of Systems","author":"G Amir","year":"2021","unstructured":"Amir, G., Wu, H., Barrett, C., Katz, G.: An SMT-based approach for verifying binarized neural networks. In: TACAS 2021. LNCS, vol. 12652, pp. 203\u2013222. Springer, Cham (2021). https:\/\/doi.org\/10.1007\/978-3-030-72013-1_11"},{"key":"21_CR11","unstructured":"Amir, G., Zelazny, T., Katz, G., Schapira, M.: Verification-aided deep ensemble selection. In: Proceedings 22nd International Conference on Formal Methods in Computer-Aided Design (FMCAD), pp. 27\u201337 (2022)"},{"key":"21_CR12","doi-asserted-by":"crossref","unstructured":"Anderson, G., Pailoor, S., Dillig, I., Chaudhuri, S.: Optimization and abstraction: a synergistic approach for analyzing neural network robustness. In: Proceedings 40th ACM SIGPLAN Conference on Programming Languages Design and Implementations (PLDI), pp. 731\u2013744 (2019)","DOI":"10.1145\/3314221.3314614"},{"key":"21_CR13","doi-asserted-by":"crossref","unstructured":"Ashok, P., Hashemi, V., Kretinsky, J., Mohr, S.: DeepAbstract: neural network abstraction for accelerating verification. In: Proceedings 18th International Symposium on Automated Technology for Verification and Analysis (ATVA), pp. 92\u2013107 (2020)","DOI":"10.1007\/978-3-030-59152-6_5"},{"key":"21_CR14","series-title":"Lecture Notes in Computer Science","doi-asserted-by":"publisher","first-page":"630","DOI":"10.1007\/978-3-030-25540-4_36","volume-title":"Computer Aided Verification","author":"G Avni","year":"2019","unstructured":"Avni, G., Bloem, R., Chatterjee, K., Henzinger, T.A., K\u00f6nighofer, B., Pranger, S.: Run-time optimization for learned controllers through quantitative games. In: Dillig, I., Tasiran, S. (eds.) CAV 2019. LNCS, vol. 11561, pp. 630\u2013649. Springer, Cham (2019). https:\/\/doi.org\/10.1007\/978-3-030-25540-4_36"},{"key":"21_CR15","doi-asserted-by":"crossref","unstructured":"Bacci, E., Giacobbe, M., Parker, D.: Verifying reinforcement learning up to infinity. In: Proceedings 30th International Joint Conference on Artificial Intelligence (IJCAI) (2021)","DOI":"10.24963\/ijcai.2021\/297"},{"key":"21_CR16","doi-asserted-by":"crossref","unstructured":"Baluta, T., Shen, S., Shinde, S., Meel, K., Saxena, P.: Quantitative verification of neural networks and its security applications. In: Proceedings ACM SIGSAC Conference on Computer and Communications Security (CCS), pp. 1249\u20131264 (2019)","DOI":"10.1145\/3319535.3354245"},{"key":"21_CR17","doi-asserted-by":"crossref","unstructured":"Barto, A., Sutton, R., Anderson, C.: Neuronlike adaptive elements that can solve difficult learning control problems. In: Proceedings of IEEE Systems Man and Cybernetics Conference (SMC), pp. 834\u2013846 (1983)","DOI":"10.1109\/TSMC.1983.6313077"},{"key":"21_CR18","unstructured":"Bojarski, M., et al.: End to end learning for self-driving cars. Technical report (2016). http:\/\/arxiv.org\/abs\/1604.07316"},{"key":"21_CR19","unstructured":"Bunel, R., Turkaslan, I., Torr, P., Kohli, P., Mudigonda, P.: A unified view of piecewise linear neural network verification. In: Proceedings 32nd Conference on Neural Information Processing Systems (NeurIPS), pp. 4795\u20134804 (2018)"},{"key":"21_CR20","unstructured":"Chen, W., Xu, Y., Wu, X.: Deep reinforcement learning for multi-resource multi-machine job scheduling. Technical report (2017). http:\/\/arxiv.org\/abs\/1711.07440"},{"key":"21_CR21","first-page":"2493","volume":"12","author":"R Collobert","year":"2011","unstructured":"Collobert, R., Weston, J., Bottou, L., Karlen, M., Kavukcuoglu, K., Kuksa, P.: Natural language processing (almost) from scratch. J. Mach. Learn. Res. (JMLR) 12, 2493\u20132537 (2011)","journal-title":"J. Mach. Learn. Res. (JMLR)"},{"key":"21_CR22","unstructured":"Corsi, D., Marchesini, E., Farinelli, A.: Formal verification of neural networks for safety-critical tasks in deep reinforcement learning. In: Proceedings 37th Conference on Uncertainty in Artificial Intelligence (UAI), pp. 333\u2013343 (2021)"},{"key":"21_CR23","doi-asserted-by":"crossref","unstructured":"Dietterich, T.: Ensemble methods in machine learning. In: Proceedings 1st International Workshop on Multiple Classifier Systems (MCS), pp. 1\u201315 (2020)","DOI":"10.1007\/3-540-45014-9_1"},{"key":"21_CR24","unstructured":"Dong, G., Sun, J., Wang, J., Wang, X., Dai, T.: Towards repairing neural networks correctly. Technical report (2020). http:\/\/arxiv.org\/abs\/2012.01872"},{"key":"21_CR25","doi-asserted-by":"crossref","unstructured":"Dutta, S., Chen, X., Sankaranarayanan, S.: Reachability analysis for neural feedback systems using regressive polynomial rule inference. In: Proceedings 22nd ACM International Conference on Hybrid Systems: Computation and Control (HSCC), pp. 157\u2013168 (2019)","DOI":"10.1145\/3302504.3311807"},{"issue":"16","key":"21_CR26","doi-asserted-by":"publisher","first-page":"151","DOI":"10.1016\/j.ifacol.2018.08.026","volume":"51","author":"S Dutta","year":"2018","unstructured":"Dutta, S., Jha, S., Sankaranarayanan, S., Tiwari, A.: Learning and verification of feedback control systems using feedforward neural networks. IFAC-PapersOnLine 51(16), 151\u2013156 (2018)","journal-title":"IFAC-PapersOnLine"},{"key":"21_CR27","doi-asserted-by":"crossref","unstructured":"Ehlers, R.: Formal verification of piece-wise linear feed-forward neural networks. In: Proceedings 15th International Symposium on Automated Technology for Verification and Analysis (ATVA), pp. 269\u2013286 (2017)","DOI":"10.1007\/978-3-319-68167-2_19"},{"key":"21_CR28","doi-asserted-by":"crossref","unstructured":"Eliyahu, T., Kazak, Y., Katz, G., Schapira, M.: Verifying learning-augmented systems. In: Proceedings Conference of the ACM Special Interest Group on Data Communication on the Applications, Technologies, Architectures, and Protocols for Computer Communication (SIGCOMM), pp. 305\u2013318 (2021)","DOI":"10.1145\/3452296.3472936"},{"key":"21_CR29","doi-asserted-by":"crossref","unstructured":"Fulton, N., Platzer, A.: Safe reinforcement learning via formal methods: toward safe control through proof and learning. In: Proceedings 32nd AAAI Conference on Artificial Intelligence (AAAI) (2018)","DOI":"10.1609\/aaai.v32i1.12107"},{"key":"21_CR30","doi-asserted-by":"publisher","DOI":"10.1016\/j.engappai.2022.105151","volume":"115","author":"M Ganaie","year":"2022","unstructured":"Ganaie, M., Hu, M., Malik, A., Tanveer, M., Suganthan, P.: Ensemble deep learning: a review. Eng. Appl. Artif. Intell. 115, 105151 (2022)","journal-title":"Eng. Appl. Artif. Intell."},{"key":"21_CR31","doi-asserted-by":"crossref","unstructured":"Gehr, T., Mirman, M., Drachsler-Cohen, D., Tsankov, E., Chaudhuri, S., Vechev, M.: AI2: safety and robustness certification of neural networks with abstract interpretation. In: Proceedings 39th IEEE Symposium on Security and Privacy (S &P) (2018)","DOI":"10.1109\/SP.2018.00058"},{"key":"21_CR32","unstructured":"Geng, C., Le, N., Xu, X., Wang, Z., Gurfinkel, A., Si, X.: Toward reliable neural specifications. Technical report (2022). https:\/\/arxiv.org\/abs\/2210.16114"},{"issue":"5","key":"21_CR33","doi-asserted-by":"publisher","first-page":"40","DOI":"10.1109\/37.236324","volume":"13","author":"S Geva","year":"1993","unstructured":"Geva, S., Sitte, J.: A cartpole experiment benchmark for trainable controllers. IEEE Control Syst. Mag. 13(5), 40\u201351 (1993)","journal-title":"IEEE Control Syst. Mag."},{"key":"21_CR34","doi-asserted-by":"crossref","unstructured":"Goldberger, B., Adi, Y., Keshet, J., Katz, G.: Minimal modifications of deep neural networks using verification. In: Proceedings 23rd Proceedings Conference on Logic for Programming, Artificial Intelligence and Reasoning (LPAR), pp. 260\u2013278 (2020)","DOI":"10.29007\/699q"},{"key":"21_CR35","unstructured":"Goodfellow, I., Bengio, Y., Courville, A.: Deep Learning. MIT Press (2016)"},{"key":"21_CR36","doi-asserted-by":"crossref","unstructured":"Gopinath, D., Katz, G., P\u01ces\u01cereanu, C., Barrett, C.: DeepSafe: a data-driven approach for assessing robustness of neural networks. In: Proceedings 16th International Symposium on Automated Technology for Verification and Analysis (ATVA), pp. 3\u201319 (2018)","DOI":"10.1007\/978-3-030-01090-4_1"},{"key":"21_CR37","doi-asserted-by":"crossref","unstructured":"Goubault, E., Palumby, S., Putot, S., Rustenholz, L., Sankaranarayanan, S.: Static analysis of ReLU neural networks with tropical Polyhedra. In: Proceedings 28th International Symposium on Static Analysis (SAS), pp. 166\u2013190 (2021)","DOI":"10.1007\/978-3-030-88806-0_8"},{"key":"21_CR38","unstructured":"Haarnoja, T., Zhou, A., Abbeel, P., Levine, S.: Soft actor-critic: off-policy maximum entropy deep reinforcement learning with a stochastic actor. In: Proceedings Conference on Machine Learning, pp. 1861\u20131870. PMLR (2018)"},{"key":"21_CR39","unstructured":"Hashemi, V., K\u0159et\u00ednsky, J., Rieder, S., Schmidt, J.: Runtime monitoring for out-of-distribution detection in object detection neural networks. Technical report (2022). http:\/\/arxiv.org\/abs\/2212.07773"},{"key":"21_CR40","unstructured":"Huang, S., Papernot, N., Goodfellow, I., Duan, Y., Abbeel, P.: Adversarial attacks on neural network policies. Technical report (2017). https:\/\/arxiv.org\/abs\/1702.02284"},{"key":"21_CR41","doi-asserted-by":"crossref","unstructured":"Huang, X., Kwiatkowska, M., Wang, S., Wu, M.: Safety verification of deep neural networks. In: Proceedings 29th International Conference on Computer Aided Verification (CAV), pp. 3\u201329 (2017)","DOI":"10.1007\/978-3-319-63387-9_1"},{"key":"21_CR42","unstructured":"Isac, O., Barrett, C., Zhang, M., Katz, G.: Neural network verification with proof production. In: Proceedings 22nd International Conference on Formal Methods in Computer-Aided Design (FMCAD), pp. 38\u201348 (2022)"},{"key":"21_CR43","doi-asserted-by":"crossref","unstructured":"Jacoby, Y., Barrett, C., Katz, G.: Verifying recurrent neural networks using invariant inference. In: Proceedings 18th International Symposium on Automated Technology for Verification and Analysis (ATVA), pp. 57\u201374 (2020)","DOI":"10.1007\/978-3-030-59152-6_3"},{"key":"21_CR44","unstructured":"Jay, N., Rotman, N., Godfrey, B., Schapira, M., Tamar, A.: A deep reinforcement learning perspective on internet congestion control. In: Proceedings 36th International Conference on Machine Learning (ICML), pp. 3050\u20133059 (2019)"},{"key":"21_CR45","doi-asserted-by":"crossref","unstructured":"Julian, K., Lopez, J., Brush, J., Owen, M., Kochenderfer, M.: Policy compression for aircraft collision avoidance systems. In: Proceedings 35th Digital Avionics Systems Conference (DASC), pp. 1\u201310 (2016)","DOI":"10.1109\/DASC.2016.7778091"},{"key":"21_CR46","doi-asserted-by":"crossref","unstructured":"Katz, G., Barrett, C., Dill, D., Julian, K., Kochenderfer, M.: Reluplex: an efficient SMT solver for verifying deep neural networks. In: Proceedings 29th International Conference on Computer Aided Verification (CAV), pp. 97\u2013117 (2017)","DOI":"10.1007\/978-3-319-63387-9_5"},{"key":"21_CR47","doi-asserted-by":"crossref","unstructured":"Katz, G., Barrett, C., Dill, D., Julian, K., Kochenderfer, M.: Reluplex: a calculus for reasoning about deep neural networks. Formal Methods Syst. Des. (FMSD) (2021)","DOI":"10.1007\/s10703-021-00363-7"},{"key":"21_CR48","doi-asserted-by":"crossref","unstructured":"Katz, G., et al.: The marabou framework for verification and analysis of deep neural networks. In: Proceedings 31st International Conference on Computer Aided Verification (CAV), pp. 443\u2013452 (2019)","DOI":"10.1007\/978-3-030-25540-4_26"},{"key":"21_CR49","doi-asserted-by":"crossref","unstructured":"K\u00f6nighofer, B., Lorber, F., Jansen, N., Bloem, R.: Shield synthesis for reinforcement learning. In: Proceedings International Symposium on Leveraging Applications of Formal Methods, Verification and Validation (ISoLA), pp. 290\u2013306 (2020)","DOI":"10.1007\/978-3-030-61362-4_16"},{"key":"21_CR50","unstructured":"Krizhevsky, A., Sutskever, I., Hinton, G.: ImageNet classification with deep convolutional neural networks. In: Proceedings 26th Conference on Neural Information Processing Systems (NeurIPS), pp. 1097\u20131105 (2012)"},{"key":"21_CR51","doi-asserted-by":"crossref","unstructured":"Krogh, A., Vedelsby, J.: Neural network ensembles, cross validation, and active learning. In: Proceedings 7th Conference on Neural Information Processing Systems (NeurIPS), pp. 231\u2013238 (1994)","DOI":"10.3233\/AIC-1994-73-412"},{"key":"21_CR52","unstructured":"Kuper, L. Katz, G., Gottschlich, J., Julian, K., Barrett, C., Kochenderfer, M.: Toward scalable verification for safety-critical deep networks. Technical report (2018). https:\/\/arxiv.org\/abs\/1801.05950"},{"key":"21_CR53","unstructured":"Kurakin, A., Goodfellow, I., Bengio, S.: Adversarial examples in the physical world. Technical report (2016). http:\/\/arxiv.org\/abs\/1607.02533"},{"key":"21_CR54","doi-asserted-by":"crossref","unstructured":"Lekharu, A., Moulii, K., Sur, A., Sarkar, A.: Deep learning based prediction model for adaptive video streaming. In: Proceedings 12th International Conference on Communication Systems & Networks (COMSNETS), pp. 152\u2013159. IEEE (2020)","DOI":"10.1109\/COMSNETS48256.2020.9027383"},{"issue":"3","key":"21_CR55","doi-asserted-by":"publisher","first-page":"445","DOI":"10.1109\/TNSE.2018.2835758","volume":"6","author":"W Li","year":"2018","unstructured":"Li, W., Zhou, F., Chowdhury, K.R., Meleis, W.: QTCP: adaptive congestion control with reinforcement learning. IEEE Trans. Netw. Sci. Eng. 6(3), 445\u2013458 (2018)","journal-title":"IEEE Trans. Netw. Sci. Eng."},{"key":"21_CR56","unstructured":"Li, Y.: Deep reinforcement learning: an overview. Technical report (2017). http:\/\/arxiv.org\/abs\/1701.07274"},{"key":"21_CR57","unstructured":"Lomuscio, A., Maganti, L.: An approach to reachability analysis for feed-forward ReLU neural networks. Technical report (2017). http:\/\/arxiv.org\/abs\/1706.07351"},{"key":"21_CR58","doi-asserted-by":"crossref","unstructured":"Loquercio, A., Segu, M., Scaramuzza, D.: A general framework for uncertainty estimation in deep learning. In: Proceedings International Conference on Robotics and Automation (ICRA), pp. 3153\u20133160 (2020)","DOI":"10.1109\/LRA.2020.2974682"},{"issue":"1","key":"21_CR59","doi-asserted-by":"publisher","first-page":"28","DOI":"10.1109\/37.980245","volume":"22","author":"S Low","year":"2002","unstructured":"Low, S., Paganini, F., Doyle, J.: Internet congestion control. IEEE Control Syst. Mag. 22(1), 28\u201343 (2002)","journal-title":"IEEE Control Syst. Mag."},{"key":"21_CR60","series-title":"Lecture Notes in Computer Science","doi-asserted-by":"publisher","first-page":"42","DOI":"10.1007\/978-3-030-88494-9_3","volume-title":"Runtime Verification","author":"A Lukina","year":"2021","unstructured":"Lukina, A., Schilling, C., Henzinger, T.A.: Into the unknown: active monitoring of\u00a0neural networks. In: Feng, L., Fisman, D. (eds.) RV 2021. LNCS, vol. 12974, pp. 42\u201361. Springer, Cham (2021). https:\/\/doi.org\/10.1007\/978-3-030-88494-9_3"},{"key":"21_CR61","doi-asserted-by":"crossref","unstructured":"Lyu, Z., Ko, C.Y., Kong, Z., Wong, N., Lin, D., Daniel, L.: Fastened crown: tightened neural network robustness certificates. In: Proceedings 34th AAAI Conference on Artificial Intelligence (AAAI), pp. 5037\u20135044 (2020)","DOI":"10.1609\/aaai.v34i04.5944"},{"key":"21_CR62","unstructured":"Ma, J., Ding, S., Mei, Q.: Towards more practical adversarial attacks on graph neural networks. In: Proceedings 34th Conference on Neural Information Processing Systems (NeurIPS) (2020)"},{"key":"21_CR63","unstructured":"Madry, A., Makelov, A., Schmidt, L., Tsipras, D., Vladu, A.: Towards deep learning models resistant to adversarial attacks. Technical report (2017). http:\/\/arxiv.org\/abs\/1706.06083"},{"key":"21_CR64","doi-asserted-by":"crossref","unstructured":"Mammadli, R., Jannesari, A., Wolf, F.: Static neural compiler optimization via deep reinforcement learning. In: Proceedings 6th IEEE\/ACM Workshop on the LLVM Compiler Infrastructure in HPC (LLVM-HPC) and Workshop on Hierarchical Parallelism for Exascale Computing (HiPar), pp. 1\u201311 (2020)","DOI":"10.1109\/LLVMHPCHiPar51896.2020.00006"},{"key":"21_CR65","doi-asserted-by":"crossref","unstructured":"Mao, H., Alizadeh, M., Menache, I., Kandula, S.: Resource management with deep reinforcement learning. In: Proceedings 15th ACM Workshop on Hot Topics in Networks (HotNets), pp. 50\u201356 (2016)","DOI":"10.1145\/3005745.3005750"},{"key":"21_CR66","doi-asserted-by":"crossref","unstructured":"Mao, H., Netravali, R., Alizadeh, M.: Neural adaptive video streaming with Pensieve. In: Proceedings Conference of the ACM Special Interest Group on Data Communication on the Applications, Technologies, Architectures, and Protocols for Computer Communication (SIGCOMM), pp. 197\u2013210 (2017)","DOI":"10.1145\/3098822.3098843"},{"key":"21_CR67","unstructured":"Mnih, V., et al.: Playing Atari with deep reinforcement learning. Technical report (2013). https:\/\/arxiv.org\/abs\/1312.5602"},{"key":"21_CR68","unstructured":"Moore, A.: Efficient Memory-based Learning for Robot Control. University of Cambridge (1990)"},{"issue":"4","key":"21_CR69","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1145\/1024908.1024910","volume":"14","author":"J Nagle","year":"1984","unstructured":"Nagle, J.: Congestion control in IP\/TCP internetworks. ACM SIGCOMM Comput. Commun. Rev. 14(4), 11\u201317 (1984)","journal-title":"ACM SIGCOMM Comput. Commun. Rev."},{"key":"21_CR70","doi-asserted-by":"crossref","unstructured":"Okudono, T., Waga, M., Sekiyama, T., Hasuo, I.: Weighted automata extraction from recurrent neural networks via regression on state spaces. In: Proceedings 34th AAAI Conference on Artificial Intelligence (AAAI), pp. 5037\u20135044 (2020)","DOI":"10.1609\/aaai.v34i04.5977"},{"key":"21_CR71","unstructured":"Ortega, L., Caba\u00f1as, R., Masegosa, A.: Diversity and generalization in neural network ensembles. In: Proceedings 25th International Conference on Artificial Intelligence and Statistics (AISTATS), pp. 11720\u201311743 (2022)"},{"key":"21_CR72","unstructured":"Osband, I., Aslanides, J., Cassirer, A.: Randomized prior functions for deep reinforcement learning. In: Proceedings 31st International Conference on Neural Information Processing Systems (NeurIPS), pp. 8617\u20138629 (2018)"},{"key":"21_CR73","doi-asserted-by":"crossref","unstructured":"Ostrovsky, M., Barrett, C., Katz, G.: An abstraction-refinement approach to verifying convolutional neural networks. In Proceedings 20th International Symposium on Automated Technology for Verification and Analysis (ATVA), pp. 391\u2013396 (2022)","DOI":"10.1007\/978-3-031-19992-9_25"},{"key":"21_CR74","unstructured":"Ovadia, Y., et al.: Can you trust your model\u2019s uncertainty? Evaluating predictive uncertainty under dataset shift. In: Proceedings 33rd Conference on Neural Information Processing Systems (NeurIPS), pp. 14003\u201314014 (2019)"},{"key":"21_CR75","unstructured":"Packer, C., Gao, K., Kos, J., Kr\u00e4henb\u00fchl, P., Koltun, V., Song, D.: Assessing generalization in deep reinforcement learning. Technical report (2018). https:\/\/arxiv.org\/abs\/1810.12282"},{"key":"21_CR76","unstructured":"Polgreen, E., Abboud, R., Kroening, D.: Counterexample guided neural synthesis. Technical report (2020). https:\/\/arxiv.org\/abs\/2001.09245"},{"key":"21_CR77","series-title":"Lecture Notes in Computer Science","doi-asserted-by":"publisher","first-page":"285","DOI":"10.1007\/978-3-030-94583-1_14","volume-title":"Verification, Model Checking, and Abstract Interpretation","author":"P Prabhakar","year":"2022","unstructured":"Prabhakar, P.: Bisimulations for\u00a0neural network reduction. In: Finkbeiner, B., Wies, T. (eds.) VMCAI 2022. LNCS, vol. 13182, pp. 285\u2013300. Springer, Cham (2022). https:\/\/doi.org\/10.1007\/978-3-030-94583-1_14"},{"key":"21_CR78","unstructured":"Prabhakar, P., Afzal, Z.: Abstraction based output range analysis for neural networks. Technical report (2020). https:\/\/arxiv.org\/abs\/2007.09527"},{"key":"21_CR79","series-title":"Lecture Notes in Computer Science (Lecture Notes in Artificial Intelligence)","doi-asserted-by":"publisher","first-page":"317","DOI":"10.1007\/11564096_32","volume-title":"Machine Learning: ECML 2005","author":"M Riedmiller","year":"2005","unstructured":"Riedmiller, M.: Neural fitted Q iteration \u2013 first experiences with a data efficient neural reinforcement learning method. In: Gama, J., Camacho, R., Brazdil, P.B., Jorge, A.M., Torgo, L. (eds.) ECML 2005. LNCS (LNAI), vol. 3720, pp. 317\u2013328. Springer, Heidelberg (2005). https:\/\/doi.org\/10.1007\/11564096_32"},{"key":"21_CR80","unstructured":"Rotman, N., Schapira, M., Tamar, A.: Online safety assurance for deep reinforcement learning. In: Proceedings 19th ACM Workshop on Hot Topics in Networks (HotNets), pp. 88\u201395 (2020)"},{"key":"21_CR81","doi-asserted-by":"crossref","unstructured":"Ruan, W., Huang, X., Kwiatkowska, M.: Reachability analysis of deep neural networks with provable guarantees. In: Proceedings 27th International Joint Conference on Artificial Intelligence (IJCAI) (2018)","DOI":"10.24963\/ijcai.2018\/368"},{"key":"21_CR82","unstructured":"Schulman, J., Wolski, F., Dhariwal, P., Radford, A., Klimov, O.: Proximal policy optimization algorithms. Technical report (2017). http:\/\/arxiv.org\/abs\/1707.06347"},{"key":"21_CR83","doi-asserted-by":"crossref","unstructured":"Seshia, S., et al.: Formal specification for deep neural networks. In: Proceedings 16th International Symposium on Automated Technology for Verification and Analysis (ATVA), pp. 20\u201334 (2018)","DOI":"10.1007\/978-3-030-01090-4_2"},{"issue":"7587","key":"21_CR84","doi-asserted-by":"publisher","first-page":"484","DOI":"10.1038\/nature16961","volume":"529","author":"D Silver","year":"2016","unstructured":"Silver, D., et al.: Mastering the game of go with deep neural networks and tree search. Nature 529(7587), 484\u2013489 (2016)","journal-title":"Nature"},{"key":"21_CR85","unstructured":"Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. Technical report (2014). http:\/\/arxiv.org\/abs\/1409.1556"},{"key":"21_CR86","doi-asserted-by":"crossref","unstructured":"Singh, G., Gehr, T., Puschel, M., Vechev, M.: An abstract domain for certifying neural networks. In: Proceedings 46th ACM SIGPLAN Symposium on Principles of Programming Languages (POPL) (2019)","DOI":"10.1145\/3290354"},{"key":"21_CR87","unstructured":"Sotoudeh, M., Thakur, A.: Correcting deep neural networks with small, generalizing patches. In: Workshop on Safety and Robustness in Decision Making (2019)"},{"key":"21_CR88","doi-asserted-by":"crossref","unstructured":"Strong, C., et al.: Global optimization of objective functions represented by ReLU networks. J. Mach. Learn., 1\u201328 (2021)","DOI":"10.1007\/s10994-021-06050-2"},{"key":"21_CR89","doi-asserted-by":"crossref","unstructured":"Sun, X., Khedr, H., Shoukry, Y.: Formal verification of neural network controlled autonomous systems. In: Proceedings 22nd ACM International Conference on Hybrid Systems: Computation and Control (HSCC) (2019)","DOI":"10.1145\/3302504.3311802"},{"key":"21_CR90","unstructured":"Sutton, R., Barto, A.: Reinforcement Learning: An Introduction. MIT Press (2018)"},{"key":"21_CR91","unstructured":"Sutton, R., McAllester, D., Singh, S., Mansour, Y.: Policy gradient methods for reinforcement learning with function approximation. In: Proceedings 12th Conference on Neural Information Processing Systems (NeurIPS) (1999)"},{"key":"21_CR92","unstructured":"Tjeng, V., Xiao, K., Tedrake, R.: Evaluating robustness of neural networks with mixed integer programming. Technical report (2017). http:\/\/arxiv.org\/abs\/1711.07356"},{"key":"21_CR93","unstructured":"Tolstoy, L.: Anna Karenina. The Russian Messenger (1877)"},{"key":"21_CR94","doi-asserted-by":"crossref","unstructured":"Urban, C., Christakis, M., W\u00fcstholz, V., Zhang, F.: Perfectly parallel fairness certification of neural networks. In: Proceedings ACM International Conference on Object Oriented Programming Systems Languages and Applications (OOPSLA), pp. 1\u201330 (2020)","DOI":"10.1145\/3428253"},{"key":"21_CR95","doi-asserted-by":"crossref","unstructured":"Usman, M., Gopinath, D., Sun, Y., Noller, Y., P\u01ces\u01cereanu, C.: NNrepair: constraint-based repair of neural network classifiers. Technical report (2021). http:\/\/arxiv.org\/abs\/2103.12535","DOI":"10.1007\/978-3-030-81685-8_1"},{"key":"21_CR96","doi-asserted-by":"crossref","unstructured":"Valadarsky, A., Schapira, M., Shahaf, D., Tamar, A.: Learning to route with deep RL. In: NeurIPS Deep Reinforcement Learning Symposium (2017)","DOI":"10.1145\/3152434.3152441"},{"key":"21_CR97","doi-asserted-by":"crossref","unstructured":"van Hasselt, H., Guez, A., Silver, D.: Deep reinforcement learning with double Q-learning. In: Proceedings 30th AAAI Conference on Artificial Intelligence (AAAI) (2016)","DOI":"10.1609\/aaai.v30i1.10295"},{"key":"21_CR98","doi-asserted-by":"publisher","first-page":"34","DOI":"10.1016\/j.neunet.2022.03.022","volume":"151","author":"M Vasi\u0107","year":"2022","unstructured":"Vasi\u0107, M., Petrovi\u0107, A., Wang, K., Nikoli\u0107, M., Singh, R., Khurshid, S.: Mo\u00cbT: mixture of expert trees and its application to verifiable reinforcement learning. Neural Netw. 151, 34\u201347 (2022)","journal-title":"Neural Netw."},{"key":"21_CR99","unstructured":"Wang, S., Pei, K., Whitehouse, J., Yang, J., Jana, S.: Formal security analysis of neural networks using symbolic intervals. In: Proceedings 27th USENIX Security Symposium, pp. 1599\u20131614 (2018)"},{"key":"21_CR100","unstructured":"Wu, H., et al.: Parallelization techniques for verifying neural networks. In: Proceedings 20th International Conference on Formal Methods in Computer-Aided Design (FMCAD), pp. 128\u2013137 (2020)"},{"key":"21_CR101","doi-asserted-by":"crossref","unstructured":"Wu, H., Zelji\u0107, A., Katz, K., Barrett, C.: Efficient neural network analysis with sum-of-infeasibilities. In: Proceedings 28th International Conference on Tools and Algorithms for the Construction and Analysis of Systems (TACAS), pp. 143\u2013163 (2022)","DOI":"10.1007\/978-3-030-99524-9_8"},{"key":"21_CR102","doi-asserted-by":"crossref","unstructured":"Xiang, W., Tran, H., Johnson, T.: Output reachable set estimation and verification for multi-layer neural networks. IEEE Trans. Neural Netw. Learn. Syst. (TNNLS) (2018)","DOI":"10.1109\/TNNLS.2018.2808470"},{"issue":"6","key":"21_CR103","doi-asserted-by":"publisher","first-page":"878","DOI":"10.1109\/TNNLS.2013.2246578","volume":"24","author":"J Yang","year":"2013","unstructured":"Yang, J., Zeng, X., Zhong, S., Wu, S.: Effective neural network ensemble approach for improving generalization performance. IEEE Trans. Neural Netw. Learn. Syst. (TNNLS) 24(6), 878\u2013887 (2013)","journal-title":"IEEE Trans. Neural Netw. Learn. Syst. (TNNLS)"},{"key":"21_CR104","doi-asserted-by":"crossref","unstructured":"Yang, X., Yamaguchi, T., Tran, H., Hoxha, B., Johnson, T., Prokhorov, D.: Neural network repair with reachability analysis. In: Proceedings 20th International Conference on Formal Modeling and Analysis of Timed Systems (FORMATS), pp. 221\u2013236 (2022)","DOI":"10.1007\/978-3-031-15839-1_13"},{"key":"21_CR105","unstructured":"Zelazny, T., Wu, H., Barrett, C., Katz, G.: On reducing over-approximation errors for neural network verification. In: Proceedings 22nd International Conference on Formal Methods in Computer-Aided Design (FMCAD), pp. 17\u201326 (2022)"},{"key":"21_CR106","unstructured":"Zhang, H., Shinn, M., Gupta, A., Gurfinkel, A., Le, N., Narodytska, N.: Verification of recurrent neural networks for cognitive tasks via reachability analysis. In: Proceedings 24th European Conference on Artificial Intelligence (ECAI), pp. 1690\u20131697 (2020)"},{"key":"21_CR107","unstructured":"Zhang, J., Kim, J., O\u2019Donoghue, B., Boyd, S.: Sample efficient reinforcement learning with REINFORCE. Technical report (2020). https:\/\/arxiv.org\/abs\/2010.11364"},{"key":"21_CR108","doi-asserted-by":"crossref","unstructured":"Zhang, J., et al.: An end-to-end automatic cloud database tuning system using deep reinforcement learning. In: Proceedings of the 2019 International Conference on Management of Data (SIGMOD), pp. 415\u2013432 (2019)","DOI":"10.1145\/3299869.3300085"}],"container-title":["Lecture Notes in Computer Science","Computer Aided Verification"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/978-3-031-37703-7_21","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,24]],"date-time":"2024-10-24T09:04:38Z","timestamp":1729760678000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/978-3-031-37703-7_21"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023]]},"ISBN":["9783031377020","9783031377037"],"references-count":108,"URL":"https:\/\/doi.org\/10.1007\/978-3-031-37703-7_21","relation":{},"ISSN":["0302-9743","1611-3349"],"issn-type":[{"type":"print","value":"0302-9743"},{"type":"electronic","value":"1611-3349"}],"subject":[],"published":{"date-parts":[[2023]]},"assertion":[{"value":"18 July 2023","order":1,"name":"first_online","label":"First Online","group":{"name":"ChapterHistory","label":"Chapter History"}},{"value":"CAV","order":1,"name":"conference_acronym","label":"Conference Acronym","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"International Conference on Computer Aided Verification","order":2,"name":"conference_name","label":"Conference Name","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Paris","order":3,"name":"conference_city","label":"Conference City","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"France","order":4,"name":"conference_country","label":"Conference Country","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"2023","order":5,"name":"conference_year","label":"Conference Year","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"17 July 2023","order":7,"name":"conference_start_date","label":"Conference Start Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"22 July 2023","order":8,"name":"conference_end_date","label":"Conference End Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"35","order":9,"name":"conference_number","label":"Conference Number","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"cav2023","order":10,"name":"conference_id","label":"Conference ID","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"http:\/\/www.i-cav.org\/2023\/","order":11,"name":"conference_url","label":"Conference URL","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Double-blind","order":1,"name":"type","label":"Type","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"hotcrp","order":2,"name":"conference_management_system","label":"Conference Management System","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"261","order":3,"name":"number_of_submissions_sent_for_review","label":"Number of Submissions Sent for Review","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"67","order":4,"name":"number_of_full_papers_accepted","label":"Number of Full Papers Accepted","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"0","order":5,"name":"number_of_short_papers_accepted","label":"Number of Short Papers Accepted","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"26% - The value is computed by the equation \"Number of Full Papers Accepted \/ Number of Submissions Sent for Review * 100\" and then rounded to a whole number.","order":6,"name":"acceptance_rate_of_full_papers","label":"Acceptance Rate of Full Papers","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"3","order":7,"name":"average_number_of_reviews_per_paper","label":"Average Number of Reviews per Paper","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"11","order":8,"name":"average_number_of_papers_per_reviewer","label":"Average Number of Papers per Reviewer","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"Yes","order":9,"name":"external_reviewers_involved","label":"External Reviewers Involved","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}}]}}