{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,29]],"date-time":"2026-01-29T22:41:12Z","timestamp":1769726472015,"version":"3.49.0"},"reference-count":69,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2023,5,30]],"date-time":"2023-05-30T00:00:00Z","timestamp":1685404800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,5,30]],"date-time":"2023-05-30T00:00:00Z","timestamp":1685404800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100007210","name":"RWTH Aachen University","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100007210","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J Softw Tools Technol Transfer"],"published-print":{"date-parts":[[2023,6]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>This paper presents a summary and meta-analysis of the first three iterations of the annual International Verification of Neural Networks Competition (VNN-COMP), held in 2020, 2021, and 2022. In the VNN-COMP, participants submit software tools that analyze whether given neural networks satisfy specifications describing their input-output behavior. These neural networks and specifications cover a variety of problem classes and tasks, corresponding to safety and robustness properties in image classification, neural control, reinforcement learning, and autonomous systems. We summarize the key processes, rules, and results, present trends observed over the last three years, and provide an outlook into possible future developments.<\/jats:p>","DOI":"10.1007\/s10009-023-00703-4","type":"journal-article","created":{"date-parts":[[2023,5,30]],"date-time":"2023-05-30T11:02:27Z","timestamp":1685444547000},"page":"329-339","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":57,"title":["First three years of the international verification of neural networks competition (VNN-COMP)"],"prefix":"10.1007","volume":"25","author":[{"given":"Christopher","family":"Brix","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mark Niklas","family":"M\u00fcller","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Stanley","family":"Bak","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Taylor T.","family":"Johnson","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Changliu","family":"Liu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2023,5,30]]},"reference":[{"key":"703_CR1","unstructured":"Simple Adversarial Generator. https:\/\/github.com\/stanleybak\/simple_adversarial_generator. Accessed: 2022-09-13"},{"key":"703_CR2","unstructured":"VNN-COMP2020 report. https:\/\/www.overleaf.com\/project\/5f0c85e8d15dc10001749fa9. Accessed: 2022-08-28"},{"key":"703_CR3","unstructured":"Bai, J., Lu, F., Zhang, K., et\u00a0al.: Onnx: open neural network exchange (2019). https:\/\/github.com\/onnx\/onnx"},{"key":"703_CR4","unstructured":"Bak, S.: Execution-guided overapproximation (ego) for improving scalability of neural network verification (2020)"},{"key":"703_CR5","doi-asserted-by":"publisher","unstructured":"Bak, S., Liu, C., Johnson, T.: The second international verification of neural networks competition (VNN-COMP 2021): summary and results (2021). https:\/\/doi.org\/10.48550\/ARXIV.2109.00498","DOI":"10.48550\/ARXIV.2109.00498"},{"key":"703_CR6","volume-title":"8th International Conference on Learning Representations, ICLR 2020","author":"M. Balunovic","year":"2020","unstructured":"Balunovic, M., Vechev, M.T.: Adversarial training and provable defenses: bridging the gap. In: 8th International Conference on Learning Representations, ICLR 2020, Addis Ababam, Ethiopia, April 26\u201330, 2020 (2020). https:\/\/openreview.net\/forum?id=SJxSDxrKDr"},{"key":"703_CR7","doi-asserted-by":"publisher","unstructured":"Bojarski, M., Del Testa, D., Dworakowski, D., Firner, B., Flepp, B., Goyal, P., Jackel, L.D., Monfort, M., Muller, U., Zhang, J., Zhang, X., Zhao, J., Zieba, K.: End to end learning for self-driving cars (2016). https:\/\/doi.org\/10.48550\/ARXIV.1604.07316","DOI":"10.48550\/ARXIV.1604.07316"},{"key":"703_CR8","volume-title":"Proceedings of the 34th AAAI Conference on Artificial Intelligence (AAAI20)","author":"E. Botoeva","year":"2020","unstructured":"Botoeva, E., Kouvaros, P., Kronqvist, J., Lomuscio, A., Misener, R.: Efficient verification of neural networks via dependency analysis. In: Proceedings of the 34th AAAI Conference on Artificial Intelligence (AAAI20). AAAI Press, Menlo Park (2020)"},{"key":"703_CR9","unstructured":"Brix, C., Noll, T.: Debona: decoupled boundary network analysis for tighter bounds and faster adversarial robustness proofs. CoRR (2020). arXiv:2006.09040 [abs]"},{"key":"703_CR10","volume-title":"Conference on Uncertainty in Artificial Intelligence","author":"R. Bunel","year":"2020","unstructured":"Bunel, R., De Palma, A., Desmaison, A., Dvijotham, K., Kohli, P., Torr, P.H., Kumar, M.P.: Lagrangian decomposition for neural network verification. In: Conference on Uncertainty in Artificial Intelligence (2020)"},{"key":"703_CR11","first-page":"1574","volume":"21","author":"R. Bunel","year":"2020","unstructured":"Bunel, R., Lu, J., Turkaslan, I., Kohli, P., Torr, P., Kumar, M.P.: Branch and bound for piecewise linear neural network verification. J. Mach. Learn. Res. 21, 1574\u20131612 (2020)","journal-title":"J. Mach. Learn. Res."},{"key":"703_CR12","first-page":"4795","volume-title":"Advances in Neural Information Processing Systems","author":"R. Bunel","year":"2018","unstructured":"Bunel, R., Turkaslan, I., Torr, P.H.S., Kohli, P., Mudigonda, P.K.: A unified view of piecewise linear neural network verification. In: Bengio, S., Wallach, H., Larochelle, H., Grauman, K., Cesa-Bianchi, N., Garnett, R. (eds.) Advances in Neural Information Processing Systems, vol.\u00a031, pp.\u00a04795\u20134804. Curran Associates, Red Hook (2018). https:\/\/proceedings.neurips.cc\/paper\/2018\/hash\/be53d253d6bc3258a8160556dda3e9b2-Abstract.html"},{"key":"703_CR13","doi-asserted-by":"publisher","first-page":"269","DOI":"10.1007\/978-3-319-68167-2_19","volume-title":"International Symposium on Automated Technology for Verification and Analysis","author":"R. Ehlers","year":"2017","unstructured":"Ehlers, R.: Formal verification of piece-wise linear feed-forward neural networks. In: International Symposium on Automated Technology for Verification and Analysis, pp.\u00a0269\u2013286 (2017). https:\/\/doi.org\/10.1007\/978-3-319-68167-2_19"},{"key":"703_CR14","doi-asserted-by":"publisher","DOI":"10.1145\/3365365.3382213","volume-title":"Proceedings of the 23rd International Conference on Hybrid Systems: Computation and Control, HSCC \u201920","author":"J. Ferlez","year":"2020","unstructured":"Ferlez, J., Shoukry, Y.: AReN: assured ReLU NN architecture for model predictive control of LTI systems. In: Proceedings of the 23rd International Conference on Hybrid Systems: Computation and Control, HSCC \u201920. ACM, New York (2020). https:\/\/doi.org\/10.1145\/3365365.3382213"},{"key":"703_CR15","volume-title":"10th International Conference on Learning Representations, ICLR 2022, Virtual Event","author":"C. Ferrari","year":"2022","unstructured":"Ferrari, C., M\u00fcller, M.N., Jovanovic, N., Vechev, M.T.: Complete verification via multi-neuron relaxation guided branch-and-bound. In: 10th International Conference on Learning Representations, ICLR 2022, Virtual Event, April 25\u201329, 2022 (2022). https:\/\/openreview.net\/forum?id=l_amHf1oaK"},{"key":"703_CR16","series-title":"Lecture Notes in Computer Science","doi-asserted-by":"publisher","first-page":"127","DOI":"10.1007\/978-3-031-13185-1_7","volume-title":"Computer Aided Verification \u2013 34th International Conference, CAV 2022, Proceedings, Part I","author":"M. Fischer","year":"2022","unstructured":"Fischer, M., Sprecher, C., Dimitrov, D.I., Singh, G., Vechev, M.T.: Shared certificates for neural network verification. In: Shoham, S., Vizel, Y. (eds.) Computer Aided Verification \u2013 34th International Conference, CAV 2022, Proceedings, Part I, Haifa, Israel, August 7\u201310, 2022. Lecture Notes in Computer Science, vol.\u00a013371, pp.\u00a0127\u2013148. Springer, Berlin (2022). https:\/\/doi.org\/10.1007\/978-3-031-13185-1_7"},{"key":"703_CR17","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1109\/SP.2018.00058","volume-title":"2018 IEEE Symposium on Security and Privacy, SP 2018, Proceedings","author":"T. Gehr","year":"2018","unstructured":"Gehr, T., Mirman, M., Drachsler-Cohen, D., Tsankov, P., Chaudhuri, S., Vechev, M.T.: AI2: safety and robustness certification of neural networks with abstract interpretation. In: 2018 IEEE Symposium on Security and Privacy, SP 2018, Proceedings, San Francisco, California, USA, 21\u201323 May 2018, pp.\u00a03\u201318. IEEE Comput. Soc., Los Alamitos (2018). https:\/\/doi.org\/10.1109\/SP.2018.00058"},{"key":"703_CR18","volume-title":"3rd International Conference on Learning Representations, ICLR 2015, Conference Track Proceedings","author":"I.J. Goodfellow","year":"2015","unstructured":"Goodfellow, I.J., Shlens, J., Szegedy, C.: Explaining and harnessing adversarial examples. In: Bengio, Y., LeCun, Y. (eds.) 3rd International Conference on Learning Representations, ICLR 2015, Conference Track Proceedings, San Diego, CA, USA, May 7\u20139, 2015 (2015). http:\/\/arxiv.org\/abs\/1412.6572"},{"key":"703_CR19","unstructured":"Gowal, S., Dvijotham, K., Stanforth, R., Bunel, R., Qin, C., Uesato, J., Arandjelovic, R., Mann, T.A., Kohli, P.: On the effectiveness of interval bound propagation for training verifiably robust models. CoRR (2018). arXiv:1810.12715 [abs]"},{"key":"703_CR20","doi-asserted-by":"publisher","first-page":"770","DOI":"10.1109\/CVPR.2016.90","volume-title":"2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)","author":"K. He","year":"2016","unstructured":"He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp.\u00a0770\u2013778 (2016). https:\/\/doi.org\/10.1109\/CVPR.2016.90"},{"key":"703_CR21","volume-title":"Proceedings of the 24th European Conference on Artificial Intelligence (ECAI20)","author":"P. Henriksen","year":"2020","unstructured":"Henriksen, P., Lomuscio, A.: Efficient neural network verification via adaptive refinement and adversarial search. In: Proceedings of the 24th European Conference on Artificial Intelligence (ECAI20) (2020)"},{"key":"703_CR22","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2021\/351","volume-title":"Proceedings of the 30th International Joint Conference on Artificial Intelligence (IJCAI21)","author":"P. Henriksen","year":"2021","unstructured":"Henriksen, P., Lomuscio, A.: Deepsplit: an efficient splitting method for neural network verification via indirect effect analysis. In: Proceedings of the 30th International Joint Conference on Artificial Intelligence (IJCAI21) (2021). https:\/\/doi.org\/10.24963\/ijcai.2021\/351"},{"key":"703_CR23","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1007\/978-3-319-63387-9_1","volume-title":"Computer Aided Verification","author":"X. Huang","year":"2017","unstructured":"Huang, X., Kwiatkowska, M., Wang, S., Wu, M.: Safety verification of deep neural networks. In: Majumdar, R., Kun\u010dak, V. (eds.) Computer Aided Verification, pp.\u00a03\u201329. Springer, Cham (2017)"},{"key":"703_CR24","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/DASC.2016.7778091","volume-title":"2016 IEEE\/AIAA 35th Digital Avionics Systems Conference (DASC)","author":"K.D. Julian","year":"2016","unstructured":"Julian, K.D., Lopez, J., Brush, J.S., Owen, M.P., Kochenderfer, M.J.: Policy compression for aircraft collision avoidance systems. In: 2016 IEEE\/AIAA 35th Digital Avionics Systems Conference (DASC), pp.\u00a01\u201310 (2016). https:\/\/doi.org\/10.1109\/DASC.2016.7778091"},{"key":"703_CR25","doi-asserted-by":"publisher","first-page":"97","DOI":"10.1007\/978-3-319-63387-9_5","volume-title":"Computer Aided Verification","author":"G. Katz","year":"2017","unstructured":"Katz, G., Barrett, C., Dill, D.L., Julian, K., Kochenderfer, M.J.: Reluplex: An efficient SMT solver for verifying deep neural networks. In: Majumdar, R., Kun\u010dak, V. (eds.) Computer Aided Verification, pp.\u00a097\u2013117. Springer, Cham (2017)"},{"key":"703_CR26","doi-asserted-by":"publisher","first-page":"443","DOI":"10.1007\/978-3-030-25540-4_26","volume-title":"International Conference on Computer Aided Verification","author":"G. Katz","year":"2019","unstructured":"Katz, G., Huang, D.A., Ibeling, D., Julian, K., Lazarus, C., Lim, R., Shah, P., Thakoor, S., Wu, H., Zelji\u0107, A., et al.: The Marabou framework for verification and analysis of deep neural networks. In: International Conference on Computer Aided Verification, pp.\u00a0443\u2013452. Springer, Berlin (2019)"},{"key":"703_CR27","unstructured":"Khedr, H., Ferlez, J., Shoukry, Y.: Effective formal verification of neural networks using the geometry of linear regions. arXiv preprint (2020). arXiv:2006.10864"},{"key":"703_CR28","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2021\/364","volume-title":"Proceedings of the 30th International Joint Conference on Artificial Intelligence (IJCAI21)","author":"P. Kouvaros","year":"2021","unstructured":"Kouvaros, P., Lomuscio, A.: Towards scalable complete verification of ReLU neural networks via dependency-based branching. In: Proceedings of the 30th International Joint Conference on Artificial Intelligence (IJCAI21) (2021). https:\/\/doi.org\/10.24963\/ijcai.2021\/364"},{"key":"703_CR29","volume-title":"ICLR 2019 Debugging Machine Learning Models Workshop","author":"C. Liu","year":"2019","unstructured":"Liu, C., Arnon, T., Lazarus, C., Kochenderfer, M.J.: Neuralverification.jl: algorithms for verifying deep neural networks. In: ICLR 2019 Debugging Machine Learning Models Workshop (2019). https:\/\/debug-ml-iclr2019.github.io\/cameraready\/DebugML-19_paper_22.pdf"},{"issue":"3\u20134","key":"703_CR30","doi-asserted-by":"publisher","first-page":"244","DOI":"10.1561\/2400000035","volume":"4","author":"C. Liu","year":"2021","unstructured":"Liu, C., Arnon, T., Lazarus, C., Strong, C., Barrett, C., Kochenderfer, M.J.: Algorithms for verifying deep neural networks. Found. Trends Optim. 4(3\u20134), 244\u2013404 (2021). https:\/\/doi.org\/10.1561\/2400000035","journal-title":"Found. Trends Optim."},{"key":"703_CR31","series-title":"EPiC Series in Computing","doi-asserted-by":"publisher","first-page":"142","DOI":"10.29007\/wfgr","volume-title":"Proceedings of 9th International Workshop on Applied Verification of Continuous and Hybrid Systems (ARCH22)","author":"D.M. Lopez","year":"2022","unstructured":"Lopez, D.M., Althoff, M., Benet, L., Chen, X., Fan, J., Forets, M., Huang, C., Johnson, T.T., Ladner, T., Li, W., Schilling, C., Zhu, Q.: Arch-comp22 category report: artificial intelligence and neural network control systems (AINNCS) for continuous and hybrid systems plants. In: Frehse, G., Althoff, M., Schoitsch, E., Guiochet, J. (eds.) Proceedings of 9th International Workshop on Applied Verification of Continuous and Hybrid Systems (ARCH22). EPiC Series in Computing, vol.\u00a090, pp.\u00a0142\u2013184 (2022). https:\/\/doi.org\/10.29007\/wfgr"},{"key":"703_CR32","series-title":"EPiC Series in Computing","doi-asserted-by":"publisher","first-page":"103","DOI":"10.29007\/rgv8","volume-title":"ARCH19. 6th International Workshop on Applied Verification of Continuous and Hybrid Systems","author":"D.M. Lopez","year":"2019","unstructured":"Lopez, D.M., Musau, P., Tran, H.D., Dutta, S., Carpenter, T.J., Ivanov, R., Johnson, T.T.: Arch-comp19 category report: artificial intelligence and neural network control systems (ainncs) for continuous and hybrid systems plants. In: Frehse, G., Althoff, M. (eds.) ARCH19. 6th International Workshop on Applied Verification of Continuous and Hybrid Systems. EPiC Series in Computing, vol.\u00a061, pp.\u00a0103\u2013119 (2019). https:\/\/doi.org\/10.29007\/rgv8"},{"key":"703_CR33","volume-title":"International Conference on Learning Representations","author":"J. Lu","year":"2020","unstructured":"Lu, J., Kumar, M.P.: Neural network branching for neural network verification. In: International Conference on Learning Representations (2020)"},{"key":"703_CR34","volume-title":"6th International Conference on Learning Representations, ICLR 2018, Conference Track Proceedings","author":"A. Madry","year":"2018","unstructured":"Madry, A., Makelov, A., Schmidt, L., Tsipras, D., Vladu, A.: Towards deep learning models resistant to adversarial attacks. In: 6th International Conference on Learning Representations, ICLR 2018, Conference Track Proceedings, Vancouver, BC, Canada, April 30\u2013May 3, 2018 (2018). https:\/\/openreview.net\/forum?id=rJzIBfZAb"},{"key":"703_CR35","series-title":"Proceedings of Machine Learning Research","first-page":"3575","volume-title":"Proceedings of the 35th International Conference on Machine Learning, ICML 2018","author":"M. Mirman","year":"2018","unstructured":"Mirman, M., Gehr, T., Vechev, M.T.: Differentiable abstract interpretation for provably robust neural networks. In: Dy, J.G., Krause, A. (eds.) Proceedings of the 35th International Conference on Machine Learning, ICML 2018, Stockholmsm\u00e4ssan, Stockholm, Sweden, July 10\u201315, 2018. Proceedings of Machine Learning Research, vol.\u00a080, pp.\u00a03575\u20133583 (2018). http:\/\/proceedings.mlr.press\/v80\/mirman18b.html"},{"key":"703_CR36","doi-asserted-by":"publisher","unstructured":"M\u00fcller, M.N., Brix, C., Bak, S., Liu, C., Johnson, T.T.: The third international verification of neural networks competition (VNN-COMP 2022): summary and results (2022). https:\/\/doi.org\/10.48550\/arXiv.2212.10376","DOI":"10.48550\/arXiv.2212.10376"},{"key":"703_CR37","doi-asserted-by":"publisher","unstructured":"M\u00fcller, M.N., Eckert, F., Fischer, M., Vechev, M.T.: Certified training: small boxes are all you need. CoRR (2022). https:\/\/doi.org\/10.48550\/arXiv.2210.04871","DOI":"10.48550\/arXiv.2210.04871"},{"key":"703_CR38","doi-asserted-by":"crossref","unstructured":"M\u00fcller, M.N., Makarchuk, G., Singh, G., P\u00fcschel, M., Vechev, M.: Prima: precise and general neural network certification via multi-neuron convex relaxations. arXiv preprint (2021). arXiv:2103.03638","DOI":"10.1145\/3498704"},{"key":"703_CR39","volume-title":"22nd International Conference on Formal Methods in Computer-Aided Design (FMCAD)","author":"O. Isac","year":"2022","unstructured":"Isac, O., Barrett, C., Zhang, M., Katz, G.: Neural network verification with proof production. In: 22nd International Conference on Formal Methods in Computer-Aided Design (FMCAD) (2022)"},{"key":"703_CR40","volume-title":"9th International Conference on Learning Representations, ICLR 2021, Conference Track Proceedings","author":"A. De Palma","year":"2021","unstructured":"De Palma, A., Behl, H.S., Bunel, R., Torr, P.H.S., Kumar, M.P.: Scaling the convex barrier with active sets. In: 9th International Conference on Learning Representations, ICLR 2021, Conference Track Proceedings, May 3\u20137, 2021 (2021). https:\/\/openreview.net\/forum?id=uQfOy7LrlTR"},{"key":"703_CR41","doi-asserted-by":"publisher","unstructured":"De Palma, A., Behl, H.S., Bunel, R., Torr, P.H.S., Kumar, M.P.: Scaling the convex barrier with sparse dual algorithms. CoRR (2021). https:\/\/doi.org\/10.48550\/arXiv.2101.05844","DOI":"10.48550\/arXiv.2101.05844"},{"key":"703_CR42","doi-asserted-by":"publisher","unstructured":"De Palma, A., Bunel, R., Desmaison, Alban., Dvijotham, K., Kohli, P., Torr, P.H.S., Kumar, M.P.: Improved branch and bound for neural network verification via lagrangian decomposition. CoRR (2021). https:\/\/doi.org\/10.48550\/arXiv.2104.06718","DOI":"10.48550\/arXiv.2104.06718"},{"key":"703_CR43","doi-asserted-by":"publisher","unstructured":"De Palma, A., Bunel, R., Dvijotham, K., Kumar, M.P., Stanforth, R.: IBP regularization for verified adversarial robustness via branch-and-bound. (2022). https:\/\/doi.org\/10.48550\/arXiv.2206.14772","DOI":"10.48550\/arXiv.2206.14772"},{"key":"703_CR44","volume-title":"Proc. Machine Learning and Systems (MLSys)","author":"F. Serre","year":"2021","unstructured":"Serre, F., M\u00fcller, C., Singh, G., P\u00fcschel, M., Vechev, M.: Scaling polyhedral neural network verification on GPUs. In: Proc. Machine Learning and Systems (MLSys) (2021)"},{"key":"703_CR45","first-page":"18335","volume-title":"Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, NeurIPS 2021, Virtual","author":"Z. Shi","year":"2021","unstructured":"Shi, Z., Wang, Y., Zhang, H., Yi, J., Hsieh, C.: Fast certified robust training with short warmup. In: Ranzato, M., Beygelzimer, A., Dauphin, Y.N., Liang, P., Vaughan, J.W. (eds.) Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, NeurIPS 2021, Virtual, December 6\u201314, 2021, pp.\u00a018335\u201318349 (2021). https:\/\/proceedings.neurips.cc\/paper\/2021\/hash\/988f9153ac4fd966ea302dd9ab9bae15-Abstract.html"},{"key":"703_CR46","doi-asserted-by":"publisher","first-page":"137","DOI":"10.1007\/978-3-030-81685-8_6","volume-title":"Computer Aided Verification","author":"D. Shriver","year":"2021","unstructured":"Shriver, D., Elbaum, S., Dwyer, M.B.: DNNV: a framework for deep neural network verification. In: Silva, A., Leino, K.R.M. (eds.) Computer Aided Verification, pp.\u00a0137\u2013150. Springer, Cham (2021)"},{"key":"703_CR47","doi-asserted-by":"publisher","first-page":"275","DOI":"10.1109\/ICSE43902.2021.00036","volume-title":"43rd IEEE\/ACM International Conference on Software Engineering, ICSE 2021","author":"D. Shriver","year":"2021","unstructured":"Shriver, D., Elbaum, S.G., Dwyer, M.B.: Reducing DNN properties to enable falsification with adversarial attacks. In: 43rd IEEE\/ACM International Conference on Software Engineering, ICSE 2021, Madrid, Spain, 22\u201330 May 2021, pp.\u00a0275\u2013287. IEEE (2021). https:\/\/doi.org\/10.1109\/ICSE43902.2021.00036"},{"key":"703_CR48","first-page":"15098","volume-title":"Advances in Neural Information Processing Systems","author":"G. Singh","year":"2019","unstructured":"Singh, G., Ganvir, R., P\u00fcschel, M., Vechev, M.: Beyond the single neuron convex barrier for neural network certification. In: Advances in Neural Information Processing Systems, vol.\u00a032, pp.\u00a015098\u201315109. Curran Associates, Red Hook (2019)"},{"key":"703_CR49","first-page":"10802","volume-title":"Advances in Neural Information Processing Systems","author":"G. Singh","year":"2018","unstructured":"Singh, G., Gehr, T., Mirman, M., P\u00fcschel, M., Vechev, M.: Fast and effective robustness certification. In: Bengio, S., Wallach, H., Larochelle, H., Grauman, K., Cesa-Bianchi, N., Garnett, R. (eds.) Advances in Neural Information Processing Systems, vol.\u00a031, pp.\u00a010802\u201310813. Curran Associates, Red Hook (2018). http:\/\/papers.nips.cc\/paper\/8278-fast-and-effective-robustness-certification.pdf"},{"issue":"POPL","key":"703_CR50","doi-asserted-by":"publisher","first-page":"41:1","DOI":"10.1145\/3290354","volume":"3","author":"G. Singh","year":"2019","unstructured":"Singh, G., Gehr, T., P\u00fcschel, M., Vechev, M.: An abstract domain for certifying neural networks. Proc. ACM Program. Lang. 3(POPL), 41:1\u201341:30 (2019)","journal-title":"Proc. ACM Program. Lang."},{"key":"703_CR51","volume-title":"Proc. International Conference on Learning Representations (ICLR)","author":"G. Singh","year":"2019","unstructured":"Singh, G., Gehr, T., P\u00fcschel, M., Vechev, M.: Boosting robustness certification of neural networks. In: Proc. International Conference on Learning Representations (ICLR) (2019)"},{"key":"703_CR52","volume-title":"2nd International Conference on Learning Representations, ICLR 2014, Conference Track Proceedings","author":"C. Szegedy","year":"2014","unstructured":"Szegedy, C., Zaremba, W., Sutskever, I., Bruna, J., Erhan, D., Goodfellow, I.J., Fergus, R.: Intriguing properties of neural networks. In: Bengio, Y., LeCun, Y. (eds.) 2nd International Conference on Learning Representations, ICLR 2014, Conference Track Proceedings, Banff, AB, Canada, April 14\u201316, 2014 (2014). http:\/\/arxiv.org\/abs\/1312.6199"},{"key":"703_CR53","unstructured":"Tacchella, A., Pulina, L., Guidotti, D., Demarchi, S.: The verification of neural networks library (VNN-LIB) (2019). https:\/\/www.vnnlib.org"},{"key":"703_CR54","volume-title":"ICLR","author":"V. Tjeng","year":"2019","unstructured":"Tjeng, V., Xiao, K.Y., Tedrake, R.: Evaluating robustness of neural networks with mixed integer programming. In: ICLR (2019)"},{"key":"703_CR55","volume-title":"32nd International Conference on Computer-Aided Verification (CAV)","author":"H.D. Tran","year":"2020","unstructured":"Tran, H.D., Bak, S., Xiang, W., Johnson, T.T.: Verification of deep convolutional neural networks using imagestars. In: 32nd International Conference on Computer-Aided Verification (CAV). Springer, Berlin (2020)"},{"key":"703_CR56","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1109\/FormaliSE.2019.00012","volume-title":"Proceedings of the 7th International Workshop on Formal Methods in Software Engineering (FormaliSE\u201919), FormaliSE \u201919","author":"H.D. Tran","year":"2019","unstructured":"Tran, H.D., Musau, P., Lopez, D.M., Yang, X., Nguyen, L.V., Xiang, W., Johnson, T.T.: Parallelizable reachability analysis algorithms for feed-forward neural networks. In: Proceedings of the 7th International Workshop on Formal Methods in Software Engineering (FormaliSE\u201919), FormaliSE \u201919, pp.\u00a031\u201340. IEEE Press, Piscataway (2019). https:\/\/doi.org\/10.1109\/FormaliSE.2019.00012"},{"key":"703_CR57","volume-title":"23rd International Symposium on Formal Methods (FM\u201919)","author":"H.D. Tran","year":"2019","unstructured":"Tran, H.D., Musau, P., Lopez, D.M., Yang, X., Nguyen, L.V., Xiang, W., Johnson, T.T.: Star-based reachability analysis for deep neural networks. In: 23rd International Symposium on Formal Methods (FM\u201919). Springer, Berlin (2019)"},{"key":"703_CR58","volume-title":"32nd International Conference on Computer-Aided Verification (CAV)","author":"H.D. Tran","year":"2020","unstructured":"Tran, H.D., Yang, X., Lopez, D.M., Musau, P., Nguyen, L.V., Xiang, W., Bak, S., Johnson, T.T.: NNV: the neural network verification tool for deep neural networks and learning-enabled cyber-physical systems. In: 32nd International Conference on Computer-Aided Verification (CAV) (2020)"},{"key":"703_CR59","doi-asserted-by":"crossref","unstructured":"Vincent, J.A., Schwager, M.: Reachable polyhedral marching (RPM): a\u00a0safety verification algorithm for robotic systems with deep neural network components (2021)","DOI":"10.1109\/ICRA48506.2021.9561956"},{"key":"703_CR60","unstructured":"Wang, S., Zhang, H., Xu, K., Lin, X., Jana, S., Hsieh, C.J., Kolter, Z.: Beta-CROWN: efficient bound propagation with per-neuron split constraints for complete and incomplete neural network verification. arXiv preprint (2021). arXiv:2103.06624"},{"issue":"11","key":"703_CR61","doi-asserted-by":"publisher","first-page":"5777","DOI":"10.1109\/TNNLS.2018.2808470","volume":"29","author":"W. Xiang","year":"2018","unstructured":"Xiang, W., Tran, H., Johnson, T.T.: Output reachable set estimation and verification for multilayer neural networks. IEEE Trans. Neural Netw. Learn. Syst. 29(11), 5777\u20135783 (2018)","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"703_CR62","volume-title":"Advances in Neural Information Processing Systems","author":"K. Xu","year":"2020","unstructured":"Xu, K., Shi, Z., Zhang, H., Wang, Y., Chang, K.W., Huang, M., Kailkhura, B., Lin, X., Hsieh, C.J.: Automatic perturbation analysis for scalable certified robustness and beyond. In: Advances in Neural Information Processing Systems, vol.\u00a033 (2020)"},{"key":"703_CR63","volume-title":"International Conference on Learning Representations","author":"K. Xu","year":"2021","unstructured":"Xu, K., Zhang, H., Wang, S., Wang, Y., Jana, S., Lin, X., Hsieh, C.J.: Fast and complete: enabling complete neural network verification with rapid and massively parallel incomplete verifiers. In: International Conference on Learning Representations (2021). https:\/\/openreview.net\/forum?id=nVZtXBI6LNn"},{"issue":"1","key":"703_CR64","doi-asserted-by":"publisher","first-page":"565","DOI":"10.1613\/jair.2490","volume":"32","author":"L. Xu","year":"2008","unstructured":"Xu, L., Hutter, F., Hoos, H.H., Leyton-Brown, K.: SATzilla: portfolio-based algorithm selection for SAT. J. Artif. Intell. Res. 32(1), 565\u2013606 (2008)","journal-title":"J. Artif. Intell. Res."},{"key":"703_CR65","volume-title":"8th International Conference on Learning Representations, ICLR 2020","author":"H. Zhang","year":"2020","unstructured":"Zhang, H., Chen, H., Xiao, C., Gowal, S., Stanforth, R., Li, B., Boning, D.S., Hsieh, C.: Towards stable and efficient training of verifiably robust neural networks. In: 8th International Conference on Learning Representations, ICLR 2020, Addis Ababa, Ethiopia, April 26\u201330, 2020 (2020). https:\/\/openreview.net\/forum?id=Skxuk1rFwB"},{"key":"703_CR66","doi-asserted-by":"publisher","unstructured":"Zhang, H., Wang, S., Xu, K., Li, L., Li, B., Jana, S., Hsieh, C., Kolter, J.Z.: General cutting planes for bound-propagation-based neural network verification. CoRR (2022). https:\/\/doi.org\/10.48550\/arXiv.2208.05740","DOI":"10.48550\/arXiv.2208.05740"},{"key":"703_CR67","first-page":"4944","volume-title":"Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018, NeurIPS 2018","author":"H. Zhang","year":"2018","unstructured":"Zhang, H., Weng, T., Chen, P., Hsieh, C., Daniel, L.: Efficient neural network robustness certification with general activation functions. In: Bengio, S., Wallach, H.M., Larochelle, H., Grauman, K., Cesa-Bianchi, N., Garnett, R. (eds.) Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018, NeurIPS 2018, Montr\u00e9al, Canada, December 3\u20138, 2018, pp.\u00a04944\u20134953 (2018). https:\/\/proceedings.neurips.cc\/paper\/2018\/hash\/d04863f100d59b3eb688a11f95b0ae60-Abstract.html"},{"key":"703_CR68","first-page":"4939","volume":"31","author":"H. Zhang","year":"2018","unstructured":"Zhang, H., Weng, T.W., Chen, P.Y., Hsieh, C.J., Daniel, L.: Efficient neural network robustness certification with general activation functions. Adv. Neural Inf. Process. Syst. 31, 4939\u20134948 (2018). https:\/\/arxiv.org\/pdf\/1811.00866.pdf","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"703_CR69","doi-asserted-by":"publisher","first-page":"71","DOI":"10.1109\/ICNN.1988.23914","volume-title":"IEEE 1988 International Conference on Neural Networks","author":"C. Zhou","year":"1988","unstructured":"Zhou, C.: Computation of optical flow using a neural network. In: IEEE 1988 International Conference on Neural Networks, vol.\u00a02, pp.\u00a071\u201378 (1988). https:\/\/doi.org\/10.1109\/ICNN.1988.23914"}],"container-title":["International Journal on Software Tools for Technology Transfer"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10009-023-00703-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10009-023-00703-4\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10009-023-00703-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,9,19]],"date-time":"2023-09-19T09:10:51Z","timestamp":1695114651000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10009-023-00703-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,30]]},"references-count":69,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2023,6]]}},"alternative-id":["703"],"URL":"https:\/\/doi.org\/10.1007\/s10009-023-00703-4","relation":{},"ISSN":["1433-2779","1433-2787"],"issn-type":[{"value":"1433-2779","type":"print"},{"value":"1433-2787","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,5,30]]},"assertion":[{"value":"14 January 2023","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"30 May 2023","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}