{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:14:58Z","timestamp":1750220098841,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":30,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,5,4]],"date-time":"2022-05-04T00:00:00Z","timestamp":1651622400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,5,4]]},"DOI":"10.1145\/3501710.3519540","type":"proceedings-article","created":{"date-parts":[[2022,4,28]],"date-time":"2022-04-28T14:28:32Z","timestamp":1651156112000},"page":"1-16","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Verification of machine learning based cyber-physical systems: a comparative study"],"prefix":"10.1145","author":[{"given":"Arthur","family":"Clavi\u00e8re","sequence":"first","affiliation":[{"name":"Collins Aerospace, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Laura","family":"Altieri Sambartolom\u00e9","sequence":"additional","affiliation":[{"name":"Collins Aerospace, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Eric","family":"Asselin","sequence":"additional","affiliation":[{"name":"Collins Aerospace, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Christophe","family":"Garion","sequence":"additional","affiliation":[{"name":"ISAE-SUPAERO, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Claire","family":"Pagetti","sequence":"additional","affiliation":[{"name":"ONERA, France"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,5,4]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.24963\/kr.2020\/3"},{"key":"e_1_3_2_1_2_1","volume-title":"Validated Explicit and Implicit Runge-Kutta Methods. Reliable Computing electronic edition 22 (July","author":"Sandretto Julien Alexandre\u00a0dit","year":"2016","unstructured":"Julien Alexandre\u00a0dit Sandretto and Alexandre Chapoutot . 2016. Validated Explicit and Implicit Runge-Kutta Methods. Reliable Computing electronic edition 22 (July 2016 ). Julien Alexandre\u00a0dit Sandretto and Alexandre Chapoutot. 2016. Validated Explicit and Implicit Runge-Kutta Methods. Reliable Computing electronic edition 22 (July 2016)."},{"key":"e_1_3_2_1_3_1","volume-title":"1st and 2nd International Workshop on Applied veRification for Continuous and Hybrid Systems(EPiC Series in Computing, Vol.\u00a034)","author":"Althoff Matthias","year":"2015","unstructured":"Matthias Althoff . 2015 . An Introduction to CORA 2015. In ARCH14-15 . 1st and 2nd International Workshop on Applied veRification for Continuous and Hybrid Systems(EPiC Series in Computing, Vol.\u00a034) , Goran Frehseand Matthias Althoff (Eds.). 120\u2013151. Matthias Althoff. 2015. An Introduction to CORA 2015. In ARCH14-15. 1st and 2nd International Workshop on Applied veRification for Continuous and Hybrid Systems(EPiC Series in Computing, Vol.\u00a034), Goran Frehseand Matthias Althoff (Eds.). 120\u2013151."},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1016\/0304-3975(94)00202-T"},{"volume-title":"Simulation-Equivalent Reachability of Large Linear Systems with Inputs","author":"Bak Stanley","key":"e_1_3_2_1_5_1","unstructured":"Stanley Bak and Parasara\u00a0Sridhar Duggirala . 2017. Simulation-Equivalent Reachability of Large Linear Systems with Inputs . In Computer Aided Verification, Rupak Majumdar and Viktor Kun\u010dak (Eds.). Springer International Publishing , Cham , 401\u2013420. Stanley Bak and Parasara\u00a0Sridhar Duggirala. 2017. Simulation-Equivalent Reachability of Large Linear Systems with Inputs. In Computer Aided Verification, Rupak Majumdar and Viktor Kun\u010dak (Eds.). Springer International Publishing, Cham, 401\u2013420."},{"key":"e_1_3_2_1_6_1","volume-title":"Periodically-Scheduled Controller Analysis Using Hybrid Systems Reachability and Continuization. In 2015 IEEE Real-Time Systems Symposium. 195\u2013205","author":"Bak Stanley","year":"2015","unstructured":"Stanley Bak and Taylor\u00a0 T. Johnson . 2015 . Periodically-Scheduled Controller Analysis Using Hybrid Systems Reachability and Continuization. In 2015 IEEE Real-Time Systems Symposium. 195\u2013205 . Stanley Bak and Taylor\u00a0T. Johnson. 2015. Periodically-Scheduled Controller Analysis Using Hybrid Systems Reachability and Continuization. In 2015 IEEE Real-Time Systems Symposium. 195\u2013205."},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3302504.3311813"},{"key":"e_1_3_2_1_8_1","unstructured":"Mariusz Bojarski David\u00a0W. del Testa Daniel Dworakowski Bernhard Firner Beat Flepp Prasoon Goyal Lawrence\u00a0D. Jackel Mathew Monfort Urs Muller Jiakai Zhang Xin Zhang Jake Zhao and Karol Zieba. 2016. End to End Learning for Self-Driving Cars. ArXiv abs\/1604.07316(2016).  Mariusz Bojarski David\u00a0W. del Testa Daniel Dworakowski Bernhard Firner Beat Flepp Prasoon Goyal Lawrence\u00a0D. Jackel Mathew Monfort Urs Muller Jiakai Zhang Xin Zhang Jake Zhao and Karol Zieba. 2016. End to End Learning for Self-Driving Cars. ArXiv abs\/1604.07316(2016)."},{"key":"e_1_3_2_1_9_1","volume-title":"DeepDriving: Learning Affordance for Direct Perception in Autonomous Driving. In 2015 IEEE International Conference on Computer Vision (ICCV). 2722\u20132730","author":"Chen Chenyi","year":"2015","unstructured":"Chenyi Chen , Ari Seff , Alain Kornhauser , and Jianxiong Xiao . 2015 . DeepDriving: Learning Affordance for Direct Perception in Autonomous Driving. In 2015 IEEE International Conference on Computer Vision (ICCV). 2722\u20132730 . https:\/\/doi.org\/10.1109\/ICCV.2015.312 10.1109\/ICCV.2015.312 Chenyi Chen, Ari Seff, Alain Kornhauser, and Jianxiong Xiao. 2015. DeepDriving: Learning Affordance for Direct Perception in Autonomous Driving. In 2015 IEEE International Conference on Computer Vision (ICCV). 2722\u20132730. https:\/\/doi.org\/10.1109\/ICCV.2015.312"},{"key":"e_1_3_2_1_10_1","volume-title":"CAV 2013, Saint Petersburg, Russia, July 13-19, 2013. Proceedings(Lecture Notes in Computer Science, Vol.\u00a08044)","author":"Chen Xin","year":"2013","unstructured":"Xin Chen , Erika \u00c1brah\u00e1m , and Sriram Sankaranarayanan . 2013 . Flow*: An Analyzer for Non-linear Hybrid Systems. In Computer Aided Verification - 25th International Conference , CAV 2013, Saint Petersburg, Russia, July 13-19, 2013. Proceedings(Lecture Notes in Computer Science, Vol.\u00a08044) , Natasha Sharygina and Helmut Veith (Eds.). Springer, 258\u2013263. Xin Chen, Erika \u00c1brah\u00e1m, and Sriram Sankaranarayanan. 2013. Flow*: An Analyzer for Non-linear Hybrid Systems. In Computer Aided Verification - 25th International Conference, CAV 2013, Saint Petersburg, Russia, July 13-19, 2013. Proceedings(Lecture Notes in Computer Science, Vol.\u00a08044), Natasha Sharygina and Helmut Veith (Eds.). Springer, 258\u2013263."},{"key":"e_1_3_2_1_11_1","volume-title":"Safety Verification of Neural Network Controlled Systems. In 2021 51st Annual IEEE\/IFIP International Conference on Dependable Systems and Networks Workshops (DSN-W). 47\u201354","author":"Clavi\u00e8re Arthur","year":"2021","unstructured":"Arthur Clavi\u00e8re , Eric Asselin , Christophe Garion , and Claire Pagetti . 2021 . Safety Verification of Neural Network Controlled Systems. In 2021 51st Annual IEEE\/IFIP International Conference on Dependable Systems and Networks Workshops (DSN-W). 47\u201354 . https:\/\/doi.org\/10.1109\/DSN-W52860.2021.00019 10.1109\/DSN-W52860.2021.00019 Arthur Clavi\u00e8re, Eric Asselin, Christophe Garion, and Claire Pagetti. 2021. Safety Verification of Neural Network Controlled Systems. In 2021 51st Annual IEEE\/IFIP International Conference on Dependable Systems and Networks Workshops (DSN-W). 47\u201354. https:\/\/doi.org\/10.1109\/DSN-W52860.2021.00019"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3302504.3311807"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/SP.2018.00058"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3358228"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3302504.3311806"},{"volume-title":"Guaranteeing Safety for Neural Network-Based Aircraft Collision Avoidance Systems. In 2019 IEEE\/AIAA 38th Digital Avionics Systems Conference (DASC).","author":"D.","key":"e_1_3_2_1_16_1","unstructured":"Kyle\u00a0 D. Julian and Mykel\u00a0J. Kochenderfer. 2019 . Guaranteeing Safety for Neural Network-Based Aircraft Collision Avoidance Systems. In 2019 IEEE\/AIAA 38th Digital Avionics Systems Conference (DASC). Kyle\u00a0D. Julian and Mykel\u00a0J. Kochenderfer. 2019. Guaranteeing Safety for Neural Network-Based Aircraft Collision Avoidance Systems. In 2019 IEEE\/AIAA 38th Digital Avionics Systems Conference (DASC)."},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.2514\/1.G003724"},{"key":"e_1_3_2_1_18_1","volume-title":"Reluplex: An Efficient SMT Solver for Verifying Deep Neural Networks","author":"Katz Guy","year":"2017","unstructured":"Guy Katz , Clark Barrett , David\u00a0 L. Dill , Kyle Julian , and Mykel\u00a0 J. Kochenderfer . 2017 . Reluplex: An Efficient SMT Solver for Verifying Deep Neural Networks . In Computer Aided Verification, Rupak Majumdar and Viktor Kun\u010dak (Eds.). Springer International Publishing , Cham , 97\u2013117. Guy Katz, Clark Barrett, David\u00a0L. Dill, Kyle Julian, and Mykel\u00a0J. Kochenderfer. 2017. Reluplex: An Efficient SMT Solver for Verifying Deep Neural Networks. In Computer Aided Verification, Rupak Majumdar and Viktor Kun\u010dak (Eds.). Springer International Publishing, Cham, 97\u2013117."},{"key":"#cr-split#-e_1_3_2_1_19_1.1","doi-asserted-by":"crossref","unstructured":"Diego\u00a0Manzanas Lopez Taylor Johnson Hoang-Dung Tran Stanley Bak Xin Chen and Kerianne\u00a0L. Hobbs. [n.d.]. Verification of Neural Network Compression of ACAS Xu Lookup Tables with Star Set Reachability. In AIAA Scitech 2021 Forum. https:\/\/doi.org\/10.2514\/6.2021-0995 arXiv:https:\/\/arc.aiaa.org\/doi\/pdf\/10.2514\/6.2021-0995 10.2514\/6.2021-0995","DOI":"10.2514\/6.2021-0995"},{"key":"#cr-split#-e_1_3_2_1_19_1.2","doi-asserted-by":"crossref","unstructured":"Diego\u00a0Manzanas Lopez Taylor Johnson Hoang-Dung Tran Stanley Bak Xin Chen and Kerianne\u00a0L. Hobbs. [n.d.]. Verification of Neural Network Compression of ACAS Xu Lookup Tables with Star Set Reachability. In AIAA Scitech 2021 Forum. https:\/\/doi.org\/10.2514\/6.2021-0995 arXiv:https:\/\/arc.aiaa.org\/doi\/pdf\/10.2514\/6.2021-0995","DOI":"10.2514\/6.2021-0995"},{"key":"e_1_3_2_1_20_1","volume-title":"6th International Workshop on Applied Verification of Continuous and Hybrid Systemsi, part of CPS-IoT Week 2019","author":"Lopez Diego\u00a0Manzanas","year":"2019","unstructured":"Diego\u00a0Manzanas Lopez , Patrick Musau , Hoang-Dung Tran , Souradeep Dutta , Taylor\u00a0 J. Carpenter , Radoslav Ivanov , and Taylor\u00a0 T. Johnson . 2019 . ARCH-COMP19 Category Report: Artificial Intelligence and Neural Network Control Systems (AINNCS) for Continuous and Hybrid Systems Plants. In ARCH19 . 6th International Workshop on Applied Verification of Continuous and Hybrid Systemsi, part of CPS-IoT Week 2019 , Montreal, QC, Canada , April 15, 2019. 103\u2013119. Diego\u00a0Manzanas Lopez, Patrick Musau, Hoang-Dung Tran, Souradeep Dutta, Taylor\u00a0J. Carpenter, Radoslav Ivanov, and Taylor\u00a0T. Johnson. 2019. ARCH-COMP19 Category Report: Artificial Intelligence and Neural Network Control Systems (AINNCS) for Continuous and Hybrid Systems Plants. In ARCH19. 6th International Workshop on Applied Verification of Continuous and Hybrid Systemsi, part of CPS-IoT Week 2019, Montreal, QC, Canada, April 15, 2019. 103\u2013119."},{"key":"e_1_3_2_1_21_1","unstructured":"Diego Manzanas. 2020. ACAS Xu. https:\/\/github.com\/mldiego\/AcasXu.  Diego Manzanas. 2020. ACAS Xu. https:\/\/github.com\/mldiego\/AcasXu."},{"volume-title":"Differential Dynamical Systems","author":"Meiss D.","key":"e_1_3_2_1_22_1","unstructured":"James\u00a0 D. Meiss . 2007. Differential Dynamical Systems . Society of Industrial and Applied Mathematics (SIAM) . James\u00a0D. Meiss. 2007. Differential Dynamical Systems. Society of Industrial and Applied Mathematics (SIAM)."},{"key":"e_1_3_2_1_23_1","unstructured":"Yunpeng Pan Ching-An Cheng Kamil Saigol Keuntaek Lee Xinyan Yan Evangelos\u00a0A. Theodorou and Byron Boots. 2018. Agile Autonomous Driving using End-to-End Deep Imitation Learning. In Robotics: Science and Systems.  Yunpeng Pan Ching-An Cheng Kamil Saigol Keuntaek Lee Xinyan Yan Evangelos\u00a0A. Theodorou and Byron Boots. 2018. Agile Autonomous Driving using End-to-End Deep Imitation Learning. In Robotics: Science and Systems."},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290354"},{"key":"e_1_3_2_1_25_1","unstructured":"Stanford Intelligent Systems\u00a0Laboratory (SISL). 2020. VCAS. https:\/\/github.com\/sisl\/VerticalCAS.  Stanford Intelligent Systems\u00a0Laboratory (SISL). 2020. VCAS. https:\/\/github.com\/sisl\/VerticalCAS."},{"key":"e_1_3_2_1_26_1","volume-title":"CAV 2020, Los Angeles, CA, USA, July 21-24, 2020, Proceedings, Part I. 3\u201317","author":"Tran Hoang-Dung","year":"2020","unstructured":"Hoang-Dung Tran , Xiaodong Yang , Diego\u00a0Manzanas Lopez , Patrick Musau , Luan\u00a0Viet Nguyen , Weiming Xiang , Stanley Bak , and Taylor\u00a0 T. Johnson . 2020 . NNV: The Neural Network Verification Tool for Deep Neural Networks and Learning-Enabled Cyber-Physical Systems. In Computer Aided Verification - 32nd International Conference , CAV 2020, Los Angeles, CA, USA, July 21-24, 2020, Proceedings, Part I. 3\u201317 . Hoang-Dung Tran, Xiaodong Yang, Diego\u00a0Manzanas Lopez, Patrick Musau, Luan\u00a0Viet Nguyen, Weiming Xiang, Stanley Bak, and Taylor\u00a0T. Johnson. 2020. NNV: The Neural Network Verification Tool for Deep Neural Networks and Learning-Enabled Cyber-Physical Systems. In Computer Aided Verification - 32nd International Conference, CAV 2020, Los Angeles, CA, USA, July 21-24, 2020, Proceedings, Part I. 3\u201317."},{"volume-title":"Formal Methods \u2013 The Next 30 Years, Maurice\u00a0H. ter Beek, Annabelle McIver, and Jos\u00e9\u00a0N","author":"Tran Hoang-Dung","key":"e_1_3_2_1_27_1","unstructured":"Hoang-Dung Tran , Diago Manzanas\u00a0Lopez , Patrick Musau , Xiaodong Yang , Luan\u00a0Viet Nguyen , Weiming Xiang , and Taylor\u00a0 T. Johnson . 2019. Star-Based Reachability Analysis of Deep Neural Networks . In Formal Methods \u2013 The Next 30 Years, Maurice\u00a0H. ter Beek, Annabelle McIver, and Jos\u00e9\u00a0N . Oliveira (Eds.). Springer International Publishing , Cham , 670\u2013686. Hoang-Dung Tran, Diago Manzanas\u00a0Lopez, Patrick Musau, Xiaodong Yang, Luan\u00a0Viet Nguyen, Weiming Xiang, and Taylor\u00a0T. Johnson. 2019. Star-Based Reachability Analysis of Deep Neural Networks. In Formal Methods \u2013 The Next 30 Years, Maurice\u00a0H. ter Beek, Annabelle McIver, and Jos\u00e9\u00a0N. Oliveira (Eds.). Springer International Publishing, Cham, 670\u2013686."},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.5555\/AAI28288437"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/CDC.2001.980443"}],"event":{"name":"HSCC '22: 25th ACM International Conference on Hybrid Systems: Computation and Control","sponsor":["SIGBED ACM Special Interest Group on Embedded Systems"],"location":"Milan Italy","acronym":"HSCC '22"},"container-title":["25th ACM International Conference on Hybrid Systems: Computation and Control"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3501710.3519540","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3501710.3519540","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T18:10:11Z","timestamp":1750183811000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3501710.3519540"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,5,4]]},"references-count":30,"alternative-id":["10.1145\/3501710.3519540","10.1145\/3501710"],"URL":"https:\/\/doi.org\/10.1145\/3501710.3519540","relation":{},"subject":[],"published":{"date-parts":[[2022,5,4]]},"assertion":[{"value":"2022-05-04","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}