{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,6]],"date-time":"2026-06-06T01:11:16Z","timestamp":1780708276707,"version":"3.54.1"},"publisher-location":"New York, NY, USA","reference-count":87,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,8,9]],"date-time":"2021-08-09T00:00:00Z","timestamp":1628467200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100003977","name":"Israel Science Foundation","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100003977","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Binational Science Foundation"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,8,9]]},"DOI":"10.1145\/3452296.3472936","type":"proceedings-article","created":{"date-parts":[[2021,8,9]],"date-time":"2021-08-09T18:13:15Z","timestamp":1628532795000},"page":"305-318","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":40,"title":["Verifying learning-augmented systems"],"prefix":"10.1145","author":[{"given":"Tomer","family":"Eliyahu","sequence":"first","affiliation":[{"name":"The Hebrew University of Jerusalem"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yafim","family":"Kazak","sequence":"additional","affiliation":[{"name":"The Hebrew University of Jerusalem"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Guy","family":"Katz","sequence":"additional","affiliation":[{"name":"The Hebrew University of Jerusalem"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael","family":"Schapira","sequence":"additional","affiliation":[{"name":"The Hebrew University of Jerusalem"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2021,8,9]]},"reference":[{"key":"e_1_3_2_2_1_1","volume-title":"Proc. Annual Conf. of the ACM Special Interest Group on Data Communication on the Applications, Technologies, Architectures, and Protocols for Computer Communication (SIGCOMM). 632--647","author":"Abbasloo Soheil","unstructured":"Soheil Abbasloo , Chen-Yu Yen , and H. Jonathan Chao . 2020. Classic Meets Modern: A Pragmatic Learning-Based Congestion Control for the Internet . In Proc. Annual Conf. of the ACM Special Interest Group on Data Communication on the Applications, Technologies, Architectures, and Protocols for Computer Communication (SIGCOMM). 632--647 . Soheil Abbasloo, Chen-Yu Yen, and H. Jonathan Chao. 2020. Classic Meets Modern: A Pragmatic Learning-Based Congestion Control for the Internet. In Proc. Annual Conf. of the ACM Special Interest Group on Data Communication on the Applications, Technologies, Architectures, and Protocols for Computer Communication (SIGCOMM). 632--647."},{"key":"e_1_3_2_2_2_1","volume-title":"Proc. 33rd Conf. on Advances in Neural Information Processing Systems (NeurIPS). 3981--3991","author":"Addanki Ravichandra","year":"2019","unstructured":"Ravichandra Addanki , Shaileshh Bojja Venkatakrishnan , Shreyan Gupta , Hongzi Mao , and Mohammad Alizadeh . 2019 . Learning Generalizable Device Placement Algorithms for Distributed Machine Learning . In Proc. 33rd Conf. on Advances in Neural Information Processing Systems (NeurIPS). 3981--3991 . Ravichandra Addanki, Shaileshh Bojja Venkatakrishnan, Shreyan Gupta, Hongzi Mao, and Mohammad Alizadeh. 2019. Learning Generalizable Device Placement Algorithms for Distributed Machine Learning. In Proc. 33rd Conf. on Advances in Neural Information Processing Systems (NeurIPS). 3981--3991."},{"key":"e_1_3_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.33016006"},{"key":"e_1_3_2_2_4_1","volume-title":"Towards Scalable Verification of RL-Driven Systems. arXiv preprint arXiv:2105.11931","author":"Amir Guy","year":"2021","unstructured":"Guy Amir , Michael Schapira , and Guy Katz . 2021a. Towards Scalable Verification of RL-Driven Systems. arXiv preprint arXiv:2105.11931 ( 2021 ). Guy Amir, Michael Schapira, and Guy Katz. 2021a. Towards Scalable Verification of RL-Driven Systems. arXiv preprint arXiv:2105.11931 (2021)."},{"key":"e_1_3_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-72013-1_11"},{"key":"e_1_3_2_2_6_1","volume-title":"Invariant Risk Minimization. arXiv preprint:1907.02893","author":"Arjovsky Martin","year":"2019","unstructured":"Martin Arjovsky , L\u00e9on Bottou , Ishaan Gulrajani , and David Lopez-Paz . 2019. Invariant Risk Minimization. arXiv preprint:1907.02893 ( 2019 ). Martin Arjovsky, L\u00e9on Bottou, Ishaan Gulrajani, and David Lopez-Paz. 2019. Invariant Risk Minimization. arXiv preprint:1907.02893 (2019)."},{"key":"e_1_3_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-59152-6_5"},{"key":"e_1_3_2_2_8_1","volume-title":"Principles of Model Checking","author":"Baier Christel","unstructured":"Christel Baier and Joost-Pieter Katoen . 2008. Principles of Model Checking . MIT Press . Christel Baier and Joost-Pieter Katoen. 2008. Principles of Model Checking. MIT Press."},{"key":"e_1_3_2_2_9_1","volume-title":"Proc. 32nd Conf. on Neural Information Processing Systems (NeurIPS). 2494--2504","author":"Bastani Osbert","year":"2018","unstructured":"Osbert Bastani , Yewen Pu , and Armando Solar-Lezama . 2018 . Verifiable Reinforcement Learning via Policy Extraction . In Proc. 32nd Conf. on Neural Information Processing Systems (NeurIPS). 2494--2504 . Osbert Bastani, Yewen Pu, and Armando Solar-Lezama. 2018. Verifiable Reinforcement Learning via Policy Extraction. In Proc. 32nd Conf. on Neural Information Processing Systems (NeurIPS). 2494--2504."},{"key":"e_1_3_2_2_10_1","volume-title":"Proc. 21st Conf. on Advances in Neural Information Processing Systems (NeurIPS). 137--144","author":"Ben-David Shai","year":"2007","unstructured":"Shai Ben-David , John Blitzer , Koby Crammer , and Fernando Pereira . 2007 . Analysis of Representations for Domain Adaptation . In Proc. 21st Conf. on Advances in Neural Information Processing Systems (NeurIPS). 137--144 . Shai Ben-David, John Blitzer, Koby Crammer, and Fernando Pereira. 2007. Analysis of Representations for Domain Adaptation. In Proc. 21st Conf. on Advances in Neural Information Processing Systems (NeurIPS). 137--144."},{"key":"e_1_3_2_2_11_1","volume-title":"Dynamic Programming and Optimal Control","author":"Bertsekas Dimitri P","unstructured":"Dimitri P Bertsekas . 1995. Dynamic Programming and Optimal Control . Vol. 1 . Athena scientific Belmont, MA. Dimitri P Bertsekas. 1995. Dynamic Programming and Optimal Control. Vol. 1. Athena scientific Belmont, MA."},{"key":"e_1_3_2_2_12_1","volume-title":"Provably Minimally-Distorted Adversarial Examples. arXiv preprint arXiv:1709.10207","author":"Carlini Nicholas","year":"2017","unstructured":"Nicholas Carlini , Guy Katz , Clark Barrett , and David Dill . 2017. Provably Minimally-Distorted Adversarial Examples. arXiv preprint arXiv:1709.10207 ( 2017 ). Nicholas Carlini, Guy Katz, Clark Barrett, and David Dill. 2017. Provably Minimally-Distorted Adversarial Examples. arXiv preprint arXiv:1709.10207 (2017)."},{"key":"e_1_3_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3230543.3230551"},{"key":"e_1_3_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1007\/10722167_15"},{"key":"e_1_3_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-63390-9_31"},{"key":"e_1_3_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3341216.3342210"},{"key":"e_1_3_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3302504.3311807"},{"key":"e_1_3_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-68167-2_19"},{"key":"e_1_3_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-53288-8_3"},{"key":"e_1_3_2_2_20_1","unstructured":"Tomer Eliyahu Yafim Kazak Guy Katz and Michael Schapira. 2021. The whiRL Repository. https:\/\/github.com\/WhiRLVerification\/WhiRL.  Tomer Eliyahu Yafim Kazak Guy Katz and Michael Schapira. 2021. The whiRL Repository. https:\/\/github.com\/WhiRLVerification\/WhiRL."},{"key":"e_1_3_2_2_21_1","first-page":"503","article-title":"Tree-Based Batch Mode Reinforcement Learning","volume":"6","author":"Ernst Damien","year":"2015","unstructured":"Damien Ernst , Pierre Geurts , and Louis Wehenkel . 2015 . Tree-Based Batch Mode Reinforcement Learning . J. Machine Learning Research 6 (2015), 503 -- 556 . Damien Ernst, Pierre Geurts, and Louis Wehenkel. 2015. Tree-Based Batch Mode Reinforcement Learning. J. Machine Learning Research 6 (2015), 503--556.","journal-title":"J. Machine Learning Research"},{"key":"e_1_3_2_2_22_1","volume-title":"Off-Policy Deep Reinforcement Learning without Exploration. arXiv preprint arXiv:1812.02900","author":"Fujimoto Scott","year":"2018","unstructured":"Scott Fujimoto , David Meger , and Doina Precup . 2018. Off-Policy Deep Reinforcement Learning without Exploration. arXiv preprint arXiv:1812.02900 ( 2018 ). Scott Fujimoto, David Meger, and Doina Precup. 2018. Off-Policy Deep Reinforcement Learning without Exploration. arXiv preprint arXiv:1812.02900 (2018)."},{"key":"e_1_3_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/SP.2018.00058"},{"key":"e_1_3_2_2_24_1","volume-title":"Proc. 30th Conf. on Neural Information Processing Systems (NeurIPS). 2298--2306","author":"Ghavamzadeh Mohammad","year":"2016","unstructured":"Mohammad Ghavamzadeh , Marek Petrik , and Yinlam Chow . 2016 . Safe Policy Improvement by Minimizing Robust Baseline Regret . In Proc. 30th Conf. on Neural Information Processing Systems (NeurIPS). 2298--2306 . Mohammad Ghavamzadeh, Marek Petrik, and Yinlam Chow. 2016. Safe Policy Improvement by Minimizing Robust Baseline Regret. In Proc. 30th Conf. on Neural Information Processing Systems (NeurIPS). 2298--2306."},{"key":"e_1_3_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3365609.3365862"},{"key":"e_1_3_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-55754-6_5"},{"key":"e_1_3_2_2_27_1","volume-title":"Deep Learning","author":"Goodfellow Ian","unstructured":"Ian Goodfellow , Yoshua Bengio , and Aaron Courville . 2016. Deep Learning . MIT Press . Ian Goodfellow, Yoshua Bengio, and Aaron Courville. 2016. Deep Learning. MIT Press."},{"key":"e_1_3_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01090-4_1"},{"key":"e_1_3_2_2_29_1","volume-title":"Explainable Artificial Intelligence (XAI)","author":"Gunning David","unstructured":"David Gunning . 2017. Explainable Artificial Intelligence (XAI) . Defense Advanced Research Projects Agency (DARPA) Project . David Gunning. 2017. Explainable Artificial Intelligence (XAI). Defense Advanced Research Projects Agency (DARPA) Project."},{"key":"e_1_3_2_2_30_1","volume-title":"AutoPhase: Compiler Phase-Ordering for HLS with Deep Reinforcement Learning. arXiv preprint arXiv:1901.04615","author":"Haj-Ali Amir","year":"2019","unstructured":"Amir Haj-Ali , , Qijing Huang , William Moses , John Xiang , Ion Stoica , Krste Asanovic , and John Wawrzynek . 2019. AutoPhase: Compiler Phase-Ordering for HLS with Deep Reinforcement Learning. arXiv preprint arXiv:1901.04615 ( 2019 ). Amir Haj-Ali, , Qijing Huang, William Moses, John Xiang, Ion Stoica, Krste Asanovic, and John Wawrzynek. 2019. AutoPhase: Compiler Phase-Ordering for HLS with Deep Reinforcement Learning. arXiv preprint arXiv:1901.04615 (2019)."},{"key":"e_1_3_2_2_31_1","volume-title":"Deep Reinforcement Learning in System Optimization. arXiv preprint arXiv:1908.01275","author":"Haj-Ali Ameer","year":"2019","unstructured":"Ameer Haj-Ali , Nesreen K. Ahmed , Theodore L. Willke , Joseph Gonzalez , Krste Asanovic , and Ion Stoica . 2019. Deep Reinforcement Learning in System Optimization. arXiv preprint arXiv:1908.01275 ( 2019 ). Ameer Haj-Ali, Nesreen K. Ahmed, Theodore L. Willke, Joseph Gonzalez, Krste Asanovic, and Ion Stoica. 2019. Deep Reinforcement Learning in System Optimization. arXiv preprint arXiv:1908.01275 (2019)."},{"key":"e_1_3_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v31i1.11123"},{"key":"e_1_3_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-63387-9_1"},{"key":"e_1_3_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-59152-6_3"},{"key":"e_1_3_2_2_35_1","volume-title":"Proc. 36th Int. Conf. on Machine Learning (ICML). 3050--3059","author":"Jay Nathan","year":"2019","unstructured":"Nathan Jay , Noga Rotman , Brighten Godfrey , Michael Schapira , and Aviv Tamar . 2019 a. A Deep Reinforcement Learning Perspective on Internet Congestion Control . In Proc. 36th Int. Conf. on Machine Learning (ICML). 3050--3059 . Nathan Jay, Noga Rotman, Brighten Godfrey, Michael Schapira, and Aviv Tamar. 2019a. A Deep Reinforcement Learning Perspective on Internet Congestion Control. In Proc. 36th Int. Conf. on Machine Learning (ICML). 3050--3059."},{"key":"e_1_3_2_2_36_1","unstructured":"Nathan Jay Noga Rotman Brighten Godfrey Michael Schapira and Aviv Tamar. 2019b. PCC Code Repository. https:\/\/github.com\/PCCproject\/PCC-RL.  Nathan Jay Noga Rotman Brighten Godfrey Michael Schapira and Aviv Tamar. 2019b. PCC Code Repository. https:\/\/github.com\/PCCproject\/PCC-RL."},{"key":"e_1_3_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-63387-9_5"},{"key":"e_1_3_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.4204\/EPTCS.257.3"},{"key":"e_1_3_2_2_39_1","volume-title":"Reluplex: a Calculus for Reasoning about Deep Neural Networks. Formal Methods in System Design (FMSD)","author":"Katz Guy","year":"2021","unstructured":"Guy Katz , Clark Barrett , David Dill , Kyle Julian , and Mykel Kochenderfer . 2021. Reluplex: a Calculus for Reasoning about Deep Neural Networks. Formal Methods in System Design (FMSD) ( 2021 ). To appear. Guy Katz, Clark Barrett, David Dill, Kyle Julian, and Mykel Kochenderfer. 2021. Reluplex: a Calculus for Reasoning about Deep Neural Networks. Formal Methods in System Design (FMSD) (2021). To appear."},{"key":"e_1_3_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-25540-4_26"},{"key":"e_1_3_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/3341216.3342218"},{"key":"e_1_3_2_2_42_1","volume-title":"Learning to Optimize Join Queries With Deep Reinforcement Learning. arXiv preprint arXiv:1808.03196","author":"Krishnan Sanjay","year":"2018","unstructured":"Sanjay Krishnan , Zongheng Yang , Ken Goldberg , Joseph Hellerstein , and Ion Stoica . 2018. Learning to Optimize Join Queries With Deep Reinforcement Learning. arXiv preprint arXiv:1808.03196 ( 2018 ). Sanjay Krishnan, Zongheng Yang, Ken Goldberg, Joseph Hellerstein, and Ion Stoica. 2018. Learning to Optimize Join Queries With Deep Reinforcement Learning. arXiv preprint arXiv:1808.03196 (2018)."},{"key":"e_1_3_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/2384616.2384628"},{"key":"e_1_3_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.5555\/3454287.3455342"},{"key":"e_1_3_2_2_45_1","volume-title":"Toward Scalable Verification for Safety-Critical Deep Networks. arXiv preprint arXiv:1801.05950","author":"Kuper Lindsey","year":"2018","unstructured":"Lindsey Kuper , Guy Katz , Justin Gottschlich , Kyle Julian , Clark Barrett , and Mykel Kochenderfer . 2018. Toward Scalable Verification for Safety-Critical Deep Networks. arXiv preprint arXiv:1801.05950 ( 2018 ). Lindsey Kuper, Guy Katz, Justin Gottschlich, Kyle Julian, Clark Barrett, and Mykel Kochenderfer. 2018. Toward Scalable Verification for Safety-Critical Deep Networks. arXiv preprint arXiv:1801.05950 (2018)."},{"key":"e_1_3_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-22110-1_47"},{"key":"e_1_3_2_2_47_1","volume-title":"Pruning and Slicing Neural Networks using Formal Verification. arXiv preprint arXiv:?","author":"Lahav Ori","year":"2021","unstructured":"Ori Lahav and Guy Katz . 2021. Pruning and Slicing Neural Networks using Formal Verification. arXiv preprint arXiv:? ( 2021 ). Ori Lahav and Guy Katz. 2021. Pruning and Slicing Neural Networks using Formal Verification. arXiv preprint arXiv:? (2021)."},{"key":"e_1_3_2_2_48_1","volume-title":"Offline Reinforcement Learning: Tutorial, Review, and Perspectives on Open Problems. arXiv preprint:2005.01643","author":"Levine Sergey","year":"2020","unstructured":"Sergey Levine , Aviral Kumar , George Tucker , and Justin Fu. 2020. Offline Reinforcement Learning: Tutorial, Review, and Perspectives on Open Problems. arXiv preprint:2005.01643 ( 2020 ). Sergey Levine, Aviral Kumar, George Tucker, and Justin Fu. 2020. Offline Reinforcement Learning: Tutorial, Review, and Perspectives on Open Problems. arXiv preprint:2005.01643 (2020)."},{"key":"e_1_3_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/3341302.3342221"},{"key":"e_1_3_2_2_50_1","volume-title":"Algorithms for Verifying Deep Neural Networks. arXiv preprint arXiv:1903.06758","author":"Liu Changliu","year":"2019","unstructured":"Changliu Liu , Tomer Arnon , Christopher Lazarus , Clark Barrett , and Mykel Kochenderfer . 2019. Algorithms for Verifying Deep Neural Networks. arXiv preprint arXiv:1903.06758 ( 2019 ). Changliu Liu, Tomer Arnon, Christopher Lazarus, Clark Barrett, and Mykel Kochenderfer. 2019. Algorithms for Verifying Deep Neural Networks. arXiv preprint arXiv:1903.06758 (2019)."},{"key":"e_1_3_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDCS.2017.123"},{"key":"e_1_3_2_2_52_1","volume-title":"Towards Deep Learning Models Resistant to Adversarial Attacks. arXiv preprint arXiv:1706.06083","author":"Madry Aleksander","year":"2017","unstructured":"Aleksander Madry , Aleksandar Makelov , Ludwig Schmidt , Dimitris Tsipras , and Adrian Vladu . 2017. Towards Deep Learning Models Resistant to Adversarial Attacks. arXiv preprint arXiv:1706.06083 ( 2017 ). Aleksander Madry, Aleksandar Makelov, Ludwig Schmidt, Dimitris Tsipras, and Adrian Vladu. 2017. Towards Deep Learning Models Resistant to Adversarial Attacks. arXiv preprint arXiv:1706.06083 (2017)."},{"key":"e_1_3_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7299155"},{"key":"e_1_3_2_2_54_1","unstructured":"Hongzi Mao Mohammad Alizadeh Ishai Menache and Srikanth Kandula. 2016a. DeepRM Code Repository. https:\/\/github.com\/hongzimao\/deeprm.  Hongzi Mao Mohammad Alizadeh Ishai Menache and Srikanth Kandula. 2016a. DeepRM Code Repository. https:\/\/github.com\/hongzimao\/deeprm."},{"key":"e_1_3_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/3005745.3005750"},{"key":"e_1_3_2_2_56_1","volume-title":"Proc. 33rd Conf. on Neural Information Processing Systems (NeurIPS). 2490--2502","author":"Mao Hongzi","year":"2019","unstructured":"Hongzi Mao , Parimarjan Negi , Akshay Narayan , Hanrui Wang , Jiacheng Yang , Haonan Wang , Ryan Marcus , Ravichandra Addanki , Mehrdad Khani Shirkoohi , Songtao He , Vikram Nathan , Frank Cangialosi , Shaileshh Bojja Venkatakrishnan , Wei-Hung Weng , Song Han , Tim Kraska , and Mohammad Alizadeh . 2019 a. Park: An Open Platform for Learning-Augmented Computer Systems . In Proc. 33rd Conf. on Neural Information Processing Systems (NeurIPS). 2490--2502 . Hongzi Mao, Parimarjan Negi, Akshay Narayan, Hanrui Wang, Jiacheng Yang, Haonan Wang, Ryan Marcus, Ravichandra Addanki, Mehrdad Khani Shirkoohi, Songtao He, Vikram Nathan, Frank Cangialosi, Shaileshh Bojja Venkatakrishnan, Wei-Hung Weng, Song Han, Tim Kraska, and Mohammad Alizadeh. 2019a. Park: An Open Platform for Learning-Augmented Computer Systems. In Proc. 33rd Conf. on Neural Information Processing Systems (NeurIPS). 2490--2502."},{"key":"e_1_3_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/3098822.3098843"},{"key":"e_1_3_2_2_58_1","unstructured":"Hongzi Mao Ravi Netravali and Mohammad Alizadeh. 2017b. Pensieve Code Repository. https:\/\/github.com\/hongzimao\/pensieve.  Hongzi Mao Ravi Netravali and Mohammad Alizadeh. 2017b. Pensieve Code Repository. https:\/\/github.com\/hongzimao\/pensieve."},{"key":"e_1_3_2_2_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/3341302.3342080"},{"key":"e_1_3_2_2_60_1","volume-title":"Neo: A Learned Query Optimizer. arXiv preprint arXiv:1904.03711","author":"Marcus Ryan","year":"2019","unstructured":"Ryan Marcus , Parimarjan Negi , Hongzi Mao , Chi Zhang , Mohammad Alizadeh , Tim Kraska , Olga Papaemmanouil , and Nesime Tatbul . 2019 . Neo: A Learned Query Optimizer. arXiv preprint arXiv:1904.03711 (2019). Ryan Marcus, Parimarjan Negi, Hongzi Mao, Chi Zhang, Mohammad Alizadeh, Tim Kraska, Olga Papaemmanouil, and Nesime Tatbul. 2019. Neo: A Learned Query Optimizer. arXiv preprint arXiv:1904.03711 (2019)."},{"key":"e_1_3_2_2_61_1","volume-title":"Verifying Properties of Binarized Deep Neural Networks. arXiv preprint arXiv:1709.06662","author":"Narodytska Nina","year":"2017","unstructured":"Nina Narodytska , Shiva Kasiviswanathan , Leonid Ryzhyk , Mooly Sagiv , and Toby Walsh . 2017. Verifying Properties of Binarized Deep Neural Networks. arXiv preprint arXiv:1709.06662 ( 2017 ). Nina Narodytska, Shiva Kasiviswanathan, Leonid Ryzhyk, Mooly Sagiv, and Toby Walsh. 2017. Verifying Properties of Binarized Deep Neural Networks. arXiv preprint arXiv:1709.06662 (2017)."},{"key":"e_1_3_2_2_62_1","volume-title":"Proc. 2nd Workshop on Data Management for End-To-End Machine Learning (DEEM). 1--4.","author":"Ortiz Jennifer","unstructured":"Jennifer Ortiz , Magdalena Balazinska , Johannes Gehrke , and S. Sathiya Keerthi . 2018. Learning State Representations for Query Optimization with Deep Reinforcement Learning . In Proc. 2nd Workshop on Data Management for End-To-End Machine Learning (DEEM). 1--4. Jennifer Ortiz, Magdalena Balazinska, Johannes Gehrke, and S. Sathiya Keerthi. 2018. Learning State Representations for Query Optimization with Deep Reinforcement Learning. In Proc. 2nd Workshop on Data Management for End-To-End Machine Learning (DEEM). 1--4."},{"key":"e_1_3_2_2_63_1","volume-title":"Regal: Transfer Learning for Fast Optimization of Computation Graphs. arXiv preprint arXiv:1905.02494","author":"Paliwal Aditya","year":"2019","unstructured":"Aditya Paliwal , Felix Gimeno , Vinod Nair , Yujia Li , Miles Lubin , Pushmeet Kohli , and Oriol Vinyals . 2019 . Regal: Transfer Learning for Fast Optimization of Computation Graphs. arXiv preprint arXiv:1905.02494 (2019). Aditya Paliwal, Felix Gimeno, Vinod Nair, Yujia Li, Miles Lubin, Pushmeet Kohli, and Oriol Vinyals. 2019. Regal: Transfer Learning for Fast Optimization of Computation Graphs. arXiv preprint arXiv:1905.02494 (2019)."},{"key":"e_1_3_2_2_64_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2009.191"},{"key":"e_1_3_2_2_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/3132747.3132785"},{"key":"e_1_3_2_2_66_1","volume-title":"Online Safety Assurance for Deep Reinforcement Learning. arXiv preprint arXiv:2010.03625","author":"Rotman Noga H.","year":"2020","unstructured":"Noga H. Rotman , Michael Schapira , and Aviv Tamar . 2020. Online Safety Assurance for Deep Reinforcement Learning. arXiv preprint arXiv:2010.03625 ( 2020 ). Noga H. Rotman, Michael Schapira, and Aviv Tamar. 2020. Online Safety Assurance for Deep Reinforcement Learning. arXiv preprint arXiv:2010.03625 (2020)."},{"key":"e_1_3_2_2_67_1","volume-title":"Safe Policy Learning from Observations. arXiv preprint arXiv:1805.07805","author":"Sarafian Elad","year":"2018","unstructured":"Elad Sarafian , Aviv Tamar , and Sarit Kraus . 2018. Safe Policy Learning from Observations. arXiv preprint arXiv:1805.07805 ( 2018 ). Elad Sarafian, Aviv Tamar, and Sarit Kraus. 2018. Safe Policy Learning from Observations. arXiv preprint arXiv:1805.07805 (2018)."},{"key":"e_1_3_2_2_68_1","volume-title":"Proc. 32nd Int. Conf. on Machine Learning (ICML). 1889--1897","author":"Schulman John","year":"2015","unstructured":"John Schulman , Sergey Levine , Pieter Abbeel , Michael Jordan , and Philipp Moritz . 2015 . Trust Region Policy Optimization . In Proc. 32nd Int. Conf. on Machine Learning (ICML). 1889--1897 . John Schulman, Sergey Levine, Pieter Abbeel, Michael Jordan, and Philipp Moritz. 2015. Trust Region Policy Optimization. In Proc. 32nd Int. Conf. on Machine Learning (ICML). 1889--1897."},{"key":"e_1_3_2_2_69_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10703-016-0248-5"},{"key":"e_1_3_2_2_70_1","volume-title":"Mastering the Game of Go without Human Knowledge. Nature 550, 7676","author":"Silver David","year":"2017","unstructured":"David Silver , Aja Huang , Chris Maddison , Arthus Guez , Laurent Sifre , George van den Driessche , Julian Schrittwieser , Ioannis Antonoglou , Veda Panneershelvam , Marc Lanctot , Sander Dieleman , Dominik Grewe , John Nham , Nal Kalchbrenner , Ilya Sutskever , Timothy Lillicrap , Madeleine Leach , Koray Kavukcuoglu , Thore Graepel , and Demis Hassabis . 2017. Mastering the Game of Go without Human Knowledge. Nature 550, 7676 ( 2017 ), 354. David Silver, Aja Huang, Chris Maddison, Arthus Guez, Laurent Sifre, George van den Driessche, Julian Schrittwieser, Ioannis Antonoglou, Veda Panneershelvam, Marc Lanctot, Sander Dieleman, Dominik Grewe, John Nham, Nal Kalchbrenner, Ilya Sutskever, Timothy Lillicrap, Madeleine Leach, Koray Kavukcuoglu, Thore Graepel, and Demis Hassabis. 2017. Mastering the Game of Go without Human Knowledge. Nature 550, 7676 (2017), 354."},{"key":"e_1_3_2_2_71_1","doi-asserted-by":"publisher","DOI":"10.5555\/3454287.3455639"},{"key":"e_1_3_2_2_72_1","volume-title":"Global Optimization of Objective Functions Represented by ReLU networks. arXiv preprint arXiv:2010.03258","author":"Strong Christopher","year":"2020","unstructured":"Christopher Strong , Haoze Wu , Aleksandar Zelji\u0107 , Kyle Julian , Guy Katz , Clark Barrett , and Mykel Kochenderfer . 2020. Global Optimization of Objective Functions Represented by ReLU networks. arXiv preprint arXiv:2010.03258 ( 2020 ). Christopher Strong, Haoze Wu, Aleksandar Zelji\u0107, Kyle Julian, Guy Katz, Clark Barrett, and Mykel Kochenderfer. 2020. Global Optimization of Objective Functions Represented by ReLU networks. arXiv preprint arXiv:2010.03258 (2020)."},{"key":"e_1_3_2_2_73_1","doi-asserted-by":"publisher","DOI":"10.1145\/3302504.3311802"},{"key":"e_1_3_2_2_74_1","volume-title":"Introduction to Reinforcement Learning","author":"Sutton Richard","unstructured":"Richard Sutton and Andrew Barto . 1998. Introduction to Reinforcement Learning . MIT press Cambridge . Richard Sutton and Andrew Barto. 1998. Introduction to Reinforcement Learning. MIT press Cambridge."},{"key":"e_1_3_2_2_75_1","volume-title":"Intriguing Properties of Neural Networks. arXiv preprint arXiv:1312.6199","author":"Szegedy Christian","year":"2013","unstructured":"Christian Szegedy , Wojciech Zaremba , Ilya Sutskever , Joan Bruna , Dumitru Erhan , Ian Goodfellow , and Rob Fergus . 2013. Intriguing Properties of Neural Networks. arXiv preprint arXiv:1312.6199 ( 2013 ). Christian Szegedy, Wojciech Zaremba, Ilya Sutskever, Joan Bruna, Dumitru Erhan, Ian Goodfellow, and Rob Fergus. 2013. Intriguing Properties of Neural Networks. arXiv preprint arXiv:1312.6199 (2013)."},{"key":"e_1_3_2_2_76_1","volume-title":"Proc. 33rd Int. Conf. on Machine Learning (ICML). 2139--2148","author":"Thomas Philip","year":"2016","unstructured":"Philip Thomas and Emma Brunskill . 2016 . Data-Efficient Off-Policy Policy Evaluation for Reinforcement Learning . In Proc. 33rd Int. Conf. on Machine Learning (ICML). 2139--2148 . Philip Thomas and Emma Brunskill. 2016. Data-Efficient Off-Policy Policy Evaluation for Reinforcement Learning. In Proc. 33rd Int. Conf. on Machine Learning (ICML). 2139--2148."},{"key":"e_1_3_2_2_77_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v29i1.9541"},{"key":"e_1_3_2_2_78_1","volume-title":"Proc. 32nd Int. Conf. on Machine Learning (ICML). 2380--2388","author":"Thomas Philip","year":"2015","unstructured":"Philip Thomas , Georgios Theocharous , and Mohammad Ghavamzadeh . 2015 b. High Confidence Policy Improvement . In Proc. 32nd Int. Conf. on Machine Learning (ICML). 2380--2388 . Philip Thomas, Georgios Theocharous, and Mohammad Ghavamzadeh. 2015b. High Confidence Policy Improvement. In Proc. 32nd Int. Conf. on Machine Learning (ICML). 2380--2388."},{"key":"e_1_3_2_2_79_1","doi-asserted-by":"publisher","DOI":"10.1145\/3180155.3180220"},{"key":"e_1_3_2_2_80_1","volume-title":"Proc. 7th Int. Conf. on Learning Representations (ICLR).","author":"Tjeng Vincent","year":"2019","unstructured":"Vincent Tjeng , Kai Xiao , and Russ Tedrake . 2019 . Evaluating Robustness of Neural Networks with Mixed Integer Programming . Proc. 7th Int. Conf. on Learning Representations (ICLR). Vincent Tjeng, Kai Xiao, and Russ Tedrake. 2019. Evaluating Robustness of Neural Networks with Mixed Integer Programming. Proc. 7th Int. Conf. on Learning Representations (ICLR)."},{"key":"e_1_3_2_2_81_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-53288-8_2"},{"key":"e_1_3_2_2_82_1","volume-title":"Proc. 27th USENIX Security Symposium. 1599--1614","author":"Wang Shiqi","year":"2018","unstructured":"Shiqi Wang , Kexin Pei , Justin Whitehouse , Junfeng Yang , and Suman Jana . 2018 . Formal Security Analysis of Neural Networks using Symbolic Intervals . In Proc. 27th USENIX Security Symposium. 1599--1614 . Shiqi Wang, Kexin Pei, Justin Whitehouse, Junfeng Yang, and Suman Jana. 2018. Formal Security Analysis of Neural Networks using Symbolic Intervals. In Proc. 27th USENIX Security Symposium. 1599--1614."},{"key":"e_1_3_2_2_83_1","volume-title":"Proc. 20th Int. Conf. on Formal Methods in Computer-Aided Design (FMCAD). 128--137","author":"Wu Haoze","year":"2020","unstructured":"Haoze Wu , Alex Ozdemir , Aleksandar Zelji\u0107 , Ahmen Irfan , Kyle Julian , Divya Gopinath , Sadjad Fouladi , Guy Katz , Corina P\u0103s\u0103reanu , and Clark Barrett . 2020 . Parallelization Techniques for Verifying Neural Networks . In Proc. 20th Int. Conf. on Formal Methods in Computer-Aided Design (FMCAD). 128--137 . Haoze Wu, Alex Ozdemir, Aleksandar Zelji\u0107, Ahmen Irfan, Kyle Julian, Divya Gopinath, Sadjad Fouladi, Guy Katz, Corina P\u0103s\u0103reanu, and Clark Barrett. 2020. Parallelization Techniques for Verifying Neural Networks. In Proc. 20th Int. Conf. on Formal Methods in Computer-Aided Design (FMCAD). 128--137."},{"key":"e_1_3_2_2_84_1","volume-title":"Proc. IEEE Conf. on Computer Vision and Pattern Recognition (CVPR). 501--509","author":"Xie Cihang","unstructured":"Cihang Xie , Yuxin Wu , Laurens van der Maaten, Alan L. Yuille, and Kaiming He. 2019. Feature Denoising for Improving Adversarial Robustness . In Proc. IEEE Conf. on Computer Vision and Pattern Recognition (CVPR). 501--509 . Cihang Xie, Yuxin Wu, Laurens van der Maaten, Alan L. Yuille, and Kaiming He. 2019. Feature Denoising for Improving Adversarial Robustness. In Proc. IEEE Conf. on Computer Vision and Pattern Recognition (CVPR). 501--509."},{"key":"e_1_3_2_2_85_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICC.2017.7997286"},{"key":"e_1_3_2_2_86_1","volume-title":"Proc. 17th Symposium on Networked Systems Design and Implementation (NSDI). 495--511","author":"Yan Francis Y","year":"2020","unstructured":"Francis Y Yan , Hudson Ayers , Chenzhi Zhu , Sadjad Fouladi , James Hong , Keyi Zhang , Philip Levis , and Keith Winstein . 2020 . Learning in Situ: A Randomized Experiment in Video Streaming . In Proc. 17th Symposium on Networked Systems Design and Implementation (NSDI). 495--511 . Francis Y Yan, Hudson Ayers, Chenzhi Zhu, Sadjad Fouladi, James Hong, Keyi Zhang, Philip Levis, and Keith Winstein. 2020. Learning in Situ: A Randomized Experiment in Video Streaming. In Proc. 17th Symposium on Networked Systems Design and Implementation (NSDI). 495--511."},{"key":"e_1_3_2_2_87_1","volume-title":"Understanding Neural Networks through Deep Visualization. arXiv preprint arXiv:1506.06579","author":"Yosinski Jason","year":"2015","unstructured":"Jason Yosinski , Jeff Clune , Anh Nguyen , Thomas Fuchs , and Hod Lipson . 2015. Understanding Neural Networks through Deep Visualization. arXiv preprint arXiv:1506.06579 ( 2015 ). Jason Yosinski, Jeff Clune, Anh Nguyen, Thomas Fuchs, and Hod Lipson. 2015. Understanding Neural Networks through Deep Visualization. arXiv preprint arXiv:1506.06579 (2015)."}],"event":{"name":"SIGCOMM '21: ACM SIGCOMM 2021 Conference","location":"Virtual Event USA","acronym":"SIGCOMM '21","sponsor":["SIGCOMM ACM Special Interest Group on Data Communication"]},"container-title":["Proceedings of the 2021 ACM SIGCOMM 2021 Conference"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3452296.3472936","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3452296.3472936","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:17:40Z","timestamp":1750191460000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3452296.3472936"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,9]]},"references-count":87,"alternative-id":["10.1145\/3452296.3472936","10.1145\/3452296"],"URL":"https:\/\/doi.org\/10.1145\/3452296.3472936","relation":{},"subject":[],"published":{"date-parts":[[2021,8,9]]},"assertion":[{"value":"2021-08-09","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}