{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,7]],"date-time":"2026-11-07T03:21:19Z","timestamp":1794021679876,"version":"4.8.0"},"publisher-location":"New York, NY, USA","reference-count":56,"publisher":"ACM","license":[{"start":{"date-parts":[[2023,7,12]],"date-time":"2023-07-12T00:00:00Z","timestamp":1689120000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["CCF-2146443, CCF-2008905, CNS-2135625, CPS-2038727, CNS Career 1750263"],"award-info":[{"award-number":["CCF-2146443, CCF-2008905, CNS-2135625, CPS-2038727, CNS Career 1750263"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,7,12]]},"DOI":"10.1145\/3597926.3598082","type":"proceedings-article","created":{"date-parts":[[2023,7,13]],"date-time":"2023-07-13T20:12:53Z","timestamp":1689279173000},"page":"614-626","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":15,"title":["DyCL: Dynamic Neural Network Compilation Via Program Rewriting and Graph Optimization"],"prefix":"10.1145","author":[{"given":"Simin","family":"Chen","sequence":"first","affiliation":[{"name":"University of Texas at Dallas, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shiyi","family":"Wei","sequence":"additional","affiliation":[{"name":"University of Texas at Dallas, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Cong","family":"Liu","sequence":"additional","affiliation":[{"name":"University of California at Riverside, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wei","family":"Yang","sequence":"additional","affiliation":[{"name":"University of Texas at Dallas, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2023,7,13]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"TensorFlow: A System for Large-Scale Machine Learning. In 12th USENIX Symposium on Operating Systems Design and Implementation, OSDI 2016","author":"Abadi Mart\u00edn","year":"2016","unstructured":"Mart\u00edn Abadi , Paul Barham , Jianmin Chen , Zhifeng Chen , Andy Davis , Jeffrey Dean , Matthieu Devin , Sanjay Ghemawat , Geoffrey Irving , Michael Isard , Manjunath Kudlur , Josh Levenberg , Rajat Monga , Sherry Moore , Derek Gordon Murray , Benoit Steiner , Paul A. Tucker , Vijay Vasudevan , Pete Warden , Martin Wicke , Yuan Yu , and Xiaoqiang Zheng . 2016 . TensorFlow: A System for Large-Scale Machine Learning. In 12th USENIX Symposium on Operating Systems Design and Implementation, OSDI 2016 , Savannah, GA, USA , November 2-4, 2016, Kimberly Keeton and Timothy Roscoe (Eds.). USENIX Association, 265\u2013283. https:\/\/www.usenix.org\/conference\/osdi16\/technical-sessions\/presentation\/abadi Mart\u00edn Abadi, Paul Barham, Jianmin Chen, Zhifeng Chen, Andy Davis, Jeffrey Dean, Matthieu Devin, Sanjay Ghemawat, Geoffrey Irving, Michael Isard, Manjunath Kudlur, Josh Levenberg, Rajat Monga, Sherry Moore, Derek Gordon Murray, Benoit Steiner, Paul A. Tucker, Vijay Vasudevan, Pete Warden, Martin Wicke, Yuan Yu, and Xiaoqiang Zheng. 2016. TensorFlow: A System for Large-Scale Machine Learning. In 12th USENIX Symposium on Operating Systems Design and Implementation, OSDI 2016, Savannah, GA, USA, November 2-4, 2016, Kimberly Keeton and Timothy Roscoe (Eds.). USENIX Association, 265\u2013283. https:\/\/www.usenix.org\/conference\/osdi16\/technical-sessions\/presentation\/abadi"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3551349.3561158"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2022\/94"},{"key":"e_1_3_2_1_4_1","volume-title":"Proceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering. 1148\u20131160","author":"Chen Simin","year":"2022","unstructured":"Simin Chen , Cong Liu , Mirazul Haque , Zihe Song , and Wei Yang . 2022 . NMTSloth: understanding and testing efficiency degradation of neural machine translation systems . In Proceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering. 1148\u20131160 . Simin Chen, Cong Liu, Mirazul Haque, Zihe Song, and Wei Yang. 2022. NMTSloth: understanding and testing efficiency degradation of neural machine translation systems. In Proceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering. 1148\u20131160."},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.5281\/zenodo.7978245"},{"key":"e_1_3_2_1_6_1","volume-title":"TVM: end-to-end optimization stack for deep learning. arXiv preprint arXiv:1802.04799, 11","author":"Chen Tianqi","year":"2018","unstructured":"Tianqi Chen , Thierry Moreau , Ziheng Jiang , Haichen Shen , Eddie Q Yan , Leyuan Wang , Yuwei Hu , Luis Ceze , Carlos Guestrin , and Arvind Krishnamurthy . 2018. TVM: end-to-end optimization stack for deep learning. arXiv preprint arXiv:1802.04799, 11 ( 2018 ), 20. Tianqi Chen, Thierry Moreau, Ziheng Jiang, Haichen Shen, Eddie Q Yan, Leyuan Wang, Yuwei Hu, Luis Ceze, Carlos Guestrin, and Arvind Krishnamurthy. 2018. TVM: end-to-end optimization stack for deep learning. arXiv preprint arXiv:1802.04799, 11 (2018), 20."},{"key":"e_1_3_2_1_7_1","volume-title":"13th USENIX Symposium on Operating Systems Design and Implementation (OSDI 18)","author":"Chen Tianqi","year":"2018","unstructured":"Tianqi Chen , Thierry Moreau , Ziheng Jiang , Lianmin Zheng , Eddie Yan , Haichen Shen , Meghan Cowan , Leyuan Wang , Yuwei Hu , and Luis Ceze . 2018 . $TVM$: An automated $End-to-End$ optimizing compiler for deep learning . In 13th USENIX Symposium on Operating Systems Design and Implementation (OSDI 18) . 578\u2013594. Tianqi Chen, Thierry Moreau, Ziheng Jiang, Lianmin Zheng, Eddie Yan, Haichen Shen, Meghan Cowan, Leyuan Wang, Yuwei Hu, and Luis Ceze. 2018. $TVM$: An automated $End-to-End$ optimizing compiler for deep learning. In 13th USENIX Symposium on Operating Systems Design and Implementation (OSDI 18). 578\u2013594."},{"key":"e_1_3_2_1_8_1","volume-title":"Yixing Lao, Christopher R. Lishka, Jaikrishnan Menon, Jennifer Myers, Sandeep Aswath Narayana, Adam Procter, and Tristan J. Webb.","author":"Cyphers Scott","year":"2018","unstructured":"Scott Cyphers , Arjun K. Bansal , Anahita Bhiwandiwalla , Jayaram Bobba , Matthew Brookhart , Avijit Chakraborty , William Constable , Christian Convey , Leona Cook , Omar Kanawi , Robert Kimball , Jason Knight , Nikolay Korovaiko , Varun Kumar Vijay , Yixing Lao, Christopher R. Lishka, Jaikrishnan Menon, Jennifer Myers, Sandeep Aswath Narayana, Adam Procter, and Tristan J. Webb. 2018 . Intel nGraph: An Intermediate Representation, Compiler, and Executor for Deep Learning. CoRR , abs\/1801.08058 (2018), arXiv:1801.08058. arxiv:1801.08058 Scott Cyphers, Arjun K. Bansal, Anahita Bhiwandiwalla, Jayaram Bobba, Matthew Brookhart, Avijit Chakraborty, William Constable, Christian Convey, Leona Cook, Omar Kanawi, Robert Kimball, Jason Knight, Nikolay Korovaiko, Varun Kumar Vijay, Yixing Lao, Christopher R. Lishka, Jaikrishnan Menon, Jennifer Myers, Sandeep Aswath Narayana, Adam Procter, and Tristan J. Webb. 2018. Intel nGraph: An Intermediate Representation, Compiler, and Executor for Deep Learning. CoRR, abs\/1801.08058 (2018), arXiv:1801.08058. arxiv:1801.08058"},{"key":"e_1_3_2_1_9_1","volume-title":"Davis and Itamar Arel","author":"Andrew","year":"2014","unstructured":"Andrew S. Davis and Itamar Arel . 2014 . Low-Rank Approximations for Conditional Feedforward Computation in Deep Neural Networks . arxiv:1312.4461 Andrew S. Davis and Itamar Arel. 2014. Low-Rank Approximations for Conditional Feedforward Computation in Deep Neural Networks. arxiv:1312.4461"},{"key":"e_1_3_2_1_10_1","volume-title":"Proceedings of Machine Learning and Systems 2021","author":"Ding Yaoyao","year":"2021","unstructured":"Yaoyao Ding , Ligeng Zhu , Zhihao Jia , Gennady Pekhimenko , and Song Han . 2021 . IOS: Inter-Operator Scheduler for CNN Acceleration . In Proceedings of Machine Learning and Systems 2021 , MLSys 2021, virtual, April 5-9, 2021, Alex Smola, Alex Dimakis, and Ion Stoica (Eds.). mlsys.org. https:\/\/proceedings.mlsys.org\/paper\/ 2021\/hash\/38b3eff8baf56627478ec76a704e9b52-Abstract.html Yaoyao Ding, Ligeng Zhu, Zhihao Jia, Gennady Pekhimenko, and Song Han. 2021. IOS: Inter-Operator Scheduler for CNN Acceleration. In Proceedings of Machine Learning and Systems 2021, MLSys 2021, virtual, April 5-9, 2021, Alex Smola, Alex Dimakis, and Ion Stoica (Eds.). mlsys.org. https:\/\/proceedings.mlsys.org\/paper\/2021\/hash\/38b3eff8baf56627478ec76a704e9b52-Abstract.html"},{"key":"e_1_3_2_1_11_1","unstructured":"Facebook. 2018. Facebook Glow. https:\/\/ai.facebook.com\/tools\/glow\/ \t\t\t\t  Facebook. 2018. Facebook Glow. https:\/\/ai.facebook.com\/tools\/glow\/"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.14778\/3489496.3489500"},{"key":"e_1_3_2_1_13_1","first-page":"38","article-title":"Cortex: A compiler for recursive deep learning models","volume":"3","author":"Fegade Pratik","year":"2021","unstructured":"Pratik Fegade , Tianqi Chen , Phillip Gibbons , and Todd Mowry . 2021 . Cortex: A compiler for recursive deep learning models . Proceedings of Machine Learning and Systems , 3 (2021), 38 \u2013 54 . Pratik Fegade, Tianqi Chen, Phillip Gibbons, and Todd Mowry. 2021. Cortex: A compiler for recursive deep learning models. Proceedings of Machine Learning and Systems, 3 (2021), 38\u201354.","journal-title":"Proceedings of Machine Learning and Systems"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.194"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00724"},{"key":"e_1_3_2_1_16_1","unstructured":"Xitong Gao Yiren Zhao Lukasz Dudziak Robert D. Mullins and Cheng-Zhong Xu. 2019. Dynamic Channel Pruning: Feature Boosting and Suppression. https:\/\/openreview.net\/forum?id=BJxh2j0qYm \t\t\t\t  Xitong Gao Yiren Zhao Lukasz Dudziak Robert D. Mullins and Cheng-Zhong Xu. 2019. Dynamic Channel Pruning: Feature Boosting and Suppression. https:\/\/openreview.net\/forum?id=BJxh2j0qYm"},{"key":"e_1_3_2_1_17_1","article-title":"Dynamic neural networks: A survey","author":"Han Yizeng","year":"2021","unstructured":"Yizeng Han , Gao Huang , Shiji Song , Le Yang , Honghui Wang , and Yulin Wang . 2021 . Dynamic neural networks: A survey . IEEE Transactions on Pattern Analysis and Machine Intelligence. Yizeng Han, Gao Huang, Shiji Song, Le Yang, Honghui Wang, and Yulin Wang. 2021. Dynamic neural networks: A survey. IEEE Transactions on Pattern Analysis and Machine Intelligence.","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence."},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90"},{"key":"e_1_3_2_1_19_1","volume-title":"Zhiru Zhang, and G Edward Suh.","author":"Hua Weizhe","year":"2018","unstructured":"Weizhe Hua , Yuan Zhou , Christopher De Sa , Zhiru Zhang, and G Edward Suh. 2018 . Channel gating neural networks. arXiv preprint arXiv:1805.12549. Weizhe Hua, Yuan Zhou, Christopher De Sa, Zhiru Zhang, and G Edward Suh. 2018. Channel gating neural networks. arXiv preprint arXiv:1805.12549."},{"key":"e_1_3_2_1_20_1","volume-title":"Zhiru Zhang, and G Edward Suh.","author":"Hua Weizhe","year":"2019","unstructured":"Weizhe Hua , Yuan Zhou , Christopher M De Sa , Zhiru Zhang, and G Edward Suh. 2019 . Channel gating neural networks. In Advances in Neural Information Processing Systems . 1884\u20131894. Weizhe Hua, Yuan Zhou, Christopher M De Sa, Zhiru Zhang, and G Edward Suh. 2019. Channel gating neural networks. In Advances in Neural Information Processing Systems. 1884\u20131894."},{"key":"e_1_3_2_1_21_1","volume-title":"An introduction to statistical learning. 112","author":"James Gareth","unstructured":"Gareth James , Daniela Witten , Trevor Hastie , and Robert Tibshirani . 2013. An introduction to statistical learning. 112 , Springer . Gareth James, Daniela Witten, Trevor Hastie, and Robert Tibshirani. 2013. An introduction to statistical learning. 112, Springer."},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2647868.2654889"},{"key":"e_1_3_2_1_23_1","volume-title":"International Conference on Machine Learning. 3301\u20133310","author":"Kaya Yigitcan","year":"2019","unstructured":"Yigitcan Kaya , Sanghyun Hong , and Tudor Dumitras . 2019 . Shallow-deep networks: Understanding and mitigating network overthinking . In International Conference on Machine Learning. 3301\u20133310 . Yigitcan Kaya, Sanghyun Hong, and Tudor Dumitras. 2019. Shallow-deep networks: Understanding and mitigating network overthinking. In International Conference on Machine Learning. 3301\u20133310."},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.14778\/3467861.3467869"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPDS.2020.3030548"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPDS.2020.3030548"},{"key":"e_1_3_2_1_27_1","first-page":"1839","article-title":"Tensorflow lite: On-device machine learning framework","volume":"57","author":"Li Shuangfeng","year":"2020","unstructured":"Shuangfeng Li . 2020 . Tensorflow lite: On-device machine learning framework . Journal of Computer Research and Development , 57 , 9 (2020), 1839 . Shuangfeng Li. 2020. Tensorflow lite: On-device machine learning framework. Journal of Computer Research and Development, 57, 9 (2020), 1839.","journal-title":"Journal of Computer Research and Development"},{"key":"e_1_3_2_1_28_1","volume-title":"Runtime Neural Pruning. In Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017","author":"Lin Ji","year":"2017","unstructured":"Ji Lin , Yongming Rao , Jiwen Lu , and Jie Zhou . 2017 . Runtime Neural Pruning. In Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017 , December 4-9, 2017, Long Beach, CA, USA, Isabelle Guyon, Ulrike von Luxburg, Samy Bengio, Hanna M. Wallach, Rob Fergus, S. V. N. Vishwanathan, and Roman Garnett (Eds.). 2181\u20132191. https:\/\/proceedings.neurips.cc\/paper\/ 2017\/hash\/a51fb975227d6640e4fe47854476d133-Abstract.html Ji Lin, Yongming Rao, Jiwen Lu, and Jie Zhou. 2017. Runtime Neural Pruning. In Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, December 4-9, 2017, Long Beach, CA, USA, Isabelle Guyon, Ulrike von Luxburg, Samy Bengio, Hanna M. Wallach, Rob Fergus, S. V. N. Vishwanathan, and Roman Garnett (Eds.). 2181\u20132191. https:\/\/proceedings.neurips.cc\/paper\/2017\/hash\/a51fb975227d6640e4fe47854476d133-Abstract.html"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3575693.3575707"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v32i1.11630"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v32i1.11630"},{"key":"e_1_3_2_1_32_1","volume-title":"Compiler and Runtime Techniques for Optimizing Deep Learning Applications. Ph. D. Dissertation","author":"Lyubomirsky Steven Solomon","unstructured":"Steven Solomon Lyubomirsky . 2022. Compiler and Runtime Techniques for Optimizing Deep Learning Applications. Ph. D. Dissertation . University of Washington. Steven Solomon Lyubomirsky. 2022. Compiler and Runtime Techniques for Optimizing Deep Learning Applications. Ph. D. Dissertation. University of Washington."},{"key":"e_1_3_2_1_33_1","unstructured":"Microsoft. [n. d.]. ONNX Runtime: a cross-platform inference and training machine-learning accelerator. https:\/\/github.com\/microsoft\/onnxruntime \t\t\t\t  Microsoft. [n. d.]. ONNX Runtime: a cross-platform inference and training machine-learning accelerator. https:\/\/github.com\/microsoft\/onnxruntime"},{"key":"e_1_3_2_1_34_1","volume-title":"Proceedings of the IEEE\/CVF International Conference on Computer Vision. 9745\u20139755","author":"Najibi Mahyar","year":"2019","unstructured":"Mahyar Najibi , Bharat Singh , and Larry S Davis . 2019 . Autofocus: Efficient multi-scale inference . In Proceedings of the IEEE\/CVF International Conference on Computer Vision. 9745\u20139755 . Mahyar Najibi, Bharat Singh, and Larry S Davis. 2019. Autofocus: Efficient multi-scale inference. In Proceedings of the IEEE\/CVF International Conference on Computer Vision. 9745\u20139755."},{"key":"e_1_3_2_1_35_1","unstructured":"Feng Nan and Venkatesh Saligrama. 2017. Adaptive classification for prediction under a budget. arXiv preprint arXiv:1705.10194. \t\t\t\t  Feng Nan and Venkatesh Saligrama. 2017. Adaptive classification for prediction under a budget. arXiv preprint arXiv:1705.10194."},{"key":"e_1_3_2_1_36_1","unstructured":"Nvidia. [n. d.]. Jetson AGX Xavier Series. https:\/\/www.nvidia.com\/en-us\/autonomous-machines\/embedded-systems\/jetson-agx-xavier\/ \t\t\t\t  Nvidia. [n. d.]. Jetson AGX Xavier Series. https:\/\/www.nvidia.com\/en-us\/autonomous-machines\/embedded-systems\/jetson-agx-xavier\/"},{"key":"e_1_3_2_1_37_1","volume-title":"Pytorch: An imperative style, high-performance deep learning library. Advances in neural information processing systems, 32","author":"Paszke Adam","year":"2019","unstructured":"Adam Paszke , Sam Gross , Francisco Massa , Adam Lerer , James Bradbury , Gregory Chanan , Trevor Killeen , Zeming Lin , Natalia Gimelshein , and Luca Antiga . 2019 . Pytorch: An imperative style, high-performance deep learning library. Advances in neural information processing systems, 32 (2019). Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, and Luca Antiga. 2019. Pytorch: An imperative style, high-performance deep learning library. Advances in neural information processing systems, 32 (2019)."},{"key":"e_1_3_2_1_38_1","volume-title":"XLA: Compiling Machine Learning for Peak Performance.","author":"Sabne Amit","year":"2020","unstructured":"Amit Sabne . 2020 . XLA: Compiling Machine Learning for Peak Performance. Amit Sabne. 2020. XLA: Compiling Machine Learning for Peak Performance."},{"key":"e_1_3_2_1_39_1","unstructured":"Noam Shazeer Azalia Mirhoseini Krzysztof Maziarz Andy Davis Quoc Le Geoffrey Hinton and Jeff Dean. 2017. Outrageously large neural networks: The sparsely-gated mixture-of-experts layer. arXiv preprint arXiv:1701.06538. \t\t\t\t  Noam Shazeer Azalia Mirhoseini Krzysztof Maziarz Andy Davis Quoc Le Geoffrey Hinton and Jeff Dean. 2017. Outrageously large neural networks: The sparsely-gated mixture-of-experts layer. arXiv preprint arXiv:1701.06538."},{"key":"e_1_3_2_1_40_1","first-page":"208","article-title":"Nimble: Efficiently compiling dynamic neural networks for model inference","volume":"3","author":"Shen Haichen","year":"2021","unstructured":"Haichen Shen , Jared Roesch , Zhi Chen , Wei Chen , Yong Wu , Mu Li , Vin Sharma , Zachary Tatlock , and Yida Wang . 2021 . Nimble: Efficiently compiling dynamic neural networks for model inference . Proceedings of Machine Learning and Systems , 3 (2021), 208 \u2013 222 . Haichen Shen, Jared Roesch, Zhi Chen, Wei Chen, Yong Wu, Mu Li, Vin Sharma, Zachary Tatlock, and Yida Wang. 2021. Nimble: Efficiently compiling dynamic neural networks for model inference. Proceedings of Machine Learning and Systems, 3 (2021), 208\u2013222.","journal-title":"Proceedings of Machine Learning and Systems"},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/3460945.3464953"},{"key":"e_1_3_2_1_42_1","volume-title":"Proceedings of the International Conference on Pattern Recognition. 2464\u20132469","author":"Teerapittayanon Surat","year":"2016","unstructured":"Surat Teerapittayanon , Bradley McDanel , and Hsiang-Tsung Kung . 2016 . Branchynet: Fast Inference via Early Exiting from Deep Neural Networks . In Proceedings of the International Conference on Pattern Recognition. 2464\u20132469 . Surat Teerapittayanon, Bradley McDanel, and Hsiang-Tsung Kung. 2016. Branchynet: Fast Inference via Early Exiting from Deep Neural Networks. In Proceedings of the International Conference on Pattern Recognition. 2464\u20132469."},{"key":"e_1_3_2_1_43_1","unstructured":"TensorFlow. [n. d.]. TensorFlow Lite. https:\/\/www.tensorflow.org\/lite \t\t\t\t  TensorFlow. [n. d.]. TensorFlow Lite. https:\/\/www.tensorflow.org\/lite"},{"key":"e_1_3_2_1_44_1","volume-title":"GPU Technology Conference. 1, 2.","author":"Vanholder Han","year":"2016","unstructured":"Han Vanholder . 2016 . Efficient inference with tensorrt . In GPU Technology Conference. 1, 2. Han Vanholder. 2016. Efficient inference with tensorrt. In GPU Technology Conference. 1, 2."},{"key":"e_1_3_2_1_45_1","unstructured":"Ashish Vaswani Noam Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan N Gomez Lukasz Kaiser and Illia Polosukhin. 2017. Attention is all you need. arXiv preprint arXiv:1706.03762. \t\t\t\t  Ashish Vaswani Noam Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan N Gomez Lukasz Kaiser and Illia Polosukhin. 2017. Attention is all you need. arXiv preprint arXiv:1706.03762."},{"key":"e_1_3_2_1_46_1","volume-title":"Proceedings of the European Conference on Computer Vision (ECCV). 3\u201318","author":"Veit Andreas","year":"2018","unstructured":"Andreas Veit and Serge Belongie . 2018 . Convolutional networks with adaptive inference graphs . In Proceedings of the European Conference on Computer Vision (ECCV). 3\u201318 . Andreas Veit and Serge Belongie. 2018. Convolutional networks with adaptive inference graphs. In Proceedings of the European Conference on Computer Vision (ECCV). 3\u201318."},{"key":"e_1_3_2_1_47_1","volume-title":"Proceedings of the European Conference on Computer Vision. 409\u2013424","author":"Wang Xin","year":"2018","unstructured":"Xin Wang , Fisher Yu , Zi-Yi Dou , Trevor Darrell , and Joseph E Gonzalez . 2018 . Skipnet: Learning Dynamic Routing in Convolutional Networks . In Proceedings of the European Conference on Computer Vision. 409\u2013424 . Xin Wang, Fisher Yu, Zi-Yi Dou, Trevor Darrell, and Joseph E Gonzalez. 2018. Skipnet: Learning Dynamic Routing in Convolutional Networks. In Proceedings of the European Conference on Computer Vision. 409\u2013424."},{"key":"e_1_3_2_1_48_1","volume-title":"31st USENIX Security Symposium (USENIX Security 22)","author":"Wu Ruoyu","year":"2022","unstructured":"Ruoyu Wu , Taegyu Kim , Dave Jing Tian , Antonio Bianchi , and Dongyan Xu . 2022 . $DnD$: A $Cross-Architecture$ Deep Neural Network Decompiler . In 31st USENIX Security Symposium (USENIX Security 22) . 2135\u20132152. Ruoyu Wu, Taegyu Kim, Dave Jing Tian, Antonio Bianchi, and Dongyan Xu. 2022. $DnD$: A $Cross-Architecture$ Deep Neural Network Decompiler. In 31st USENIX Security Symposium (USENIX Security 22). 2135\u20132152."},{"key":"e_1_3_2_1_49_1","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 1278\u20131287","author":"Wu Zuxuan","year":"2019","unstructured":"Zuxuan Wu , Caiming Xiong , Chih-Yao Ma , Richard Socher , and Larry S Davis . 2019 . Adaframe: Adaptive frame selection for fast video recognition . In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 1278\u20131287 . Zuxuan Wu, Caiming Xiong, Chih-Yao Ma, Richard Socher, and Larry S Davis. 2019. Adaframe: Adaptive frame selection for fast video recognition. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 1278\u20131287."},{"key":"e_1_3_2_1_50_1","volume-title":"Proceedings of the 32nd International Conference on Machine Learning, ICML 2015, Lille, France, 6-11 July 2015 (JMLR Workshop and Conference Proceedings","volume":"2057","author":"Xu Kelvin","year":"2015","unstructured":"Kelvin Xu , Jimmy Ba , Ryan Kiros , Kyunghyun Cho , Aaron C. Courville , Ruslan Salakhutdinov , Richard S. Zemel , and Yoshua Bengio . 2015 . Show, Attend and Tell: Neural Image Caption Generation with Visual Attention . In Proceedings of the 32nd International Conference on Machine Learning, ICML 2015, Lille, France, 6-11 July 2015 (JMLR Workshop and Conference Proceedings , Vol. 37). JMLR.org, 2048\u2013 2057 . http:\/\/proceedings.mlr.press\/v37\/xuc15.html Kelvin Xu, Jimmy Ba, Ryan Kiros, Kyunghyun Cho, Aaron C. Courville, Ruslan Salakhutdinov, Richard S. Zemel, and Yoshua Bengio. 2015. Show, Attend and Tell: Neural Image Caption Generation with Visual Attention. In Proceedings of the 32nd International Conference on Machine Learning, ICML 2015, Lille, France, 6-11 July 2015 (JMLR Workshop and Conference Proceedings, Vol. 37). JMLR.org, 2048\u20132057. http:\/\/proceedings.mlr.press\/v37\/xuc15.html"},{"key":"e_1_3_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/3582016.3582047"},{"key":"e_1_3_2_1_52_1","volume-title":"A Survey of Large-Scale Deep Learning Serving System Optimization: Challenges and Opportunities. CoRR, abs\/2111.14247","author":"Yu Fuxun","year":"2021","unstructured":"Fuxun Yu , Di Wang , Longfei Shangguan , Minjia Zhang , Xulong Tang , Chenchen Liu , and Xiang Chen . 2021. A Survey of Large-Scale Deep Learning Serving System Optimization: Challenges and Opportunities. CoRR, abs\/2111.14247 ( 2021 ), arXiv:2111.14247. arxiv:2111.14247 Fuxun Yu, Di Wang, Longfei Shangguan, Minjia Zhang, Xulong Tang, Chenchen Liu, and Xiang Chen. 2021. A Survey of Large-Scale Deep Learning Serving System Optimization: Challenges and Opportunities. CoRR, abs\/2111.14247 (2021), arXiv:2111.14247. arxiv:2111.14247"},{"key":"e_1_3_2_1_53_1","first-page":"848","article-title":"DietCode: Automatic optimization for dynamic tensor programs","volume":"4","author":"Zheng Bojian","year":"2022","unstructured":"Bojian Zheng , Ziheng Jiang , Cody Hao Yu , Haichen Shen , Joshua Fromm , Yizhi Liu , Yida Wang , Luis Ceze , Tianqi Chen , and Gennady Pekhimenko . 2022 . DietCode: Automatic optimization for dynamic tensor programs . Proceedings of Machine Learning and Systems , 4 (2022), 848 \u2013 863 . Bojian Zheng, Ziheng Jiang, Cody Hao Yu, Haichen Shen, Joshua Fromm, Yizhi Liu, Yida Wang, Luis Ceze, Tianqi Chen, and Gennady Pekhimenko. 2022. DietCode: Automatic optimization for dynamic tensor programs. Proceedings of Machine Learning and Systems, 4 (2022), 848\u2013863.","journal-title":"Proceedings of Machine Learning and Systems"},{"key":"e_1_3_2_1_54_1","volume-title":"Proceedings of the 14th USENIX Conference on Operating Systems Design and Implementation. 863\u2013879","author":"Zheng Lianmin","year":"2020","unstructured":"Lianmin Zheng , Chengfan Jia , Minmin Sun , Zhao Wu , Cody Hao Yu , Ameer Haj-Ali , Yida Wang , Jun Yang , Danyang Zhuo , and Koushik Sen . 2020 . Ansor: Generating high-performance tensor programs for deep learning . In Proceedings of the 14th USENIX Conference on Operating Systems Design and Implementation. 863\u2013879 . Lianmin Zheng, Chengfan Jia, Minmin Sun, Zhao Wu, Cody Hao Yu, Ameer Haj-Ali, Yida Wang, Jun Yang, Danyang Zhuo, and Koushik Sen. 2020. Ansor: Generating high-performance tensor programs for deep learning. In Proceedings of the 14th USENIX Conference on Operating Systems Design and Implementation. 863\u2013879."},{"key":"e_1_3_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/3470496.3527440"},{"key":"e_1_3_2_1_56_1","volume-title":"16th USENIX Symposium on Operating Systems Design and Implementation (OSDI 22)","author":"Zhu Hongyu","year":"2022","unstructured":"Hongyu Zhu , Ruofan Wu , Yijia Diao , Shanbin Ke , Haoyu Li , Chen Zhang , Jilong Xue , Lingxiao Ma , Yuqing Xia , and Wei Cui . 2022 . $ROLLER$: Fast and Efficient Tensor Compilation for Deep Learning . In 16th USENIX Symposium on Operating Systems Design and Implementation (OSDI 22) . 233\u2013248. Hongyu Zhu, Ruofan Wu, Yijia Diao, Shanbin Ke, Haoyu Li, Chen Zhang, Jilong Xue, Lingxiao Ma, Yuqing Xia, and Wei Cui. 2022. $ROLLER$: Fast and Efficient Tensor Compilation for Deep Learning. In 16th USENIX Symposium on Operating Systems Design and Implementation (OSDI 22). 233\u2013248."}],"event":{"name":"ISSTA '23: 32nd ACM SIGSOFT International Symposium on Software Testing and Analysis","location":"Seattle WA USA","acronym":"ISSTA '23","sponsor":["SIGSOFT ACM Special Interest Group on Software Engineering","AITO"]},"container-title":["Proceedings of the 32nd ACM SIGSOFT International Symposium on Software Testing and Analysis"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3597926.3598082","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3597926.3598082","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:48:42Z","timestamp":1750182522000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3597926.3598082"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,7,12]]},"references-count":56,"alternative-id":["10.1145\/3597926.3598082","10.1145\/3597926"],"URL":"https:\/\/doi.org\/10.1145\/3597926.3598082","relation":{},"subject":[],"published":{"date-parts":[[2023,7,12]]},"assertion":[{"value":"2023-07-13","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}