{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,18]],"date-time":"2026-06-18T16:06:06Z","timestamp":1781798766711,"version":"3.54.5"},"publisher-location":"New York, NY, USA","reference-count":22,"publisher":"ACM","license":[{"start":{"date-parts":[[2019,12,9]],"date-time":"2019-12-09T00:00:00Z","timestamp":1575849600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["1755659"],"award-info":[{"award-number":["1755659"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2019,12,9]]},"DOI":"10.1145\/3366622.3368147","type":"proceedings-article","created":{"date-parts":[[2019,11,8]],"date-time":"2019-11-08T13:40:33Z","timestamp":1573220433000},"page":"7-12","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":8,"title":["Challenges and Opportunities of DNN Model Execution Caching"],"prefix":"10.1145","author":[{"given":"Guin R.","family":"Gilman","sequence":"first","affiliation":[{"name":"Department of Computer Science, Worcester Polytechnic Institute, Worcester, Massachusetts"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Samuel S.","family":"Ogden","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Worcester Polytechnic Institute, Worcester, Massachusetts"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Robert J.","family":"Walls","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Worcester Polytechnic Institute, Worcester, Massachusetts"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tian","family":"Guo","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Worcester Polytechnic Institute, Worcester, Massachusetts"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2019,12,9]]},"reference":[{"key":"e_1_3_2_1_1_1","unstructured":"2019. Lazily load models and on insufficient resources for a load look to unload idle models \u00b7 Issue #1403. https:\/\/github.com\/tensorflow\/serving\/issues\/1403.  2019. Lazily load models and on insufficient resources for a load look to unload idle models \u00b7 Issue #1403. https:\/\/github.com\/tensorflow\/serving\/issues\/1403."},{"key":"e_1_3_2_1_2_1","unstructured":"2019. List of Hosted Models. https:\/\/www.tensorflow.org\/lite\/guide\/hosted_models.  2019. List of Hosted Models. https:\/\/www.tensorflow.org\/lite\/guide\/hosted_models."},{"key":"e_1_3_2_1_3_1","unstructured":"Daniel S. Berger Ramesh K. Sitaraman and Mor Harchol-Balter. 2017. AdaptSize: Orchestrating the Hot Object Memory Cache in a Content Delivery Network. In NSDI 17.  Daniel S. Berger Ramesh K. Sitaraman and Mor Harchol-Balter. 2017. AdaptSize: Orchestrating the Hot Object Memory Cache in a Content Delivery Network. In NSDI 17."},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"crossref","unstructured":"Simone Bianco Remi Cadene Luigi Celona and Paolo Napoletano. 2018. Benchmark analysis of representative deep neural network architectures. IEEE Access (2018).  Simone Bianco Remi Cadene Luigi Celona and Paolo Napoletano. 2018. Benchmark analysis of representative deep neural network architectures. IEEE Access (2018).","DOI":"10.1109\/ACCESS.2018.2877890"},{"key":"e_1_3_2_1_5_1","volume-title":"Clipper: A Low-Latency Online Prediction Serving System. In NSDI 17.","author":"Crankshaw Daniel","year":"2017"},{"key":"e_1_3_2_1_6_1","volume-title":"Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv:1810.04805","author":"Devlin Jacob","year":"2018"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDCS.2017.94"},{"key":"e_1_3_2_1_8_1","volume-title":"USENIX Annual Technical Conference 15","author":"Gill Binny S","year":"2005"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/IC2E.2018.00042"},{"key":"e_1_3_2_1_10_1","volume-title":"The Fourth ACM\/IEEE Symposium on Edge Computing.","author":"Guo Tian"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"crossref","unstructured":"Michael R. Hines Umesh Deshpande and Kartik Gopalan. 2009. Post-copy Live Migration of Virtual Machines. SIGOPS Oper. Syst. Rev. (2009).  Michael R. Hines Umesh Deshpande and Kartik Gopalan. 2009. Post-copy Live Migration of Virtual Machines. SIGOPS Oper. Syst. Rev. (2009).","DOI":"10.1145\/1618525.1618528"},{"key":"e_1_3_2_1_12_1","volume-title":"2018 IEEE International Conference on Cloud Engineering (IC2E).","author":"Ishakian V."},{"key":"e_1_3_2_1_13_1","unstructured":"Jakub Kone\u010dny; Jie Liu Peter Richt\u00e1rik and Martin Tak\u00e1\u010d. 2015. Mini-batch semi-stochastic gradient descent in the proximal setting. IEEE Journal of Selected Topics in Signal Processing (2015).  Jakub Kone\u010dny; Jie Liu Peter Richt\u00e1rik and Martin Tak\u00e1\u010d. 2015. Mini-batch semi-stochastic gradient descent in the proximal setting. IEEE Journal of Selected Topics in Signal Processing (2015)."},{"key":"e_1_3_2_1_14_1","unstructured":"Samuel S. Ogden and Tian Guo. 2018. MODI: Mobile Deep Inference Made Efficient by Edge Computing. In HotEdge 18.  Samuel S. Ogden and Tian Guo. 2018. MODI: Mobile Deep Inference Made Efficient by Edge Computing. In HotEdge 18."},{"key":"e_1_3_2_1_15_1","unstructured":"Christopher Olston Noah Fiedel Kiril Gorovoy Jeremiah Harmsen Li Lao Fangwei Li Vinu Rajashekhar Sukriti Ramesh and Jordan Soyke. 2017. TensorFlow-Serving: Flexible High-Performance ML Serving. arXiv:1712.06139  Christopher Olston Noah Fiedel Kiril Gorovoy Jeremiah Harmsen Li Lao Fangwei Li Vinu Rajashekhar Sukriti Ramesh and Jordan Soyke. 2017. TensorFlow-Serving: Flexible High-Performance ML Serving. arXiv:1712.06139"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"crossref","unstructured":"Heiko Schwarz Detlev Marpe and Thomas Wiegand. 2007. Overview of the scalable video coding extension of the H. 264\/AVC standard. IEEE Transactions on circuits and systems for video technology (2007).  Heiko Schwarz Detlev Marpe and Thomas Wiegand. 2007. Overview of the scalable video coding extension of the H. 264\/AVC standard. IEEE Transactions on circuits and systems for video technology (2007).","DOI":"10.1109\/TCSVT.2007.905532"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00293"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICPR.2016.7900006"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3241539.3241563"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3127479.3131210"},{"key":"e_1_3_2_1_21_1","volume-title":"SLO-Aware Machine Learning Inference Serving. In 2019 USENIX Annual Technical Conference (USENIX ATC 19)","author":"Zhang Chengliang","year":"2019"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/HPCA.2016.7446077"}],"event":{"name":"Middleware '19: 20th International Middleware Conference","location":"Davis CA USA","acronym":"Middleware '19","sponsor":["ACM Association for Computing Machinery","IFIP"]},"container-title":["Proceedings of the Workshop on Distributed Infrastructures for Deep Learning"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3366622.3368147","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3366622.3368147","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3366622.3368147","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:13:33Z","timestamp":1750202013000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3366622.3368147"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,12,9]]},"references-count":22,"alternative-id":["10.1145\/3366622.3368147","10.1145\/3366622"],"URL":"https:\/\/doi.org\/10.1145\/3366622.3368147","relation":{},"subject":[],"published":{"date-parts":[[2019,12,9]]},"assertion":[{"value":"2019-12-09","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}