{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,11]],"date-time":"2026-07-11T15:41:54Z","timestamp":1783784514734,"version":"3.55.0"},"publisher-location":"New York, NY, USA","reference-count":63,"publisher":"ACM","license":[{"start":{"date-parts":[[2023,3,25]],"date-time":"2023-03-25T00:00:00Z","timestamp":1679702400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,3,25]]},"DOI":"10.1145\/3582016.3582028","type":"proceedings-article","created":{"date-parts":[[2023,3,20]],"date-time":"2023-03-20T16:59:03Z","timestamp":1679331543000},"page":"631-643","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":16,"title":["Snape: Reliable and Low-Cost Computing with Mixture of Spot and On-Demand VMs"],"prefix":"10.1145","author":[{"given":"Fangkai","family":"Yang","sequence":"first","affiliation":[{"name":"Microsoft Research, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lu","family":"Wang","sequence":"additional","affiliation":[{"name":"Microsoft Research, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhenyu","family":"Xu","sequence":"additional","affiliation":[{"name":"Microsoft Research, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jue","family":"Zhang","sequence":"additional","affiliation":[{"name":"Microsoft Research, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Liqun","family":"Li","sequence":"additional","affiliation":[{"name":"Microsoft Research, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bo","family":"Qiao","sequence":"additional","affiliation":[{"name":"Microsoft Research, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Camille","family":"Couturier","sequence":"additional","affiliation":[{"name":"Microsoft 365, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chetan","family":"Bansal","sequence":"additional","affiliation":[{"name":"Microsoft 365, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Soumya","family":"Ram","sequence":"additional","affiliation":[{"name":"Microsoft Azure, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Si","family":"Qin","sequence":"additional","affiliation":[{"name":"Microsoft Research, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhen","family":"Ma","sequence":"additional","affiliation":[{"name":"Microsoft 365, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"\u00cd\u00f1igo","family":"Goiri","sequence":"additional","affiliation":[{"name":"Microsoft Azure, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Eli","family":"Cortez","sequence":"additional","affiliation":[{"name":"Microsoft Azure, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Terry","family":"Yang","sequence":"additional","affiliation":[{"name":"Microsoft 365, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Victor","family":"R\u00fchle","sequence":"additional","affiliation":[{"name":"Microsoft 365, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Saravan","family":"Rajmohan","sequence":"additional","affiliation":[{"name":"Microsoft 365, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Qingwei","family":"Lin","sequence":"additional","affiliation":[{"name":"Microsoft Research, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dongmei","family":"Zhang","sequence":"additional","affiliation":[{"name":"Microsoft Research, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2023,3,25]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"Constrained Markov decision processes: stochastic modeling","author":"Altman Eitan","unstructured":"Eitan Altman . 1999. Constrained Markov decision processes: stochastic modeling . Routledge . Eitan Altman. 1999. Constrained Markov decision processes: stochastic modeling. Routledge."},{"key":"e_1_3_2_1_2_1","unstructured":"Amazon. 2022. Amazon EC2 Spot Instances. https:\/\/www.amazonaws.cn\/en\/ec2\/spot-instances\/ \t\t\t\t  Amazon. 2022. Amazon EC2 Spot Instances. https:\/\/www.amazonaws.cn\/en\/ec2\/spot-instances\/"},{"key":"e_1_3_2_1_3_1","volume-title":"Providing SLOs for Resource-Harvesting VMs in Cloud Platforms. In 14th USENIX Symposium on Operating Systems Design and Implementation (OSDI \u201920)","author":"Ambati Pradeep","year":"2020","unstructured":"Pradeep Ambati , \u00cd\u00f1igo Goiri , Felipe Frujeri , Alper Gun , Ke Wang , Brian Dolan , Brian Corell , Sekhar Pasupuleti , Thomas Moscibroda , Sameh Elnikety , Marcus Fontoura , and Ricardo Bianchini . 2020 . Providing SLOs for Resource-Harvesting VMs in Cloud Platforms. In 14th USENIX Symposium on Operating Systems Design and Implementation (OSDI \u201920) . 735\u2013751. Pradeep Ambati, \u00cd\u00f1igo Goiri, Felipe Frujeri, Alper Gun, Ke Wang, Brian Dolan, Brian Corell, Sekhar Pasupuleti, Thomas Moscibroda, Sameh Elnikety, Marcus Fontoura, and Ricardo Bianchini. 2020. Providing SLOs for Resource-Harvesting VMs in Cloud Platforms. In 14th USENIX Symposium on Operating Systems Design and Implementation (OSDI \u201920). 735\u2013751."},{"key":"e_1_3_2_1_4_1","unstructured":"Apache. 2022. Open Source Serverless Cloud Platform. https:\/\/openwhisk.apache.org\/ Accessed: 2022-10-19 \t\t\t\t  Apache. 2022. Open Source Serverless Cloud Platform. https:\/\/openwhisk.apache.org\/ Accessed: 2022-10-19"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/UKSim.2014.67"},{"key":"e_1_3_2_1_6_1","unstructured":"AutoSpotting. 2022. AutoSpotting. https:\/\/github.com\/cloudutil\/AutoSpotting Accessed: 2022-10-14 \t\t\t\t  AutoSpotting. 2022. AutoSpotting. https:\/\/github.com\/cloudutil\/AutoSpotting Accessed: 2022-10-14"},{"key":"e_1_3_2_1_7_1","unstructured":"AWS. 2022. Auto Scaling groups with multiple instance types and purchase options. https:\/\/docs.aws.amazon.com\/autoscaling\/ec2\/userguide\/ec2-auto-scaling-mixed-instances-groups.html \t\t\t\t  AWS. 2022. Auto Scaling groups with multiple instance types and purchase options. https:\/\/docs.aws.amazon.com\/autoscaling\/ec2\/userguide\/ec2-auto-scaling-mixed-instances-groups.html"},{"key":"e_1_3_2_1_8_1","unstructured":"AWS. 2022. AWS instance types. https:\/\/docs.aws.amazon.com\/AWSEC2\/latest\/WindowsGuide\/instance-types.html Accessed: 2022-06-28 \t\t\t\t  AWS. 2022. AWS instance types. https:\/\/docs.aws.amazon.com\/AWSEC2\/latest\/WindowsGuide\/instance-types.html Accessed: 2022-06-28"},{"key":"e_1_3_2_1_9_1","unstructured":"AWS. 2022. AWS VM Availability. https:\/\/docs.aws.amazon.com\/whitepapers\/latest\/real-time-communication-on-aws\/high-availability-and-scalability-on-aws.html \t\t\t\t  AWS. 2022. AWS VM Availability. https:\/\/docs.aws.amazon.com\/whitepapers\/latest\/real-time-communication-on-aws\/high-availability-and-scalability-on-aws.html"},{"key":"e_1_3_2_1_10_1","unstructured":"AWS. 2022. EC2 Spot Blocks. https:\/\/aws.amazon.com\/blogs\/aws\/new-ec2-spot-blocks-for-defined-duration-workloads\/ \t\t\t\t  AWS. 2022. EC2 Spot Blocks. https:\/\/aws.amazon.com\/blogs\/aws\/new-ec2-spot-blocks-for-defined-duration-workloads\/"},{"key":"e_1_3_2_1_11_1","unstructured":"Microsoft Azure. 2022. Azure Spot Virtual Machines. https:\/\/azure.microsoft.com\/en-us\/services\/virtual-machines\/spot\/#overview \t\t\t\t  Microsoft Azure. 2022. Azure Spot Virtual Machines. https:\/\/azure.microsoft.com\/en-us\/services\/virtual-machines\/spot\/#overview"},{"key":"e_1_3_2_1_12_1","unstructured":"Microsoft Azure. 2022. Azure Spot Virtual Machines: Try to restore functionality now generally available. https:\/\/azure.microsoft.com\/en-us\/updates\/azure-spot-virtual-machines-tryrestore-functionality-now-generally-available\/ \t\t\t\t  Microsoft Azure. 2022. Azure Spot Virtual Machines: Try to restore functionality now generally available. https:\/\/azure.microsoft.com\/en-us\/updates\/azure-spot-virtual-machines-tryrestore-functionality-now-generally-available\/"},{"key":"e_1_3_2_1_13_1","unstructured":"Microsoft Azure. 2022. Azure VM Availability. https:\/\/azure.microsoft.com\/en-us\/support\/legal\/sla\/virtual-machines\/v1_9\/ \t\t\t\t  Microsoft Azure. 2022. Azure VM Availability. https:\/\/azure.microsoft.com\/en-us\/support\/legal\/sla\/virtual-machines\/v1_9\/"},{"key":"e_1_3_2_1_14_1","unstructured":"Microsoft Azure. 2022. Azure VM SKU. https:\/\/docs.microsoft.com\/en-us\/azure\/virtual-machines\/sizes Accessed: 2022-10-19 \t\t\t\t  Microsoft Azure. 2022. Azure VM SKU. https:\/\/docs.microsoft.com\/en-us\/azure\/virtual-machines\/sizes Accessed: 2022-10-19"},{"key":"e_1_3_2_1_15_1","unstructured":"Microsoft Azure. 2022. Personalizer. https:\/\/learn.microsoft.com\/en-us\/azure\/cognitive-services\/personalizer\/what-is-personalizer \t\t\t\t  Microsoft Azure. 2022. Personalizer. https:\/\/learn.microsoft.com\/en-us\/azure\/cognitive-services\/personalizer\/what-is-personalizer"},{"key":"e_1_3_2_1_16_1","unstructured":"Microsoft Azure. 2022. Spot Priority Mix for high availability and cost savings. https:\/\/learn.microsoft.com\/zh-cn\/azure\/virtual-machine-scale-sets\/spot-priority-mix Accessed: 2022-10-19 \t\t\t\t  Microsoft Azure. 2022. Spot Priority Mix for high availability and cost savings. https:\/\/learn.microsoft.com\/zh-cn\/azure\/virtual-machine-scale-sets\/spot-priority-mix Accessed: 2022-10-19"},{"key":"e_1_3_2_1_17_1","unstructured":"Microsoft Azure. 2022. Virtual Machine Scale Sets. https:\/\/learn.microsoft.com\/en-us\/azure\/virtual-machine-scale-sets\/overview Accessed: 2022-09-28 \t\t\t\t  Microsoft Azure. 2022. Virtual Machine Scale Sets. https:\/\/learn.microsoft.com\/en-us\/azure\/virtual-machine-scale-sets\/overview Accessed: 2022-09-28"},{"key":"e_1_3_2_1_18_1","volume-title":"Proceedings of the International Conference on Automated Planning and Scheduling. 29","author":"Bhatia Abhinav","year":"2019","unstructured":"Abhinav Bhatia , Pradeep Varakantham , and Akshat Kumar . 2019 . Resource constrained deep reinforcement learning . In Proceedings of the International Conference on Automated Planning and Scheduling. 29 , 610\u2013620. Abhinav Bhatia, Pradeep Varakantham, and Akshat Kumar. 2019. Resource constrained deep reinforcement learning. In Proceedings of the International Conference on Automated Planning and Scheduling. 29, 610\u2013620."},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1010933404324"},{"key":"e_1_3_2_1_20_1","first-page":"13550","article-title":"Heuristic-guided reinforcement learning","volume":"34","author":"Cheng Ching-An","year":"2021","unstructured":"Ching-An Cheng , Andrey Kolobov , and Adith Swaminathan . 2021 . Heuristic-guided reinforcement learning . Advances in Neural Information Processing Systems , 34 (2021), 13550 \u2013 13563 . Ching-An Cheng, Andrey Kolobov, and Adith Swaminathan. 2021. Heuristic-guided reinforcement learning. Advances in Neural Information Processing Systems, 34 (2021), 13550\u201313563.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_1_21_1","unstructured":"Navraj Chohan Claris Castillo Mike Spreitzer Malgorzata Steinder Asser Tantawi and Chandra Krintz. 2010. See Spot Run: Using Spot Instances for Mapreduce Workflows. HotCloud\u201910. \t\t\t\t  Navraj Chohan Claris Castillo Mike Spreitzer Malgorzata Steinder Asser Tantawi and Chandra Krintz. 2010. See Spot Run: Using Spot Instances for Mapreduce Workflows. HotCloud\u201910."},{"key":"e_1_3_2_1_22_1","unstructured":"Google Cloud. 2022. Instance groups. https:\/\/cloud.google.com\/compute\/docs\/instance-groups\/ Accessed: 2022-09-28 \t\t\t\t  Google Cloud. 2022. Instance groups. https:\/\/cloud.google.com\/compute\/docs\/instance-groups\/ Accessed: 2022-09-28"},{"key":"e_1_3_2_1_23_1","unstructured":"Gal Dalal Krishnamurthy Dvijotham Matej Vecerik Todd Hester Cosmin Paduraru and Yuval Tassa. 2018. Safe exploration in continuous action spaces. arXiv preprint arXiv:1801.08757. \t\t\t\t  Gal Dalal Krishnamurthy Dvijotham Matej Vecerik Todd Hester Cosmin Paduraru and Yuval Tassa. 2018. Safe exploration in continuous action spaces. arXiv preprint arXiv:1801.08757."},{"key":"e_1_3_2_1_24_1","first-page":"2818","article-title":"Sample complexity of episodic fixed-horizon reinforcement learning","volume":"28","author":"Dann Christoph","year":"2015","unstructured":"Christoph Dann and Emma Brunskill . 2015 . Sample complexity of episodic fixed-horizon reinforcement learning . Advances in Neural Information Processing Systems , 28 (2015), 2818 \u2013 2826 . Christoph Dann and Emma Brunskill. 2015. Sample complexity of episodic fixed-horizon reinforcement learning. Advances in Neural Information Processing Systems, 28 (2015), 2818\u20132826.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1214\/aos\/1013203451"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3503222.3507725"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.5555\/2789272.2886795"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.engappai.2019.103360"},{"key":"e_1_3_2_1_29_1","unstructured":"Google. 2022. Google Spot VMs. https:\/\/cloud.google.com\/compute\/docs\/instances\/spot \t\t\t\t  Google. 2022. Google Spot VMs. https:\/\/cloud.google.com\/compute\/docs\/instances\/spot"},{"key":"e_1_3_2_1_30_1","volume-title":"Cocktail: A Multidimensional Optimization for Model Serving in Cloud. In 19th USENIX Symposium on Networked Systems Design and Implementation (NSDI \u201922)","author":"Gunasekaran Jashwant Raj","unstructured":"Jashwant Raj Gunasekaran , Cyan Subhra Mishra , Prashanth Thinakaran , Bikash Sharma , Mahmut Taylan Kandemir , and Chita R. Das . 2022 . Cocktail: A Multidimensional Optimization for Model Serving in Cloud. In 19th USENIX Symposium on Networked Systems Design and Implementation (NSDI \u201922) . Jashwant Raj Gunasekaran, Cyan Subhra Mishra, Prashanth Thinakaran, Bikash Sharma, Mahmut Taylan Kandemir, and Chita R. Das. 2022. Cocktail: A Multidimensional Optimization for Model Serving in Cloud. In 19th USENIX Symposium on Networked Systems Design and Implementation (NSDI \u201922)."},{"key":"e_1_3_2_1_31_1","volume-title":"14th USENIX Symposium on Operating Systems Design and Implementation (OSDI \u201920)","author":"Hadary Ori","year":"2020","unstructured":"Ori Hadary , Luke Marshall , Ishai Menache , Abhisek Pan , Esaias E Greeff , David Dion , Star Dorminey , Shailesh Joshi , Yang Chen , Mark Russinovich , and Thomas Moscibroda . 2020 . Protean: VM allocation service at scale . In 14th USENIX Symposium on Operating Systems Design and Implementation (OSDI \u201920) . 845\u2013861. Ori Hadary, Luke Marshall, Ishai Menache, Abhisek Pan, Esaias E Greeff, David Dion, Star Dorminey, Shailesh Joshi, Yang Chen, Mark Russinovich, and Thomas Moscibroda. 2020. Protean: VM allocation service at scale. In 14th USENIX Symposium on Operating Systems Design and Implementation (OSDI \u201920). 845\u2013861."},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1997.9.8.1735"},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/TASE.2017.2746348"},{"key":"e_1_3_2_1_34_1","volume-title":"Reformer: The Efficient Transformer. In 8th International Conference on Learning Representations, ICLR 2020","author":"Kitaev Nikita","year":"2020","unstructured":"Nikita Kitaev , Lukasz Kaiser , and Anselm Levskaya . 2020 . Reformer: The Efficient Transformer. In 8th International Conference on Learning Representations, ICLR 2020 , Addis Ababa, Ethiopia , April 26-30, 2020. OpenReview.net. Nikita Kitaev, Lukasz Kaiser, and Anselm Levskaya. 2020. Reformer: The Efficient Transformer. In 8th International Conference on Learning Representations, ICLR 2020, Addis Ababa, Ethiopia, April 26-30, 2020. OpenReview.net."},{"key":"e_1_3_2_1_35_1","volume-title":"Actor-critic algorithms. Advances in neural information processing systems, 12","author":"Konda Vijay","year":"1999","unstructured":"Vijay Konda and John Tsitsiklis . 1999. Actor-critic algorithms. Advances in neural information processing systems, 12 ( 1999 ), 1008\u20131014. Vijay Konda and John Tsitsiklis. 1999. Actor-critic algorithms. Advances in neural information processing systems, 12 (1999), 1008\u20131014."},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2318716.2318723"},{"key":"e_1_3_2_1_37_1","volume-title":"The Tenth International Conference on Learning Representations, ICLR 2022","author":"Li Boyan","year":"2022","unstructured":"Boyan Li , Hongyao Tang , Yan Zheng , Jianye Hao , Pengyi Li , Zhen Wang , Zhaopeng Meng , and Li Wang . 2022 . HyAR: Addressing Discrete-Continuous Action Reinforcement Learning via Hybrid Action Representation . In The Tenth International Conference on Learning Representations, ICLR 2022 , Virtual Event , April 25-29, 2022. OpenReview.net. Boyan Li, Hongyao Tang, Yan Zheng, Jianye Hao, Pengyi Li, Zhen Wang, Zhaopeng Meng, and Li Wang. 2022. HyAR: Addressing Discrete-Continuous Action Reinforcement Learning via Hybrid Action Representation. In The Tenth International Conference on Learning Representations, ICLR 2022, Virtual Event, April 25-29, 2022. OpenReview.net."},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.procir.2021.03.088"},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICNP49622.2020.9259378"},{"key":"e_1_3_2_1_40_1","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence. 34","author":"Liu Yongshuai","year":"2020","unstructured":"Yongshuai Liu , Jiaxin Ding , and Xin Liu . 2020 . IPO: Interior-point policy optimization under constraints . In Proceedings of the AAAI Conference on Artificial Intelligence. 34 , 4940\u20134947. Yongshuai Liu, Jiaxin Ding, and Xin Liu. 2020. IPO: Interior-point policy optimization under constraints. In Proceedings of the AAAI Conference on Artificial Intelligence. 34, 4940\u20134947."},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2021\/614"},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIFS.2022.3149396"},{"key":"e_1_3_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/3341302.3342080"},{"key":"e_1_3_2_1_44_1","volume-title":"Analysis and Exploitation of Dynamic Pricing in the Public Cloud for ML Training. In Workshop on Distributed Infrastructure, Systems, Programming, and AI.","author":"Narayanan Deepak","year":"2020","unstructured":"Deepak Narayanan , Keshav Santhanam , Fiodar Kazhamiaka , Amar Phanishayee , and Matei Zaharia . 2020 . Analysis and Exploitation of Dynamic Pricing in the Public Cloud for ML Training. In Workshop on Distributed Infrastructure, Systems, Programming, and AI. Deepak Narayanan, Keshav Santhanam, Fiodar Kazhamiaka, Amar Phanishayee, and Matei Zaharia. 2020. Analysis and Exploitation of Dynamic Pricing in the Public Cloud for ML Training. In Workshop on Distributed Infrastructure, Systems, Programming, and AI."},{"key":"e_1_3_2_1_45_1","volume-title":"Conference on Robot Learning. 735\u2013751","author":"Neunert Michael","year":"2020","unstructured":"Michael Neunert , Abbas Abdolmaleki , Markus Wulfmeier , Thomas Lampe , Tobias Springenberg , Roland Hafner , Francesco Romano , Jonas Buchli , Nicolas Heess , and Martin Riedmiller . 2020 . Continuous-discrete reinforcement learning for hybrid control in robotics . In Conference on Robot Learning. 735\u2013751 . Michael Neunert, Abbas Abdolmaleki, Markus Wulfmeier, Thomas Lampe, Tobias Springenberg, Roland Hafner, Francesco Romano, Jonas Buchli, Nicolas Heess, and Martin Riedmiller. 2020. Continuous-discrete reinforcement learning for hybrid control in robotics. In Conference on Robot Learning. 735\u2013751."},{"key":"e_1_3_2_1_46_1","unstructured":"OpenAI. 2022. Proximal Policy Optimization. https:\/\/spinningup.openai.com\/en\/latest\/algorithms\/ppo.html Accessed: 2022-06-28 \t\t\t\t  OpenAI. 2022. Proximal Policy Optimization. https:\/\/spinningup.openai.com\/en\/latest\/algorithms\/ppo.html Accessed: 2022-06-28"},{"key":"e_1_3_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2018.8460547"},{"key":"e_1_3_2_1_48_1","volume-title":"FIRM: An Intelligent Fine-grained Resource Management Framework for SLO-Oriented Microservices. In 14th USENIX Symposium on Operating Systems Design and Implementation (OSDI \u201920)","author":"Qiu Haoran","unstructured":"Haoran Qiu , Subho S. Banerjee , Saurabh Jha , Zbigniew T. Kalbarczyk , and Ravishankar K. Iyer . 2020 . FIRM: An Intelligent Fine-grained Resource Management Framework for SLO-Oriented Microservices. In 14th USENIX Symposium on Operating Systems Design and Implementation (OSDI \u201920) . Haoran Qiu, Subho S. Banerjee, Saurabh Jha, Zbigniew T. Kalbarczyk, and Ravishankar K. Iyer. 2020. FIRM: An Intelligent Fine-grained Resource Management Framework for SLO-Oriented Microservices. In 14th USENIX Symposium on Operating Systems Design and Implementation (OSDI \u201920)."},{"key":"e_1_3_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/3517207.3526971"},{"key":"e_1_3_2_1_50_1","unstructured":"John Schulman Filip Wolski Prafulla Dhariwal Alec Radford and Oleg Klimov. 2017. Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347. \t\t\t\t  John Schulman Filip Wolski Prafulla Dhariwal Alec Radford and Oleg Klimov. 2017. Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347."},{"key":"e_1_3_2_1_51_1","volume-title":"Linear regression analysis. 329","author":"Seber George AF","unstructured":"George AF Seber and Alan J Lee . 2012. Linear regression analysis. 329 , John Wiley & Sons . George AF Seber and Alan J Lee. 2012. Linear regression analysis. 329, John Wiley & Sons."},{"key":"e_1_3_2_1_52_1","volume-title":"Near-optimal time and sample complexities for solving Markov decision processes with a generative model. Advances in Neural Information Processing Systems, 31","author":"Sidford Aaron","year":"2018","unstructured":"Aaron Sidford , Mengdi Wang , Xian Wu , Lin Yang , and Yinyu Ye. 2018. Near-optimal time and sample complexities for solving Markov decision processes with a generative model. Advances in Neural Information Processing Systems, 31 ( 2018 ). Aaron Sidford, Mengdi Wang, Xian Wu, Lin Yang, and Yinyu Ye. 2018. Near-optimal time and sample complexities for solving Markov decision processes with a generative model. Advances in Neural Information Processing Systems, 31 (2018)."},{"key":"e_1_3_2_1_53_1","volume-title":"Policy gradient methods for reinforcement learning with function approximation. Advances in neural information processing systems, 12","author":"Sutton Richard S","year":"1999","unstructured":"Richard S Sutton , David McAllester , Satinder Singh , and Yishay Mansour . 1999. Policy gradient methods for reinforcement learning with function approximation. Advances in neural information processing systems, 12 ( 1999 ). Richard S Sutton, David McAllester, Satinder Singh, and Yishay Mansour. 1999. Policy gradient methods for reinforcement learning with function approximation. Advances in neural information processing systems, 12 (1999)."},{"key":"e_1_3_2_1_54_1","doi-asserted-by":"crossref","unstructured":"Taylor Sean J. Letham and  Benjamin. 2018. Forecasting at Scale. American Statistician. \t\t\t\t  Taylor Sean J. Letham and  Benjamin. 2018. Forecasting at Scale. American Statistician.","DOI":"10.7287\/peerj.preprints.3190v2"},{"key":"e_1_3_2_1_55_1","volume-title":"Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani , Noam Shazeer , Niki Parmar , Jakob Uszkoreit , Llion Jones , Aidan N. Gomez , Lukasz Kaiser , and Illia Polosukhin . 2017 . Attention is All you Need . In Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017 , December 4-9, 2017, Long Beach, CA, USA. 5998\u20136008. Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin. 2017. Attention is All you Need. In Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, December 4-9, 2017, Long Beach, CA, USA. 5998\u20136008."},{"key":"e_1_3_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/2741948.2741964"},{"key":"e_1_3_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/3447786.3456225"},{"key":"e_1_3_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/3487553.3524229"},{"key":"e_1_3_2_1_59_1","volume-title":"SLO-Aware Machine Learning Inference Serving. In 2019 USENIX Annual Technical Conference (USENIX ATC \u201919)","author":"Zhang Chengliang","year":"2019","unstructured":"Chengliang Zhang , Minchen Yu , Wei Wang , and Feng Yan . 2019 . MArk: Exploiting Cloud Services for Cost-Effective , SLO-Aware Machine Learning Inference Serving. In 2019 USENIX Annual Technical Conference (USENIX ATC \u201919) . 1049\u20131062. Chengliang Zhang, Minchen Yu, Wei Wang, and Feng Yan. 2019. MArk: Exploiting Cloud Services for Cost-Effective, SLO-Aware Machine Learning Inference Serving. In 2019 USENIX Annual Technical Conference (USENIX ATC \u201919). 1049\u20131062."},{"key":"e_1_3_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/3299869.3300085"},{"key":"e_1_3_2_1_61_1","volume-title":"12th Conference on Innovative Data Systems Research, CIDR. 9\u201312","author":"Zhang Qizhen","year":"2022","unstructured":"Qizhen Zhang , Philip Bernstein , Daniel Berger , Badrish Chandramouli , Vincent Liu , and Boon Thau Loo . 2022 . Compucache: Remote computable caching using spot VMs . In 12th Conference on Innovative Data Systems Research, CIDR. 9\u201312 . Qizhen Zhang, Philip Bernstein, Daniel Berger, Badrish Chandramouli, Vincent Liu, and Boon Thau Loo. 2022. Compucache: Remote computable caching using spot VMs. In 12th Conference on Innovative Data Systems Research, CIDR. 9\u201312."},{"key":"e_1_3_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/3477132.3483580"},{"key":"e_1_3_2_1_63_1","volume-title":"Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting. In Thirty-Fifth AAAI Conference on Artificial Intelligence, AAAI 2021","author":"Zhou Haoyi","year":"2021","unstructured":"Haoyi Zhou , Shanghang Zhang , Jieqi Peng , Shuai Zhang , Jianxin Li , Hui Xiong , and Wancai Zhang . 2021 . Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting. In Thirty-Fifth AAAI Conference on Artificial Intelligence, AAAI 2021 , Virtual Event , February 2-9, 2021. AAAI Press, 11106\u201311115. Haoyi Zhou, Shanghang Zhang, Jieqi Peng, Shuai Zhang, Jianxin Li, Hui Xiong, and Wancai Zhang. 2021. Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting. In Thirty-Fifth AAAI Conference on Artificial Intelligence, AAAI 2021, Virtual Event, February 2-9, 2021. AAAI Press, 11106\u201311115."}],"event":{"name":"ASPLOS '23: 28th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 3","location":"Vancouver BC Canada","acronym":"ASPLOS '23","sponsor":["SIGARCH ACM Special Interest Group on Computer Architecture","SIGOPS ACM Special Interest Group on Operating Systems","SIGPLAN ACM Special Interest Group on Programming Languages","SIGBED ACM Special Interest Group on Embedded Systems"]},"container-title":["Proceedings of the 28th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 3"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3582016.3582028","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:46:45Z","timestamp":1750178805000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3582016.3582028"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,25]]},"references-count":63,"alternative-id":["10.1145\/3582016.3582028","10.1145\/3582016"],"URL":"https:\/\/doi.org\/10.1145\/3582016.3582028","relation":{},"subject":[],"published":{"date-parts":[[2023,3,25]]},"assertion":[{"value":"2023-03-25","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}