{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,11]],"date-time":"2026-07-11T16:25:00Z","timestamp":1783787100448,"version":"3.55.0"},"publisher-location":"New York, NY, USA","reference-count":81,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,11,7]],"date-time":"2022-11-07T00:00:00Z","timestamp":1667779200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"IBM-ILLINOIS Discovery Accelerator Institute (IIDAI)"},{"name":"National Science Foundation (NSF)","award":["CCF 20-29049"],"award-info":[{"award-number":["CCF 20-29049"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,11,7]]},"DOI":"10.1145\/3542929.3563475","type":"proceedings-article","created":{"date-parts":[[2022,11,7]],"date-time":"2022-11-07T20:19:18Z","timestamp":1667852358000},"page":"306-322","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":21,"title":["SIMPPO"],"prefix":"10.1145","author":[{"given":"Haoran","family":"Qiu","sequence":"first","affiliation":[{"name":"UIUC"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Weichao","family":"Mao","sequence":"additional","affiliation":[{"name":"UIUC"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Archit","family":"Patke","sequence":"additional","affiliation":[{"name":"UIUC"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chen","family":"Wang","sequence":"additional","affiliation":[{"name":"IBM Research"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hubertus","family":"Franke","sequence":"additional","affiliation":[{"name":"IBM Research"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zbigniew T.","family":"Kalbarczyk","sequence":"additional","affiliation":[{"name":"UIUC"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tamer","family":"Ba\u015far","sequence":"additional","affiliation":[{"name":"UIUC"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ravishankar K.","family":"Iyer","sequence":"additional","affiliation":[{"name":"UIUC"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2022,11,7]]},"reference":[{"key":"e_1_3_2_1_1_1","unstructured":"Amazon. 2022. AWS Lambda Concurrency Limit. https:\/\/docs.aws.amazon.com\/lambda\/latest\/dg\/invocation-scaling.html. Accessed: 2022-04-14.  Amazon. 2022. AWS Lambda Concurrency Limit. https:\/\/docs.aws.amazon.com\/lambda\/latest\/dg\/invocation-scaling.html. Accessed: 2022-04-14."},{"key":"e_1_3_2_1_2_1","unstructured":"Andrea Angiuli Jean-Pierre Fouque and Mathieu Lauriere. 2021. Reinforcement Learning for Mean Field Games with Applications to Economics. https:\/\/arxiv.org\/abs\/2106.13755  Andrea Angiuli Jean-Pierre Fouque and Mathieu Lauriere. 2021. Reinforcement Learning for Mean Field Games with Applications to Economics. https:\/\/arxiv.org\/abs\/2106.13755"},{"key":"e_1_3_2_1_3_1","volume-title":"Miles Brundage, and Anil Anthony Bharath.","author":"Arulkumaran Kai","year":"2017","unstructured":"Kai Arulkumaran , Marc Peter Deisenroth , Miles Brundage, and Anil Anthony Bharath. 2017 . A Brief Survey of Deep Reinforcement Learning. CoRR abs\/1708.05866 (2017), 16 pages. http:\/\/arxiv.org\/abs\/1708.05866 Kai Arulkumaran, Marc Peter Deisenroth, Miles Brundage, and Anil Anthony Bharath. 2017. A Brief Survey of Deep Reinforcement Learning. CoRR abs\/1708.05866 (2017), 16 pages. http:\/\/arxiv.org\/abs\/1708.05866"},{"key":"e_1_3_2_1_4_1","volume-title":"Serverless Computing: Current Trends and Open Problems","author":"Baldini Ioana","year":"2017","unstructured":"Ioana Baldini , Paul Castro , Kerry Chang , Perry Cheng , Stephen Fink , Vatche Ishakian , Nick Mitchell , Vinod Muthusamy , 2017 . Serverless Computing: Current Trends and Open Problems . Springer Singapore , Singapore , 1--20. Ioana Baldini, Paul Castro, Kerry Chang, Perry Cheng, Stephen Fink, Vatche Ishakian, Nick Mitchell, Vinod Muthusamy, et al. 2017. Serverless Computing: Current Trends and Open Problems. Springer Singapore, Singapore, 1--20."},{"key":"e_1_3_2_1_5_1","volume-title":"Proceedings of the 37th International Conference on Machine Learning (ICML","author":"Banerjee Subho","year":"2020","unstructured":"Subho Banerjee , Saurabh Jha , Zbigniew T. Kalbarczyk , and Ravishankar K. Iyer . 2020. Inductive-bias-driven Reinforcement Learning for Efficient Scheduling in Heterogeneous Clusters . In Proceedings of the 37th International Conference on Machine Learning (ICML 2020 ). PMLR, Cambridge, MA, USA, 629--641. Subho Banerjee, Saurabh Jha, Zbigniew T. Kalbarczyk, and Ravishankar K. Iyer. 2020. Inductive-bias-driven Reinforcement Learning for Efficient Scheduling in Heterogeneous Clusters. In Proceedings of the 37th International Conference on Machine Learning (ICML 2020). PMLR, Cambridge, MA, USA, 629--641."},{"key":"e_1_3_2_1_6_1","volume-title":"The Datacenter as a Computer: Designing Warehouse-scale Machines","author":"Barroso Luiz Andr\u00e9","unstructured":"Luiz Andr\u00e9 Barroso , Urs H\u00f6lzle , and Parthasarathy Ranganathan . 2018. The Datacenter as a Computer: Designing Warehouse-scale Machines ( 3 rd ed.). Morgan & Claypool Publishers , San Rafael, CA, USA . Luiz Andr\u00e9 Barroso, Urs H\u00f6lzle, and Parthasarathy Ranganathan. 2018. The Datacenter as a Computer: Designing Warehouse-scale Machines (3rd ed.). Morgan & Claypool Publishers, San Rafael, CA, USA.","edition":"3"},{"key":"e_1_3_2_1_7_1","volume-title":"Site Reliability Engineering: How Google Runs Production Systems","author":"Beyer Betsy","unstructured":"Betsy Beyer , Chris Jones , Jennifer Petoff , and Niall Richard Murphy . 2016. Site Reliability Engineering: How Google Runs Production Systems . O'Reilly Media, Inc. , Sebastopol, CA, USA . Betsy Beyer, Chris Jones, Jennifer Petoff, and Niall Richard Murphy. 2016. Site Reliability Engineering: How Google Runs Production Systems. O'Reilly Media, Inc., Sebastopol, CA, USA."},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/375735.375826"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-14435-6_7"},{"key":"e_1_3_2_1_10_1","volume-title":"Proceedings of the 15th National Conference on Artificial Intelligence and the 10th Innovative Applications of Artificial Intelligence Conference (AAAI\/IAAI 1998)","author":"Claus Caroline","year":"1998","unstructured":"Caroline Claus and Craig Boutilier . 1998 . The Dynamics of Reinforcement Learning in Cooperative Multi-agent Systems . Proceedings of the 15th National Conference on Artificial Intelligence and the 10th Innovative Applications of Artificial Intelligence Conference (AAAI\/IAAI 1998) 2 (1998), 746--752. Caroline Claus and Craig Boutilier. 1998. The Dynamics of Reinforcement Learning in Cooperative Multi-agent Systems. Proceedings of the 15th National Conference on Artificial Intelligence and the 10th Innovative Applications of Artificial Intelligence Conference (AAAI\/IAAI 1998) 2 (1998), 746--752."},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3464298.3476133"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3419111.3421285"},{"key":"e_1_3_2_1_13_1","volume-title":"Proceedings of the 16th USENIX Symposium on Networked Systems Design and Implementation (NSDI","author":"Curino Carlo","year":"2019","unstructured":"Carlo Curino , Subru Krishnan , Konstantinos Karanasos , Sriram Rao , Giovanni M. Fumarola , Botong Huang , Kishore Chaliparambil , Arun Suresh , Young Chen , Solom Heddaya , 2019 . Hydra: A Federated Resource Manager for Data-center Scale Analytics . In Proceedings of the 16th USENIX Symposium on Networked Systems Design and Implementation (NSDI 2019). USENIX Association, Berkeley, CA, USA, 177--192. Carlo Curino, Subru Krishnan, Konstantinos Karanasos, Sriram Rao, Giovanni M. Fumarola, Botong Huang, Kishore Chaliparambil, Arun Suresh, Young Chen, Solom Heddaya, et al. 2019. Hydra: A Federated Resource Manager for Data-center Scale Analytics. In Proceedings of the 16th USENIX Symposium on Networked Systems Design and Implementation (NSDI 2019). USENIX Association, Berkeley, CA, USA, 177--192."},{"key":"e_1_3_2_1_14_1","volume-title":"Mingfei Sun, and Shimon Whiteson.","author":"de Witt Christian Schroeder","year":"2020","unstructured":"Christian Schroeder de Witt , Tarun Gupta , Denys Makoviichuk , Viktor Makoviychuk , Philip HS Torr , Mingfei Sun, and Shimon Whiteson. 2020 . Is Independent Learning All You Need in the StarCraft MultiAgent Challenge ? arXiv:2011.09533 abs\/2011.09533 (2020), 11 pages. Christian Schroeder de Witt, Tarun Gupta, Denys Makoviichuk, Viktor Makoviychuk, Philip HS Torr, Mingfei Sun, and Shimon Whiteson. 2020. Is Independent Learning All You Need in the StarCraft MultiAgent Challenge? arXiv:2011.09533 abs\/2011.09533 (2020), 11 pages."},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/IISWC.2013.6704667"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2644865.2541941"},{"key":"e_1_3_2_1_17_1","volume-title":"Autonomous Warehouse-Scale Computers. In 2020 57th ACM\/IEEE Design Automation Conference (DAC). Association for Computing Machinery","author":"Dev Sundar","year":"2020","unstructured":"Sundar Dev , David Lo , Liqun Cheng , and Parthasarathy Ranganathan . 2020 . Autonomous Warehouse-Scale Computers. In 2020 57th ACM\/IEEE Design Automation Conference (DAC). Association for Computing Machinery , New York, NY, USA, 1--6. Sundar Dev, David Lo, Liqun Cheng, and Parthasarathy Ranganathan. 2020. Autonomous Warehouse-Scale Computers. In 2020 57th ACM\/IEEE Design Automation Conference (DAC). Association for Computing Machinery, New York, NY, USA, 1--6."},{"key":"e_1_3_2_1_18_1","unstructured":"Apache Software Foundation. 2022. OpenWhisk. https:\/\/github.com\/apache\/openwhisk. Accessed: 2022-04-14.  Apache Software Foundation. 2022. OpenWhisk. https:\/\/github.com\/apache\/openwhisk. Accessed: 2022-04-14."},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3297858.3304004"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.engappai.2021.104288"},{"key":"e_1_3_2_1_21_1","volume-title":"Proceedings of the 6th International Workshop on Serverless Computing (WoSC6)","author":"Ginzburg Samuel","year":"2020","unstructured":"Samuel Ginzburg and Michael J. Freedman . 2020. Serverless Isn't Server-less: Measuring and Exploiting Resource Variability on Cloud FaaS Platforms . In Proceedings of the 6th International Workshop on Serverless Computing (WoSC6) 2020 . Association for Computing Machinery, New York, NY, USA, 43--48. Samuel Ginzburg and Michael J. Freedman. 2020. Serverless Isn't Server-less: Measuring and Exploiting Resource Variability on Cloud FaaS Platforms. In Proceedings of the 6th International Workshop on Serverless Computing (WoSC6) 2020. Association for Computing Machinery, New York, NY, USA, 43--48."},{"key":"e_1_3_2_1_22_1","volume-title":"Proceedings of the 14th USENIX Symposium on Operating Systems Design and Implementation (OSDI","author":"Gujarati Arpan","year":"2020","unstructured":"Arpan Gujarati , Reza Karimi , Safya Alzayat , Wei Hao , Antoine Kaufmann , Ymir Vigfusson , and Jonathan Mace . 2020 . Serving DNNs like Clockwork: Performance Predictability from the Bottom Up . In Proceedings of the 14th USENIX Symposium on Operating Systems Design and Implementation (OSDI 2020). USENIX Association, Berkeley, CA, USA, 443--462. Arpan Gujarati, Reza Karimi, Safya Alzayat, Wei Hao, Antoine Kaufmann, Ymir Vigfusson, and Jonathan Mace. 2020. Serving DNNs like Clockwork: Performance Predictability from the Bottom Up. In Proceedings of the 14th USENIX Symposium on Operating Systems Design and Implementation (OSDI 2020). USENIX Association, Berkeley, CA, USA, 443--462."},{"key":"e_1_3_2_1_23_1","volume-title":"Proceedings of the 8th USENIX Symposium on Networked Systems Design and Implementation (NSDI","author":"Hindman Benjamin","year":"2011","unstructured":"Benjamin Hindman , Andy Konwinski , Matei Zaharia , Ali Ghodsi , Anthony D Joseph , Randy Katz , Scott Shenker , and Ion Stoica . 2011 . Mesos: A Platform for Fine-grained Resource Sharing in the Data Center . In Proceedings of the 8th USENIX Symposium on Networked Systems Design and Implementation (NSDI 2011). USENIX Association, Berkeley, CA, USA, 1--14. Benjamin Hindman, Andy Konwinski, Matei Zaharia, Ali Ghodsi, Anthony D Joseph, Randy Katz, Scott Shenker, and Ion Stoica. 2011. Mesos: A Platform for Fine-grained Resource Sharing in the Data Center. In Proceedings of the 8th USENIX Symposium on Networked Systems Design and Implementation (NSDI 2011). USENIX Association, Berkeley, CA, USA, 1--14."},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/3445814.3446701"},{"key":"e_1_3_2_1_25_1","volume-title":"Practical Scheduling for Real-World Serverless Computing. arXiv preprint arXiv:2111.07226","author":"Kaffes Kostis","year":"2021","unstructured":"Kostis Kaffes , Neeraja J Yadwadkar , and Christos Kozyrakis . 2021. Practical Scheduling for Real-World Serverless Computing. arXiv preprint arXiv:2111.07226 ( 2021 ), 14 pages. Kostis Kaffes, Neeraja J Yadwadkar, and Christos Kozyrakis. 2021. Practical Scheduling for Real-World Serverless Computing. arXiv preprint arXiv:2111.07226 (2021), 14 pages."},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3267809.3267832"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3302424.3303958"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPDS.2020.3025914"},{"key":"e_1_3_2_1_29_1","unstructured":"Kubernetes. 2022. Horizontal Pod Autoscaling. https:\/\/kubernetes.io\/docs\/tasks\/run-application\/horizontal-pod-autoscale\/. Accessed: 2022-04-14.  Kubernetes. 2022. Horizontal Pod Autoscaling. https:\/\/kubernetes.io\/docs\/tasks\/run-application\/horizontal-pod-autoscale\/. Accessed: 2022-04-14."},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/CLOUD55607.2022.00067"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/LCA.2021.3066142"},{"key":"e_1_3_2_1_32_1","volume-title":"Proceedings of the 4th International Conference on Learning Representations (ICLR","author":"Lillicrap Timothy P.","year":"2016","unstructured":"Timothy P. Lillicrap , Jonathan J. Hunt , Alexander Pritzel , Nicolas Heess , Tom Erez , Yuval Tassa , David Silver , and Daan Wierstra . 2016 . Continuous Control with Deep Reinforcement Learning . In Proceedings of the 4th International Conference on Learning Representations (ICLR 2016). Open Review, Online, 14 pages. https:\/\/arxiv.org\/abs\/1509.02971 Timothy P. Lillicrap, Jonathan J. Hunt, Alexander Pritzel, Nicolas Heess, Tom Erez, Yuval Tassa, David Silver, and Daan Wierstra. 2016. Continuous Control with Deep Reinforcement Learning. In Proceedings of the 4th International Conference on Learning Representations (ICLR 2016). Open Review, Online, 14 pages. https:\/\/arxiv.org\/abs\/1509.02971"},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/2749469.2749475"},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3005745.3005750"},{"key":"e_1_3_2_1_35_1","volume-title":"Songtao He, Vikram Nathan, et al.","author":"Mao Hongzi","year":"2019","unstructured":"Hongzi Mao , Parimarjan Negi , Akshay Narayan , Hanrui Wang , Jiacheng Yang , Haonan Wang , Ryan Marcus , Mehrdad Khani Shirkoohi , Songtao He, Vikram Nathan, et al. 2019 . Park : An Open Platform for Learning-augmented Computer Systems. Advances in Neural Information Processing Systems (NIPS 2019) 32 (2019), 13 pages. Hongzi Mao, Parimarjan Negi, Akshay Narayan, Hanrui Wang, Jiacheng Yang, Haonan Wang, Ryan Marcus, Mehrdad Khani Shirkoohi, Songtao He, Vikram Nathan, et al. 2019. Park: An Open Platform for Learning-augmented Computer Systems. Advances in Neural Information Processing Systems (NIPS 2019) 32 (2019), 13 pages."},{"key":"e_1_3_2_1_36_1","volume-title":"Proceedings of the 36th Conference on Advances in Neural Information Processing Systems (NIPS","volume":"36","author":"Mao Weichao","year":"2022","unstructured":"Weichao Mao , Haoran Qiu , Chen Wang , Hubertus Franke , Zbigniew T. Kalbarczyk , Ravishankar K. Iyer , and Tamer Ba\u015far . 2022 . A Mean-Field Game Approach to Cloud Resource Management with Function Approximation . In Proceedings of the 36th Conference on Advances in Neural Information Processing Systems (NIPS 2022), Vol. 36 . Curran Associates, Inc., New Orleans, LA, USA, 1--12. Weichao Mao, Haoran Qiu, Chen Wang, Hubertus Franke, Zbigniew T. Kalbarczyk, Ravishankar K. Iyer, and Tamer Ba\u015far. 2022. A Mean-Field Game Approach to Cloud Resource Management with Function Approximation. In Proceedings of the 36th Conference on Advances in Neural Information Processing Systems (NIPS 2022), Vol. 36. Curran Associates, Inc., New Orleans, LA, USA, 1--12."},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/FOCS.2008.36"},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3472883.3487014"},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICC.2002.997043"},{"key":"e_1_3_2_1_40_1","volume-title":"Proceedings of the 13th USENIX Symposium on Operating Systems Design and Implementation (OSDI","author":"Moritz Philipp","year":"2018","unstructured":"Philipp Moritz , Robert Nishihara , Stephanie Wang , Alexey Tumanov , Richard Liaw , Eric Liang , Melih Elibol , Zongheng Yang , William Paul , Michael I. Jordan , 2018 . Ray: A Distributed Framework for Emerging AI applications . In Proceedings of the 13th USENIX Symposium on Operating Systems Design and Implementation (OSDI 2018). USENIX Association, Berkeley, CA, USA, 561--577. Philipp Moritz, Robert Nishihara, Stephanie Wang, Alexey Tumanov, Richard Liaw, Eric Liang, Melih Elibol, Zongheng Yang, William Paul, Michael I. Jordan, et al. 2018. Ray: A Distributed Framework for Emerging AI applications. In Proceedings of the 13th USENIX Symposium on Operating Systems Design and Implementation (OSDI 2018). USENIX Association, Berkeley, CA, USA, 561--577."},{"key":"e_1_3_2_1_41_1","volume-title":"Hipster: Hybrid Task Manager for Latency-critical Cloud Workloads. In IEEE International Symposium on High Performance Computer Architecture (HPCA","author":"Nishtala Rajiv","year":"2017","unstructured":"Rajiv Nishtala , Paul Carpenter , Vinicius Petrucci , and Xavier Martorell . 2017 . Hipster: Hybrid Task Manager for Latency-critical Cloud Workloads. In IEEE International Symposium on High Performance Computer Architecture (HPCA 2017). IEEE Computer Society, Washington, DC, USA, 409--420. Rajiv Nishtala, Paul Carpenter, Vinicius Petrucci, and Xavier Martorell. 2017. Hipster: Hybrid Task Manager for Latency-critical Cloud Workloads. In IEEE International Symposium on High Performance Computer Architecture (HPCA 2017). IEEE Computer Society, Washington, DC, USA, 409--420."},{"key":"e_1_3_2_1_42_1","volume-title":"Albrecht","author":"Papoudakis Georgios","year":"2019","unstructured":"Georgios Papoudakis , Filippos Christianos , Arrasy Rahman , and Stefano V . Albrecht . 2019 . Dealing with Non-stationarity in Multi-agent Deep Reinforcement Learning . https:\/\/arxiv.org\/abs\/1906.04737 Georgios Papoudakis, Filippos Christianos, Arrasy Rahman, and Stefano V. Albrecht. 2019. Dealing with Non-stationarity in Multi-agent Deep Reinforcement Learning. https:\/\/arxiv.org\/abs\/1906.04737"},{"key":"e_1_3_2_1_43_1","volume-title":"Proceedings of the 14th USENIX Symposium on Operating Systems Design and Implementation (OSDI","author":"Qiu Haoran","year":"2020","unstructured":"Haoran Qiu , Subho S. Banerjee , Saurabh Jha , Zbigniew T. Kalbarczyk , and Ravishankar K. Iyer . 2020. FIRM: An Intelligent Fine-grained Resource Management Framework for SLO-oriented Microservices . In Proceedings of the 14th USENIX Symposium on Operating Systems Design and Implementation (OSDI 2020 ). USENIX Association, Berkeley, CA, USA, 805--825. Haoran Qiu, Subho S. Banerjee, Saurabh Jha, Zbigniew T. Kalbarczyk, and Ravishankar K. Iyer. 2020. FIRM: An Intelligent Fine-grained Resource Management Framework for SLO-oriented Microservices. In Proceedings of the 14th USENIX Symposium on Operating Systems Design and Implementation (OSDI 2020). USENIX Association, Berkeley, CA, USA, 805--825."},{"key":"e_1_3_2_1_44_1","volume-title":"Proceedings of the 7th International Workshop on Serverless Computing (WoSC7)","author":"Qiu Haoran","year":"2021","unstructured":"Haoran Qiu , Saurabh Jha , Subho S. Banerjee , Archit Patke , Chen Wang , Franke Hubertus , Zbigniew T. Kalbarczyk , and Ravishankar K. Iyer . 2021. Is Function-as-a-Service a Good Fit for Latency-Critical Services? . In Proceedings of the 7th International Workshop on Serverless Computing (WoSC7) 2021 . Association for Computing Machinery, New York, NY, USA, 1--8. Haoran Qiu, Saurabh Jha, Subho S. Banerjee, Archit Patke, Chen Wang, Franke Hubertus, Zbigniew T. Kalbarczyk, and Ravishankar K. Iyer. 2021. Is Function-as-a-Service a Good Fit for Latency-Critical Services?. In Proceedings of the 7th International Workshop on Serverless Computing (WoSC7) 2021. Association for Computing Machinery, New York, NY, USA, 1--8."},{"key":"e_1_3_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/3342195.3387524"},{"key":"e_1_3_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1137\/17M1112583"},{"key":"e_1_3_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1287\/moor.2018.0957"},{"key":"e_1_3_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/357401.357402"},{"key":"e_1_3_2_1_49_1","doi-asserted-by":"crossref","unstructured":"Lucia Schuler Somaya Jamil and Niklas K\u00fchl. 2021. AI-based Resource Allocation: Reinforcement Learning for Adaptive Auto-scaling in Serverless Environments. In 2021 IEEE\/ACM 21st International Symposium on Cluster Cloud and Internet Computing (CCGrid 2021). Association for Computing Machinery New York NY USA 804--811.  Lucia Schuler Somaya Jamil and Niklas K\u00fchl. 2021. AI-based Resource Allocation: Reinforcement Learning for Adaptive Auto-scaling in Serverless Environments. In 2021 IEEE\/ACM 21st International Symposium on Cluster Cloud and Internet Computing (CCGrid 2021). Association for Computing Machinery New York NY USA 804--811.","DOI":"10.1109\/CCGrid51090.2021.00098"},{"key":"e_1_3_2_1_50_1","volume-title":"Proximal Policy Optimization Algorithms. CoRR abs\/1707.06347","author":"Schulman John","year":"2017","unstructured":"John Schulman , Filip Wolski , Prafulla Dhariwal , Alec Radford , and Oleg Klimov . 2017. Proximal Policy Optimization Algorithms. CoRR abs\/1707.06347 ( 2017 ), 12 pages. http:\/\/arxiv.org\/abs\/1707.06347 John Schulman, Filip Wolski, Prafulla Dhariwal, Alec Radford, and Oleg Klimov. 2017. Proximal Policy Optimization Algorithms. CoRR abs\/1707.06347 (2017), 12 pages. http:\/\/arxiv.org\/abs\/1707.06347"},{"key":"e_1_3_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/2465351.2465386"},{"key":"e_1_3_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/3352460.3358296"},{"key":"e_1_3_2_1_53_1","volume-title":"Proceedings of the USENIX 2020 Annual Technical Conference (ATC","author":"Shahrad Mohammad","year":"2020","unstructured":"Mohammad Shahrad , Rodrigo Fonseca , \u00cd\u00f1igo Goiri , Gohar Chaudhry , Paul Batum , Jason Cooke , Eduardo Laureano , Colby Tresness , Mark Russinovich , and Ricardo Bianchini . 2020 . Serverless in the Wild: Characterizing and Optimizing the Serverless Workload at a Large Cloud Provider . In Proceedings of the USENIX 2020 Annual Technical Conference (ATC 2020). USENIX Association, Berkeley, CA, USA, 205--218. Mohammad Shahrad, Rodrigo Fonseca, \u00cd\u00f1igo Goiri, Gohar Chaudhry, Paul Batum, Jason Cooke, Eduardo Laureano, Colby Tresness, Mark Russinovich, and Ricardo Bianchini. 2020. Serverless in the Wild: Characterizing and Optimizing the Serverless Workload at a Large Cloud Provider. In Proceedings of the USENIX 2020 Annual Technical Conference (ATC 2020). USENIX Association, Berkeley, CA, USA, 205--218."},{"key":"e_1_3_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.39.10.1953"},{"key":"e_1_3_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/3472883.3486981"},{"key":"e_1_3_2_1_56_1","volume-title":"ENSURE: Efficient Scheduling and Autonomous Resource Management in Serverless Environments. In International Conference on Autonomic Computing and Self-Organizing Systems (ACSOS","author":"Suresh Amoghavarsha","year":"2020","unstructured":"Amoghavarsha Suresh , Gagan Somashekar , Anandh Varadarajan , Veerendra Ramesh Kakarla , Hima Upadhyay , and Anshul Gandhi . 2020 . ENSURE: Efficient Scheduling and Autonomous Resource Management in Serverless Environments. In International Conference on Autonomic Computing and Self-Organizing Systems (ACSOS 2020). IEEE Computer Society, Washington, DC, USA, 1--10. Amoghavarsha Suresh, Gagan Somashekar, Anandh Varadarajan, Veerendra Ramesh Kakarla, Hima Upadhyay, and Anshul Gandhi. 2020. ENSURE: Efficient Scheduling and Autonomous Resource Management in Serverless Environments. In International Conference on Autonomic Computing and Self-Organizing Systems (ACSOS 2020). IEEE Computer Society, Washington, DC, USA, 1--10."},{"key":"e_1_3_2_1_57_1","volume-title":"Reinforcement Learning: An Introduction","author":"Sutton Richard S","year":"2018","unstructured":"Richard S Sutton and Andrew G Barto . 2018 . Reinforcement Learning: An Introduction . MIT Press, Cambridge, MA , USA. Richard S Sutton and Andrew G Barto. 2018. Reinforcement Learning: An Introduction. MIT Press, Cambridge, MA, USA."},{"key":"e_1_3_2_1_58_1","volume-title":"Cooperative Agents. In Proceedings of the 10th International Conference on Machine Learning (ICML","author":"Tan Ming","year":"1993","unstructured":"Ming Tan . 1993 . Multi-agent Reinforcement Learning: Independent vs . Cooperative Agents. In Proceedings of the 10th International Conference on Machine Learning (ICML 1993). PMLR, Cambridge, MA, USA, 8. Ming Tan. 1993. Multi-agent Reinforcement Learning: Independent vs. Cooperative Agents. In Proceedings of the 10th International Conference on Machine Learning (ICML 1993). PMLR, Cambridge, MA, USA, 8."},{"key":"e_1_3_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/3419111.3421306"},{"key":"e_1_3_2_1_60_1","volume-title":"Proceedings of the Linux Symposium. Linux Symposium","author":"Turner Paul","year":"2010","unstructured":"Paul Turner , Bharata B Rao , and Nikhil Rao . 2010 . CPU bandwidth control for CFS . In Proceedings of the Linux Symposium. Linux Symposium , Ottawa, Ontario, Canada, 245--254. Paul Turner, Bharata B Rao, and Nikhil Rao. 2010. CPU bandwidth control for CFS. In Proceedings of the Linux Symposium. Linux Symposium, Ottawa, Ontario, Canada, 245--254."},{"key":"e_1_3_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/3445814.3446714"},{"key":"e_1_3_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v30i1.10295"},{"key":"e_1_3_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/2523616.2523633"},{"key":"e_1_3_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1504\/IJBDI.2016.078400"},{"key":"e_1_3_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/2741948.2741964"},{"key":"e_1_3_2_1_66_1","volume-title":"2018 USENIX Annual Technical Conference. USENIX Association","author":"Wang Liang","year":"2018","unstructured":"Liang Wang , Mengyuan Li , Yinqian Zhang , Thomas Ristenpart , and Michael Swift . 2018 . Peeking behind the Curtains of Serverless Platforms . In 2018 USENIX Annual Technical Conference. USENIX Association , Berkeley, CA, USA, 133--146. Liang Wang, Mengyuan Li, Yinqian Zhang, Thomas Ristenpart, and Michael Swift. 2018. Peeking behind the Curtains of Serverless Platforms. In 2018 USENIX Annual Technical Conference. USENIX Association, Berkeley, CA, USA, 133--146."},{"key":"e_1_3_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1145\/3503222.3507704"},{"key":"e_1_3_2_1_68_1","volume-title":"StepConf: SLO-aware Dynamic Resource Configuration for Serverless Function Workflows. In IEEE Conference on Computer Communications (INFOCOM","author":"Wen Zhaojie","year":"2022","unstructured":"Zhaojie Wen , Yishuo Wang , and Fangming Liu . 2022 . StepConf: SLO-aware Dynamic Resource Configuration for Serverless Function Workflows. In IEEE Conference on Computer Communications (INFOCOM 2022). IEEE Computer Society, Washington, DC, USA, 1--10. Zhaojie Wen, Yishuo Wang, and Fangming Liu. 2022. StepConf: SLO-aware Dynamic Resource Configuration for Serverless Function Workflows. In IEEE Conference on Computer Communications (INFOCOM 2022). IEEE Computer Society, Washington, DC, USA, 1--10."},{"key":"e_1_3_2_1_69_1","volume-title":"Proceedings of the 38th International Conference on Machine Learning (ICML","author":"Xie Annie","year":"2021","unstructured":"Annie Xie , James Harrison , and Chelsea Finn . 2021 . Deep Reinforcement Learning amidst Lifelong Non-stationarity . In Proceedings of the 38th International Conference on Machine Learning (ICML 2021). PMLR, Cambridge, MA, 1--11. Annie Xie, James Harrison, and Chelsea Finn. 2021. Deep Reinforcement Learning amidst Lifelong Non-stationarity. In Proceedings of the 38th International Conference on Machine Learning (ICML 2021). PMLR, Cambridge, MA, 1--11."},{"key":"e_1_3_2_1_70_1","volume-title":"Proceedings of the 35th International Conference on Machine Learning (ICML","author":"Yang Yaodong","year":"2018","unstructured":"Yaodong Yang , Rui Luo , Minne Li , Ming Zhou , Weinan Zhang , and Jun Wang . 2018 . Mean Field Multi-agent Reinforcement Learning . In Proceedings of the 35th International Conference on Machine Learning (ICML 2018). PMLR, Cambridge, MA, USA, 5571--5580. Yaodong Yang, Rui Luo, Minne Li, Ming Zhou, Weinan Zhang, and Jun Wang. 2018. Mean Field Multi-agent Reinforcement Learning. In Proceedings of the 35th International Conference on Machine Learning (ICML 2018). PMLR, Cambridge, MA, USA, 5571--5580."},{"key":"e_1_3_2_1_71_1","volume-title":"High-throughput Inference. In Proceedings of the 27th ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS","author":"Yang Yanan","year":"2022","unstructured":"Yanan Yang , Laiping Zhao , Yiming Li , Huanyu Zhang , Jie Li , Mingyang Zhao , Xingzhen Chen , and Keqiu Li . 2022 . INFless: A Native Serverless System for Low-latency , High-throughput Inference. In Proceedings of the 27th ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS 2022). Association for Computing Machinery, New York, NY, USA, 768--781. Yanan Yang, Laiping Zhao, Yiming Li, Huanyu Zhang, Jie Li, Mingyang Zhao, Xingzhen Chen, and Keqiu Li. 2022. INFless: A Native Serverless System for Low-latency, High-throughput Inference. In Proceedings of the 27th ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS 2022). Association for Computing Machinery, New York, NY, USA, 768--781."},{"key":"e_1_3_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDCS.2019.00021"},{"key":"e_1_3_2_1_73_1","volume-title":"Proceedings of the 26th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS","author":"Yanqi Zhang","year":"2021","unstructured":"Zhang Yanqi , Hua Weizhe , Zhou Zhuangzhuang , Suh G. Edward , and Delimitrou Christina . 2021 . Sinan: ML-based & QoS-aware Resource Management for Cloud Microservices . In Proceedings of the 26th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS 2021). Association for Computing Machinery, New York, NY, USA, 167--181. Zhang Yanqi, Hua Weizhe, Zhou Zhuangzhuang, Suh G. Edward, and Delimitrou Christina. 2021. Sinan: ML-based & QoS-aware Resource Management for Cloud Microservices. In Proceedings of the 26th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS 2021). Association for Computing Machinery, New York, NY, USA, 167--181."},{"key":"e_1_3_2_1_74_1","unstructured":"Chao Yu Akash Velu Eugene Vinitsky Yu Wang Alexandre Bayen and Yi Wu. 2021. The Surprising Effectiveness of PPO in Cooperative Multi-agent Games. https:\/\/arxiv.org\/abs\/2103.01955  Chao Yu Akash Velu Eugene Vinitsky Yu Wang Alexandre Bayen and Yi Wu. 2021. The Surprising Effectiveness of PPO in Cooperative Multi-agent Games. https:\/\/arxiv.org\/abs\/2103.01955"},{"key":"e_1_3_2_1_75_1","volume-title":"Proceedings of the 2nd IEEE International Conference on Autonomic Computing and Self-Organizing Systems (ACSOS","author":"Yu Hanfei","year":"2021","unstructured":"Hanfei Yu , Athirai A. Irissappane , Hao Wang , and Wes J. Lloyd . 2021. FaaSRank: Learning to Schedule Functions in Serverless Platforms . In Proceedings of the 2nd IEEE International Conference on Autonomic Computing and Self-Organizing Systems (ACSOS 2021 ). IEEE Computer Society, Washington, DC, USA, 31--40. Hanfei Yu, Athirai A. Irissappane, Hao Wang, and Wes J. Lloyd. 2021. FaaSRank: Learning to Schedule Functions in Serverless Platforms. In Proceedings of the 2nd IEEE International Conference on Autonomic Computing and Self-Organizing Systems (ACSOS 2021). IEEE Computer Society, Washington, DC, USA, 31--40."},{"key":"e_1_3_2_1_76_1","unstructured":"Tianyi Yu Qingyuan Liu Dong Du Yubin Xia Binyu Zang Ziqian Lu Pingchao Yang Chenggang Qin and Haibo Chen. 2020. Serverless-Bench (SoCC 2020). https:\/\/github.com\/SJTU-IPADS\/ServerlessBench.  Tianyi Yu Qingyuan Liu Dong Du Yubin Xia Binyu Zang Ziqian Lu Pingchao Yang Chenggang Qin and Haibo Chen. 2020. Serverless-Bench (SoCC 2020). https:\/\/github.com\/SJTU-IPADS\/ServerlessBench."},{"key":"e_1_3_2_1_77_1","volume-title":"Reinforcement Learning-assisted Autoscaling Mechanisms for Serverless Computing Platforms. Simulation Modelling Practice and Theory 116","author":"Zafeiropoulos Anastasios","year":"2022","unstructured":"Anastasios Zafeiropoulos , Eleni Fotopoulou , Nikos Filinis , and Symeon Papavassiliou . 2022. Reinforcement Learning-assisted Autoscaling Mechanisms for Serverless Computing Platforms. Simulation Modelling Practice and Theory 116 ( 2022 ), 17 pages. Anastasios Zafeiropoulos, Eleni Fotopoulou, Nikos Filinis, and Symeon Papavassiliou. 2022. Reinforcement Learning-assisted Autoscaling Mechanisms for Serverless Computing Platforms. Simulation Modelling Practice and Theory 116 (2022), 17 pages."},{"key":"e_1_3_2_1_78_1","doi-asserted-by":"publisher","DOI":"10.1631\/FITEE.1900661"},{"key":"e_1_3_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-60990-0_12"},{"key":"e_1_3_2_1_80_1","volume-title":"Proceedings of the 4th International Conference on Simulation of Adaptive Behavior. Citeseer","author":"Zhao Jieyu","year":"1996","unstructured":"Jieyu Zhao and Jurgen Schmidhuber . 1996 . Incremental Self-improvement for Life-time Multi-agent Reinforcement Learning . In Proceedings of the 4th International Conference on Simulation of Adaptive Behavior. Citeseer , Cambridge, MA, USA, 516--525. Jieyu Zhao and Jurgen Schmidhuber. 1996. Incremental Self-improvement for Life-time Multi-agent Reinforcement Learning. In Proceedings of the 4th International Conference on Simulation of Adaptive Behavior. Citeseer, Cambridge, MA, USA, 516--525."},{"key":"e_1_3_2_1_81_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v32i1.11371"}],"event":{"name":"SoCC '22: ACM Symposium on Cloud Computing","location":"San Francisco California","acronym":"SoCC '22","sponsor":["SIGMOD ACM Special Interest Group on Management of Data","SIGOPS ACM Special Interest Group on Operating Systems"]},"container-title":["Proceedings of the 13th Symposium on Cloud Computing"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3542929.3563475","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3542929.3563475","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:49:31Z","timestamp":1750182571000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3542929.3563475"}},"subtitle":["a scalable and incremental online learning framework for serverless resource management"],"short-title":[],"issued":{"date-parts":[[2022,11,7]]},"references-count":81,"alternative-id":["10.1145\/3542929.3563475","10.1145\/3542929"],"URL":"https:\/\/doi.org\/10.1145\/3542929.3563475","relation":{},"subject":[],"published":{"date-parts":[[2022,11,7]]},"assertion":[{"value":"2022-11-07","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}