{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,5]],"date-time":"2026-03-05T16:07:55Z","timestamp":1772726875694,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":37,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,4,5]],"date-time":"2022-04-05T00:00:00Z","timestamp":1649116800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"IIDAI"},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["CCF 20-29049"],"award-info":[{"award-number":["CCF 20-29049"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,4,5]]},"DOI":"10.1145\/3517207.3526971","type":"proceedings-article","created":{"date-parts":[[2022,3,29]],"date-time":"2022-03-29T22:09:26Z","timestamp":1648591766000},"page":"20-28","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":21,"title":["Reinforcement learning for resource management in multi-tenant serverless platforms"],"prefix":"10.1145","author":[{"given":"Haoran","family":"Qiu","sequence":"first","affiliation":[{"name":"University of Illinois"}]},{"given":"Weichao","family":"Mao","sequence":"additional","affiliation":[{"name":"University of Illinois"}]},{"given":"Archit","family":"Patke","sequence":"additional","affiliation":[{"name":"University of Illinois"}]},{"given":"Chen","family":"Wang","sequence":"additional","affiliation":[{"name":"IBM Research"}]},{"given":"Hubertus","family":"Franke","sequence":"additional","affiliation":[{"name":"IBM Research"}]},{"given":"Zbigniew T.","family":"Kalbarczyk","sequence":"additional","affiliation":[{"name":"University of Illinois"}]},{"given":"Tamer","family":"Ba\u015far","sequence":"additional","affiliation":[{"name":"University of Illinois"}]},{"given":"Ravishankar K.","family":"Iyer","sequence":"additional","affiliation":[{"name":"University of Illinois"}]}],"member":"320","published-online":{"date-parts":[[2022,4,5]]},"reference":[{"key":"e_1_3_2_1_1_1","unstructured":"Amazon. 2022. AWS Lambda concurrency limit. https:\/\/docs.aws.amazon.com\/lambda\/latest\/dg\/invocation-scaling.html. Accessed: 2022-01-10.  Amazon. 2022. AWS Lambda concurrency limit. https:\/\/docs.aws.amazon.com\/lambda\/latest\/dg\/invocation-scaling.html. Accessed: 2022-01-10."},{"key":"e_1_3_2_1_2_1","volume-title":"Miles Brundage, and Anil Anthony Bharath.","author":"Arulkumaran Kai","year":"2017","unstructured":"Kai Arulkumaran , Marc Peter Deisenroth , Miles Brundage, and Anil Anthony Bharath. 2017 . A brief survey of deep reinforcement learning. arXiv preprint arXiv:1708.05866 (2017). Kai Arulkumaran, Marc Peter Deisenroth, Miles Brundage, and Anil Anthony Bharath. 2017. A brief survey of deep reinforcement learning. arXiv preprint arXiv:1708.05866 (2017)."},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"crossref","unstructured":"Ioana Baldini Paul Castro Kerry Chang Perry Cheng Stephen Fink Vatche Ishakian Nick Mitchell Vinod Muthusamy Rodric Rabbah Aleksander Slominski etal 2017. Serverless computing: Current trends and open problems. In Research Advances in Cloud Computing. Springer 1--20.  Ioana Baldini Paul Castro Kerry Chang Perry Cheng Stephen Fink Vatche Ishakian Nick Mitchell Vinod Muthusamy Rodric Rabbah Aleksander Slominski et al. 2017. Serverless computing: Current trends and open problems. In Research Advances in Cloud Computing. Springer 1--20.","DOI":"10.1007\/978-981-10-5026-8_1"},{"key":"e_1_3_2_1_4_1","volume-title":"Proceedings of the 37th International Conference on Machine Learning (Proceedings of Machine Learning Research","volume":"641","author":"Banerjee Subho","year":"2020","unstructured":"Subho Banerjee , Saurabh Jha , Zbigniew Kalbarczyk , and Ravishankar Iyer . 2020 . Inductive-bias-driven Reinforcement Learning For Efficient Schedules in Heterogeneous Clusters . In Proceedings of the 37th International Conference on Machine Learning (Proceedings of Machine Learning Research , Vol. 119). PMLR, 629-- 641 . https:\/\/proceedings.mlr.press\/v119\/banerjee20a.html Subho Banerjee, Saurabh Jha, Zbigniew Kalbarczyk, and Ravishankar Iyer. 2020. Inductive-bias-driven Reinforcement Learning For Efficient Schedules in Heterogeneous Clusters. In Proceedings of the 37th International Conference on Machine Learning (Proceedings of Machine Learning Research, Vol. 119). PMLR, 629--641. https:\/\/proceedings.mlr.press\/v119\/banerjee20a.html"},{"key":"e_1_3_2_1_5_1","volume-title":"Proceedings of the Fifteenth National Conference on Artificial Intelligence and Tenth Innovative Applications of Artificial Intelligence Conference (AAAI\/IAAI) 1998","author":"Claus Caroline","year":"1998","unstructured":"Caroline Claus and Craig Boutilier . 1998 . The dynamics of reinforcement learning in cooperative multiagent systems . Proceedings of the Fifteenth National Conference on Artificial Intelligence and Tenth Innovative Applications of Artificial Intelligence Conference (AAAI\/IAAI) 1998 , 746--752 (1998), 2. Caroline Claus and Craig Boutilier. 1998. The dynamics of reinforcement learning in cooperative multiagent systems. Proceedings of the Fifteenth National Conference on Artificial Intelligence and Tenth Innovative Applications of Artificial Intelligence Conference (AAAI\/IAAI) 1998, 746--752 (1998), 2."},{"key":"e_1_3_2_1_6_1","volume-title":"Mingfei Sun, and Shimon Whiteson.","author":"de Witt Christian Schroeder","year":"2020","unstructured":"Christian Schroeder de Witt , Tarun Gupta , Denys Makoviichuk , Viktor Makoviychuk , Philip HS Torr , Mingfei Sun, and Shimon Whiteson. 2020 . Is Independent Learning All You Need in the StarCraft Multi-Agent Challenge ? arXiv preprint arXiv:2011.09533 (2020). Christian Schroeder de Witt, Tarun Gupta, Denys Makoviichuk, Viktor Makoviychuk, Philip HS Torr, Mingfei Sun, and Shimon Whiteson. 2020. Is Independent Learning All You Need in the StarCraft Multi-Agent Challenge? arXiv preprint arXiv:2011.09533 (2020)."},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/2644865.2541941"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.engappai.2021.104288"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3429880.3430099"},{"key":"e_1_3_2_1_10_1","unstructured":"Github. 2022. Apache OpenWhisk. https:\/\/github.com\/apache\/openwhisk. Accessed: 2022-01-10.  Github. 2022. Apache OpenWhisk. https:\/\/github.com\/apache\/openwhisk. Accessed: 2022-01-10."},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPDS.2020.3025914"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3005745.3005750"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/FOCS.2008.36"},{"key":"e_1_3_2_1_14_1","unstructured":"OpenAI. 2022. OpenAI Baselines: Proximal Policy Optimization. https:\/\/openai.com\/blog\/openai-baselines-ppo\/. Accessed: 2022-01-10.  OpenAI. 2022. OpenAI Baselines: Proximal Policy Optimization. https:\/\/openai.com\/blog\/openai-baselines-ppo\/. Accessed: 2022-01-10."},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3485983.3494866"},{"key":"e_1_3_2_1_16_1","volume-title":"Proceedings of the 14th USENIX Symposium on Operating Systems Design and Implementation (OSDI","author":"Qiu Haoran","year":"2020","unstructured":"Haoran Qiu , Subho S. Banerjee , Saurabh Jha , Zbigniew T. Kalbarczyk , and Ravishankar K. Iyer . 2020. FIRM: An intelligent fine-grained resource management framework for SLO-oriented microservices . In Proceedings of the 14th USENIX Symposium on Operating Systems Design and Implementation (OSDI 2020 ). 805--825. Haoran Qiu, Subho S. Banerjee, Saurabh Jha, Zbigniew T. Kalbarczyk, and Ravishankar K. Iyer. 2020. FIRM: An intelligent fine-grained resource management framework for SLO-oriented microservices. In Proceedings of the 14th USENIX Symposium on Operating Systems Design and Implementation (OSDI 2020). 805--825."},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3493651.3493666"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3342195.3387524"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/CCGrid51090.2021.00098"},{"key":"e_1_3_2_1_20_1","volume-title":"Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347","author":"Schulman John","year":"2017","unstructured":"John Schulman , Filip Wolski , Prafulla Dhariwal , Alec Radford , and Oleg Klimov . 2017. Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347 ( 2017 ). John Schulman, Filip Wolski, Prafulla Dhariwal, Alec Radford, and Oleg Klimov. 2017. Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347 (2017)."},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3352460.3358296"},{"key":"e_1_3_2_1_22_1","volume-title":"2020 USENIX Annual Technical Conference. 205--218","author":"Shahrad Mohammad","year":"2020","unstructured":"Mohammad Shahrad , Rodrigo Fonseca , \u00cd\u00f1igo Goiri , Gohar Chaudhry , Paul Batum , Jason Cooke , Eduardo Laureano , Colby Tresness , Mark Russinovich , and Ricardo Bianchini . 2020 . Serverless in the wild: Characterizing and optimizing the serverless workload at a large cloud provider . In 2020 USENIX Annual Technical Conference. 205--218 . Mohammad Shahrad, Rodrigo Fonseca, \u00cd\u00f1igo Goiri, Gohar Chaudhry, Paul Batum, Jason Cooke, Eduardo Laureano, Colby Tresness, Mark Russinovich, and Ricardo Bianchini. 2020. Serverless in the wild: Characterizing and optimizing the serverless workload at a large cloud provider. In 2020 USENIX Annual Technical Conference. 205--218."},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.39.10.1953"},{"key":"e_1_3_2_1_24_1","volume-title":"ENSURE: Efficient Scheduling and Autonomous Resource Management in Serverless Environments. In International Conference on Autonomic Computing and Self-Organizing Systems (ACSOS","author":"Suresh Amoghavarsha","year":"2020","unstructured":"Amoghavarsha Suresh , Gagan Somashekar , Anandh Varadarajan , Veerendra Ramesh Kakarla , Hima Upadhyay , and Anshul Gandhi . 2020 . ENSURE: Efficient Scheduling and Autonomous Resource Management in Serverless Environments. In International Conference on Autonomic Computing and Self-Organizing Systems (ACSOS 2020). 1--10. Amoghavarsha Suresh, Gagan Somashekar, Anandh Varadarajan, Veerendra Ramesh Kakarla, Hima Upadhyay, and Anshul Gandhi. 2020. ENSURE: Efficient Scheduling and Autonomous Resource Management in Serverless Environments. In International Conference on Autonomic Computing and Self-Organizing Systems (ACSOS 2020). 1--10."},{"key":"e_1_3_2_1_25_1","volume-title":"Reinforcement learning: An introduction","author":"Sutton Richard S","unstructured":"Richard S Sutton and Andrew G Barto . 2018. Reinforcement learning: An introduction . MIT Press . Richard S Sutton and Andrew G Barto. 2018. Reinforcement learning: An introduction. MIT Press."},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3445814.3446714"},{"key":"e_1_3_2_1_27_1","volume-title":"2018 USENIX Annual Technical Conference. 133--146","author":"Wang Liang","year":"2018","unstructured":"Liang Wang , Mengyuan Li , Yinqian Zhang , Thomas Ristenpart , and Michael Swift . 2018 . Peeking behind the curtains of serverless platforms . In 2018 USENIX Annual Technical Conference. 133--146 . Liang Wang, Mengyuan Li, Yinqian Zhang, Thomas Ristenpart, and Michael Swift. 2018. Peeking behind the curtains of serverless platforms. In 2018 USENIX Annual Technical Conference. 133--146."},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1080\/09540099108946587"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDCS.2019.00021"},{"key":"e_1_3_2_1_30_1","volume-title":"Proceedings of the Twenty-Sixth International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS","author":"Yanqi Zhang","year":"2021","unstructured":"Zhang Yanqi , Hua Weizhe , Zhou Zhuangzhuang , Suh G. Edward , and Delimitrou Christina . 2021 . Sinan: ML-Based & QoS-Aware Resource Management for Cloud Microservices . In Proceedings of the Twenty-Sixth International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS 2021). Zhang Yanqi, Hua Weizhe, Zhou Zhuangzhuang, Suh G. Edward, and Delimitrou Christina. 2021. Sinan: ML-Based & QoS-Aware Resource Management for Cloud Microservices. In Proceedings of the Twenty-Sixth International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS 2021)."},{"key":"e_1_3_2_1_31_1","volume-title":"Multi-Agent Games. arXiv preprint arXiv:2103.01955","author":"Yu Chao","year":"2021","unstructured":"Chao Yu , Akash Velu , Eugene Vinitsky , Yu Wang , Alexandre Bayen , and Yi Wu. 2021. The Surprising Effectiveness of PPO in Cooperative , Multi-Agent Games. arXiv preprint arXiv:2103.01955 ( 2021 ). Chao Yu, Akash Velu, Eugene Vinitsky, Yu Wang, Alexandre Bayen, and Yi Wu. 2021. The Surprising Effectiveness of PPO in Cooperative, Multi-Agent Games. arXiv preprint arXiv:2103.01955 (2021)."},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACSOS52086.2021.00023"},{"key":"e_1_3_2_1_33_1","unstructured":"Tianyi Yu Qingyuan Liu Dong Du Yubin Xia Binyu Zang Ziqian Lu Pingchao Yang Chenggang Qin and Haibo Chen. 2020. Serverless-Bench (SoCC 2020). https:\/\/github.com\/SJTU-IPADS\/ServerlessBench.  Tianyi Yu Qingyuan Liu Dong Du Yubin Xia Binyu Zang Ziqian Lu Pingchao Yang Chenggang Qin and Haibo Chen. 2020. Serverless-Bench (SoCC 2020). https:\/\/github.com\/SJTU-IPADS\/ServerlessBench."},{"key":"e_1_3_2_1_34_1","volume-title":"Reinforcement learning-assisted autoscaling mechanisms for serverless computing platforms. Simulation Modelling Practice and Theory","author":"Zafeiropoulos Anastasios","year":"2022","unstructured":"Anastasios Zafeiropoulos , Eleni Fotopoulou , Nikos Filinis , and Symeon Papavassiliou . 2022. Reinforcement learning-assisted autoscaling mechanisms for serverless computing platforms. Simulation Modelling Practice and Theory ( 2022 ), 102461. Anastasios Zafeiropoulos, Eleni Fotopoulou, Nikos Filinis, and Symeon Papavassiliou. 2022. Reinforcement learning-assisted autoscaling mechanisms for serverless computing platforms. Simulation Modelling Practice and Theory (2022), 102461."},{"key":"e_1_3_2_1_35_1","volume-title":"SLO-Aware Machine Learning Inference Serving. In 2019 USENIX Annual Technical Conference (ATC","author":"Zhang Chengliang","year":"2019","unstructured":"Chengliang Zhang , Minchen Yu , Wei Wang , and Feng Yan . 2019 . MArk: Exploiting Cloud Services for Cost-Effective , SLO-Aware Machine Learning Inference Serving. In 2019 USENIX Annual Technical Conference (ATC 2019). 1049--1062. Chengliang Zhang, Minchen Yu, Wei Wang, and Feng Yan. 2019. MArk: Exploiting Cloud Services for Cost-Effective, SLO-Aware Machine Learning Inference Serving. In 2019 USENIX Annual Technical Conference (ATC 2019). 1049--1062."},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1631\/FITEE.1900661"},{"key":"e_1_3_2_1_37_1","volume-title":"Multi-agent reinforcement learning: A selective overview of theories and algorithms. Handbook of Reinforcement Learning and Control","author":"Zhang Kaiqing","year":"2021","unstructured":"Kaiqing Zhang , Zhuoran Yang , and Tamer Ba\u015far . 2021. Multi-agent reinforcement learning: A selective overview of theories and algorithms. Handbook of Reinforcement Learning and Control ( 2021 ), 321--384. Kaiqing Zhang, Zhuoran Yang, and Tamer Ba\u015far. 2021. Multi-agent reinforcement learning: A selective overview of theories and algorithms. Handbook of Reinforcement Learning and Control (2021), 321--384."}],"event":{"name":"EuroSys '22: Seventeenth European Conference on Computer Systems","location":"Rennes France","acronym":"EuroSys '22","sponsor":["SIGOPS ACM Special Interest Group on Operating Systems"]},"container-title":["Proceedings of the 2nd European Workshop on Machine Learning and Systems"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3517207.3526971","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3517207.3526971","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3517207.3526971","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:31:29Z","timestamp":1750188689000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3517207.3526971"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,4,5]]},"references-count":37,"alternative-id":["10.1145\/3517207.3526971","10.1145\/3517207"],"URL":"https:\/\/doi.org\/10.1145\/3517207.3526971","relation":{},"subject":[],"published":{"date-parts":[[2022,4,5]]},"assertion":[{"value":"2022-04-05","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}