{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,16]],"date-time":"2026-04-16T17:40:07Z","timestamp":1776361207462,"version":"3.51.2"},"reference-count":51,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2020,4,17]],"date-time":"2020-04-17T00:00:00Z","timestamp":1587081600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"China Scholarship Council and the Australia Research Council Discovery Project"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Internet Technol."],"published-print":{"date-parts":[[2020,5,31]]},"abstract":"<jats:p>Containers, as a lightweight application virtualization technology, have recently gained immense popularity in mainstream cluster management systems like Google Borg and Kubernetes. Prevalently adopted by these systems for task deployments of diverse workloads such as big data, web services, and IoT, they support agile application deployment, environmental consistency, OS distribution portability, application-centric management, and resource isolation. Although most of these systems are mature with advanced features, their optimization strategies are still tailored to the assumption of a static cluster. Elastic compute resources would enable heterogeneous resource management strategies in response to the dynamic business volume for various types of workloads. Hence, we propose a heterogeneous task allocation strategy for cost-efficient container orchestration through resource utilization optimization and elastic instance pricing with three main features. The first one is to support heterogeneous job configurations to optimize the initial placement of containers into existing resources by task packing. The second one is cluster size adjustment to meet the changing workload through autoscaling algorithms. The third one is a rescheduling mechanism to shut down underutilized VM instances for cost saving and reallocate the relevant jobs without losing task progress. We evaluate our approach in terms of cost and performance on the Australian National Cloud Infrastructure (Nectar). Our experiments demonstrate that the proposed strategy could reduce the overall cost by 23% to 32% for different types of cloud workload patterns when compared to the default Kubernetes framework.<\/jats:p>","DOI":"10.1145\/3378447","type":"journal-article","created":{"date-parts":[[2020,5,4]],"date-time":"2020-05-04T06:51:22Z","timestamp":1588575082000},"page":"1-24","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":114,"title":["A Cost-Efficient Container Orchestration Strategy in Kubernetes-Based Cloud Computing Infrastructures with Heterogeneous Resources"],"prefix":"10.1145","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6361-696X","authenticated-orcid":false,"given":"Zhiheng","family":"Zhong","sequence":"first","affiliation":[{"name":"University of Melbourne, Melbourne, Victoria, Australia"}]},{"given":"Rajkumar","family":"Buyya","sequence":"additional","affiliation":[{"name":"University of Melbourne, Melbourne, Victoria, Australia"}]}],"member":"320","published-online":{"date-parts":[[2020,4,17]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"R. Mocevicius. 2015. CoreOS Essentials. Packt Publishing Ltd.  R. Mocevicius. 2015. CoreOS Essentials. Packt Publishing Ltd."},{"key":"e_1_2_1_2_1","volume-title":"Proceedings of the 10th European Conference on Computer Systems. 18","author":"Verma A."},{"key":"e_1_2_1_3_1","volume-title":"Kubernetes: Up and Running: Dive into the Future of Infrastructure","author":"Hightower K.","year":"2017"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1002\/spe.2660"},{"key":"e_1_2_1_5_1","series-title":"Lecture Notes in Computer Science","volume-title":"Performance Tools and Applications to Networked Systems","author":"Karatza H. D."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/2925990"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCC.2014.51"},{"key":"e_1_2_1_8_1","volume-title":"Proceedings of the 9th IEEE\/ACM International Conference on Utility and Cloud Computing (UCC\u201916)","author":"Medel V."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/SysEng.2016.7753148"},{"key":"e_1_2_1_10_1","volume-title":"Proceedings of the 8th USENIX Conference on Networked Systems Design and Implementation. 295--308","author":"Hindman B."},{"key":"e_1_2_1_11_1","volume-title":"Retrieved","year":"2019"},{"key":"e_1_2_1_12_1","volume-title":"Proceedings of the 9th IEEE International Conference on Cloud Computing (CLOUD\u201916)","author":"DelValle R."},{"key":"e_1_2_1_13_1","volume-title":"Proceedings of the ACM International Symposium on Quality of Service (IWQoS\u201919)","author":"Guo J."},{"key":"e_1_2_1_14_1","volume-title":"Proceedings of the 9th IEEE International Conference on Cloud Computing (CLOUD\u201916)","author":"Zhang H."},{"key":"e_1_2_1_15_1","volume-title":"Proceedings of the 9th International Conference on Knowledge and Smart Technology (KST\u201917)","author":"Kaewkasi C."},{"key":"e_1_2_1_16_1","volume-title":"Proceedings of the ACM Symposium on Cloud Computing (SoCC\u201918)","author":"Liu Q."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10723-017-9419-x"},{"key":"e_1_2_1_18_1","doi-asserted-by":"crossref","unstructured":"S. Kehrer and W. Blochinger. 2018. TOSCA-based container orchestration on Mesos. Computer Science\u2014Research and Development 33 3--4 (2018) 305--316.  S. Kehrer and W. Blochinger. 2018. TOSCA-based container orchestration on Mesos. Computer Science\u2014Research and Development 33 3--4 (2018) 305--316.","DOI":"10.1007\/s00450-017-0385-0"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSUSC.2018.2808493"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1093\/comjnl\/bxy043"},{"key":"e_1_2_1_21_1","volume-title":"Proceedings of the ACM Symposium on Cloud Computing. 121--134","author":"Chung A."},{"key":"e_1_2_1_22_1","unstructured":"M. A. Rodriguez and R. Buyya. 2018. Containers orchestration with cost-efficient autoscaling in cloud computing environments. arXiv:1812.00300.  M. A. Rodriguez and R. Buyya. 2018. Containers orchestration with cost-efficient autoscaling in cloud computing environments. arXiv:1812.00300."},{"key":"e_1_2_1_23_1","volume-title":"Proceedings of the 2018 IEEE International Conference on Services Computing. 33--40","author":"Jha D. N."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSUSC.2017.2702164"},{"key":"e_1_2_1_25_1","volume-title":"Proceedings of the 2011 International Conference for High Performance Computing, Networking, Storage, and Analysis (SC\u201911)","author":"Mao M."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0377-2217(02)00247-3"},{"key":"e_1_2_1_27_1","unstructured":"Nectar. Home Page. Retrieved March 22 2020 from https:\/\/nectar.org.au\/.  Nectar. Home Page. Retrieved March 22 2020 from https:\/\/nectar.org.au\/."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/1773912.1773922"},{"key":"e_1_2_1_29_1","volume-title":"High Performance Computing. Lecture Notes in Computer Science","volume":"9945","author":"Pickartz S."},{"key":"e_1_2_1_30_1","volume-title":"Nginx HTTP Server: Adopt Nginx for Your Web Applications to Make the Most of Your Infrastructure and Serve Pages Faster Than Ever"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3239565"},{"key":"e_1_2_1_32_1","volume-title":"Proceedings of 2010 International Conference on Network and Service Management. 9--16","author":"Gong Z."},{"key":"e_1_2_1_33_1","volume-title":"Proceedings of the 2012 IEEE Network Operations and Management Symposium. 1287--1294","author":"Yan X."},{"key":"e_1_2_1_34_1","volume-title":"Proceedings of the 9th IEEE\/ACM International Conference on Utility and Cloud Computing (UCC\u201916)","author":"Medel V."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1002\/spe.2729"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10723-017-9415-1"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2019.01.003"},{"key":"e_1_2_1_38_1","volume-title":"Proceedings of the 3rd ACM Symposium on Cloud Computing. 7.","author":"Reiss C."},{"key":"e_1_2_1_39_1","volume-title":"Proceedings of the 2nd ACM Symposium on Cloud Computing. 3.","author":"Sharma B."},{"key":"e_1_2_1_40_1","volume-title":"Proceedings of the 3rd IEEE International Conference on Future Internet of Things and Cloud. 379--386","author":"Pahl C."},{"key":"e_1_2_1_41_1","volume-title":"Proceedings of the 8th USENIX Workshop on Hot Topics in Cloud Computing (HotCloud\u201916)","author":"Burns B.","year":"2016"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/1084805.1084814"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2019.05.031"},{"key":"e_1_2_1_44_1","volume-title":"Proceedings of the 17th IEEE International Conference on Computational Science and Engineering. 257--264","author":"Xu X."},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/TII.2018.2851241"},{"key":"e_1_2_1_46_1","volume-title":"Proceedings of the 3rd IEEE International Conference on Advances in Computing, Communications, and informatics (ICACCI\u201914)","author":"Buyya R."},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1109\/CCGrid.2015.73"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.14778\/2733004.2733012"},{"key":"e_1_2_1_49_1","volume-title":"Retrieved","author":"Qi L.","year":"2019"},{"key":"e_1_2_1_50_1","volume-title":"Proceedings of the 6th ACM Symposium on Cloud Computing. 97--110","author":"Delimitrou C."},{"key":"e_1_2_1_51_1","volume-title":"Proceedings of the 8th ACM Symposium on Cloud Computing. 493--505","author":"Shastri S."}],"container-title":["ACM Transactions on Internet Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3378447","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3378447","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:45:04Z","timestamp":1750203904000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3378447"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,4,17]]},"references-count":51,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2020,5,31]]}},"alternative-id":["10.1145\/3378447"],"URL":"https:\/\/doi.org\/10.1145\/3378447","relation":{},"ISSN":["1533-5399","1557-6051"],"issn-type":[{"value":"1533-5399","type":"print"},{"value":"1557-6051","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,4,17]]},"assertion":[{"value":"2019-08-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-01-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-04-17","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}