{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,22]],"date-time":"2025-08-22T22:10:11Z","timestamp":1755900611607,"version":"3.44.0"},"reference-count":66,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2025,5,27]],"date-time":"2025-05-27T00:00:00Z","timestamp":1748304000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Major Key Project of PCL","award":["PCL2024A06,PCL2022A05"],"award-info":[{"award-number":["PCL2024A06,PCL2022A05"]}]},{"name":"Shenzhen Science and Technology Program","award":["RCJC20231211085918010"],"award-info":[{"award-number":["RCJC20231211085918010"]}]},{"name":"National Key Research and Development (R\\&D) Plan","award":["2022YFB4500004"],"award-info":[{"award-number":["2022YFB4500004"]}]},{"DOI":"10.13039\/501100021171","name":"Guangdong Basic and Applied Basic Research Foundation","doi-asserted-by":"crossref","award":["2023B1515020120"],"award-info":[{"award-number":["2023B1515020120"]}],"id":[{"id":"10.13039\/501100021171","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Meas. Anal. Comput. Syst."],"published-print":{"date-parts":[[2025,5,27]]},"abstract":"<jats:p>Microservice applications typically employ a technique known as connection subsetting to ensure resource-efficient and stable communication. In this technique, upstream containers selectively route requests to a limited subset of downstream counterparts via persistent connections. However, the interdependency in microservice applications and complex runtime environments pose significant challenges for effective connection subsetting, rendering traditional strategies notably inefficient.<\/jats:p>\n          <jats:p>In this paper, we present Microns, a connection subsetting framework designed for microservices in shared clusters. At the application level, Microns effectively handles the complex call dependencies in applications and meticulously determines the number of connections maintained by each pair of dependent microservices. At the microservice level, Microns manages the connection relationships between dependent containers according to their respective contributions on end-to-end latency. Experiments across microservice benchmarks and large-scale simulations demonstrate that Microns achieves a significant reduction on end-to-end latency by over 74.4% compared with the state-of-the-art strategies.<\/jats:p>","DOI":"10.1145\/3727118","type":"journal-article","created":{"date-parts":[[2025,6,4]],"date-time":"2025-06-04T09:43:35Z","timestamp":1749030215000},"page":"1-26","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Microns: Connection Subsetting for Microservices in Shared Clusters"],"prefix":"10.1145","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0009-0009-1076-7284","authenticated-orcid":false,"given":"Jianxiong","family":"Liao","sequence":"first","affiliation":[{"name":"Sun Yat-sen University, Guangzhou, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-5858-3456","authenticated-orcid":false,"given":"Juntao","family":"Li","sequence":"additional","affiliation":[{"name":"Sun Yat-sen University, Guangzhou, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0307-266X","authenticated-orcid":false,"given":"Zhi","family":"Zhou","sequence":"additional","affiliation":[{"name":"Sun Yat-sen University, Guangzhou, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1590-5323","authenticated-orcid":false,"given":"Fei","family":"Xu","sequence":"additional","affiliation":[{"name":"East China Normal University, Shanghai, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8570-1345","authenticated-orcid":false,"given":"Fangming","family":"Liu","sequence":"additional","affiliation":[{"name":"Peng Cheng Laboratory, Shenzhen, China and Huazhong University of Science and Technology, Wuhan, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9943-6020","authenticated-orcid":false,"given":"Xu","family":"Chen","sequence":"additional","affiliation":[{"name":"Sun Yat-sen University, Guangzhou, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2025,6,3]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"[n. d.]. Sklearn. https:\/\/scikit-learn.org\/stable\/."},{"key":"e_1_2_1_2_1","unstructured":"AblibabaCloud 2024. Alibaba Cloud Microservices Engine. https:\/\/www.alibabacloud.com\/product\/microservicesengine."},{"key":"e_1_2_1_3_1","unstructured":"Alitrace 2022. Alibaba Microservices Cluster Traces. https:\/\/github.com\/alibaba\/clusterdata\/tree\/master\/cluster-tracemicroservices-v2022."},{"key":"e_1_2_1_4_1","unstructured":"Azure Cloud Container Apps. 2024. https:\/\/azure.microsoft.com\/en-us\/services\/container-apps\/."},{"key":"e_1_2_1_5_1","unstructured":"Kubernetes's Horizontal Pod Autoscaling. 2024. https:\/\/kubernetes.io\/docs\/tasks\/run-application\/horizontal-podautoscale\/."},{"key":"e_1_2_1_6_1","volume-title":"Proceedings of the ACM on Measurement and Analysis of Computing Systems","author":"Roy Rohan Basu","year":"2024","unstructured":"Rohan Basu Roy and Devesh Tiwari. 2024. Starship: Mitigating i\/o bottlenecks in serverless computing for scientific workflows. Proceedings of the ACM on Measurement and Analysis of Computing Systems (2024), 1--29."},{"volume-title":"Site reliability engineering: How Google runs production systems. '' O'Reilly Media","author":"Beyer Betsy","key":"e_1_2_1_7_1","unstructured":"Betsy Beyer, Chris Jones, Jennifer Petoff, and Niall Richard Murphy. 2016. Site reliability engineering: How Google runs production systems. '' O'Reilly Media, Inc.''."},{"key":"e_1_2_1_8_1","volume-title":"An algorithm with guaranteed convergence for finding a zero of a function. The computer journal","author":"Brent Richard P.","year":"1971","unstructured":"Richard P. Brent. 1971. An algorithm with guaranteed convergence for finding a zero of a function. The computer journal (1971)."},{"key":"e_1_2_1_9_1","volume-title":"Derm: SLA-aware Resource Management for Highly Dynamic Microservices. In 2024 ACM\/IEEE 51st Annual International Symposium on Computer Architecture (ISCA). IEEE, 424--436","author":"Chen Liao","year":"2024","unstructured":"Liao Chen, Shutian Luo, Chenyu Lin, Zizhao Mo, Huanle Xu, Kejiang Ye, and Chengzhong Xu. 2024. Derm: SLA-aware Resource Management for Highly Dynamic Microservices. In 2024 ACM\/IEEE 51st Annual International Symposium on Computer Architecture (ISCA). IEEE, 424--436."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939785"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE60146.2024.00397"},{"key":"e_1_2_1_12_1","volume-title":"SCAD: Scalability Advisor for Interactive Microservices on Hybrid Clouds. In Companion of ACM SIGMOD.","author":"Chow Ka-Ho","year":"2023","unstructured":"Ka-Ho Chow, Umesh Deshpande, Veera Deenadhayalan, Sangeetha Seshadri, and Ling Liu. 2023. SCAD: Scalability Advisor for Interactive Microservices on Hybrid Clouds. In Companion of ACM SIGMOD."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3492321.3519564"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/1327452.1327492"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/IISWC.2013.6704667"},{"key":"e_1_2_1_16_1","unstructured":"Envoy 2024. Envoy: Load Balancer Subsets. https:\/\/www.envoyproxy.io\/docs\/envoy\/latest\/intro\/arch_overview\/ upstream\/load_balancing\/subsets."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3623278.3624758"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3297858.3304013"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3297858.3304004"},{"key":"e_1_2_1_20_1","unstructured":"Google Kubernetes Engine 2024. Google Kubernetes Engine. https:\/\/cloud.google.com\/kubernetes-engine."},{"key":"e_1_2_1_21_1","unstructured":"Google Site Reliability Engineering 2024. Google Site Reliability Engineering. https:\/\/sre.google\/sre-book\/loadbalancing-datacenter\/."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3368089.3417066"},{"key":"e_1_2_1_23_1","volume-title":"PEMA: A Comprehensive Resource Manager for Microservices. ACM SIGMETRICS Performance Evaluation Review","author":"Hossen Md Rajib","year":"2024","unstructured":"Md Rajib Hossen. 2024. PEMA: A Comprehensive Resource Manager for Microservices. ACM SIGMETRICS Performance Evaluation Review (2024), 10--12."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/3669940.3707287"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3643748"},{"key":"e_1_2_1_26_1","unstructured":"Istio. 2024. https:\/\/istio.io\/latest\/about\/service-mesh\/."},{"key":"e_1_2_1_27_1","unstructured":"Jaeger 2024. Jaeger. https:\/\/jaegertracing.io\/."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3302424.3303958"},{"key":"e_1_2_1_29_1","doi-asserted-by":"crossref","unstructured":"Carl T Kelley. 2003. Solving nonlinear equations with Newton's method. SIAM.","DOI":"10.1137\/1.9780898718898"},{"key":"e_1_2_1_30_1","unstructured":"Kubernetes. 2024. https:\/\/kubernetes.io.."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.14778\/3484224.3484232"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3700436"},{"key":"e_1_2_1_33_1","volume-title":"Proceedings of the VLDB Endowment","author":"Li Qian","year":"2023","unstructured":"Qian Li, Peter Kraft, Michael Cafarella, \u00c7agatay Demiralp, Goetz Graefe, Christos Kozyrakis, Michael Stonebraker, Lalith Suresh, Xiangyao Yu, and Matei Zaharia. 2023. R3: Record-Replay-Retroaction for Database-Backed Applications. Proceedings of the VLDB Endowment (2023)."},{"key":"e_1_2_1_34_1","volume-title":"Proceedings of NSDI.","author":"Mike Liang Chieh-Jan","year":"2023","unstructured":"Chieh-Jan Mike Liang, Zilin Fang, Yuqing Xie, Fan Yang, Zhao Lucis Li, Li Lyna Zhang, Mao Yang, and Lidong Zhou. 2023. On Modular Learning of Distributed Systems for Predicting {End-to-End} Latency. In Proceedings of NSDI."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3552326.3587437"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/3472883.3487003"},{"key":"e_1_2_1_37_1","volume-title":"Proceedings of ASPLOS.","author":"Luo Shutian","year":"2023","unstructured":"Shutian Luo, Huanle Xu, Chengzhi Lu, Kejiang Ye, Guoyao Xu, Liping Zhang, Yu Ding, Jian He, and Chengzhong Xu. 2023. Erms: Efficient Resource Management for Shared Microservices with SLA Guarantees. In Proceedings of ASPLOS."},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPDS.2022.3174631"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/3542929.3563477"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3489048.3530959"},{"key":"e_1_2_1_41_1","volume-title":"The Kolmogorov-Smirnov test for goodness of fit. Journal of the American statistical Association","author":"Massey Frank J","year":"1951","unstructured":"Frank J Massey Jr. 1951. The Kolmogorov-Smirnov test for goodness of fit. Journal of the American statistical Association (1951)."},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3472883.3486985"},{"key":"e_1_2_1_43_1","unstructured":"Netclix 2024. ServerListSubsetFilter in Netflix. https:\/\/javadoc.io\/doc\/com.netflix.ribbon\/ribbonloadbalancer\/ 2.4.3\/com\/netflix\/loadbalancer\/ServerListSubsetFilter.html."},{"key":"e_1_2_1_44_1","unstructured":"OpenTelemetry 2022. Tail Sampling with OpenTelemetry: Why it's useful how to do it and what to consider. https:\/\/opentelemetry.io\/blog\/2022\/tail-sampling\/."},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/3485983.3494866"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3540250.3558951"},{"key":"e_1_2_1_47_1","unstructured":"Prometheus 2024. Prometheus. https:\/\/prometheus.io\/."},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE53745.2022.00252"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/3342195.3387524"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/3603269.3604823"},{"key":"e_1_2_1_51_1","volume-title":"Proceedings of OSDI.","author":"Tang Chunqiang","year":"2020","unstructured":"Chunqiang Tang, Kenny Yu, Kaushik Veeraraghavan, and Jonathan Kaldor, et al. 2020. Twine: A Unified Cluster Management System for Shared Infrastructure. In Proceedings of OSDI."},{"key":"e_1_2_1_52_1","unstructured":"Twitter 2019. Deterministic Aperture: A distributed load balancing algorithm in Twitter. https:\/\/blog.x.com\/ engineering\/en_us\/topics\/infrastructure\/2019\/daperture-load-balancer."},{"key":"e_1_2_1_53_1","unstructured":"Uber 2024. Better Load Balancing: Real-Time Dynamic Subsetting. https:\/\/www.uber.com\/en-HK\/blog\/better-loadbalancing-real-time-dynamic-subsetting\/."},{"key":"e_1_2_1_54_1","unstructured":"Uberupdate 2024. Load Balancing: Handling Heterogeneous Hardware. https:\/\/www.uber.com\/en-DO\/blog\/loadbalancing-handling-heterogeneous-hardware\/."},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/3542929.3563469"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/3570937"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/3588863"},{"key":"e_1_2_1_58_1","volume-title":"Proc. of ACM SoCC. 308--323","author":"Xiang Wu","year":"2023","unstructured":"Wu Xiang, Yakun Li, Yuquan Ren, Fan Jiang, Chaohui Xin, Varun Gupta, Chao Xiang, Xinyi Song, Meng Liu, Bing Li, et al. 2023. G\u00f6del: Unified Large-Scale Resource Management and Scheduling at ByteDance. In Proc. of ACM SoCC. 308--323."},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/3611643.3613861"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/3597503.3639088"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/3540250.3549146"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/3445814.3446693"},{"key":"e_1_2_1_63_1","volume-title":"Ursa: Lightweight Resource Management for Cloud-Native Microservices. In 2024 IEEE International Symposium on High-Performance Computer Architecture (HPCA). IEEE, 954--969","author":"Zhang Yanqi","year":"2024","unstructured":"Yanqi Zhang, Zhuangzhuang Zhou, Sameh Elnikety, and Christina Delimitrou. 2024. Ursa: Lightweight Resource Management for Cloud-Native Microservices. In 2024 IEEE International Symposium on High-Performance Computer Architecture (HPCA). IEEE, 954--969."},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.14778\/2733004.2733012"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/3342195.3387534"},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/3567955.3567960"}],"container-title":["Proceedings of the ACM on Measurement and Analysis of Computing Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3727118","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3727118","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,22]],"date-time":"2025-08-22T21:32:35Z","timestamp":1755898355000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3727118"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,5,27]]},"references-count":66,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2025,5,27]]}},"alternative-id":["10.1145\/3727118"],"URL":"https:\/\/doi.org\/10.1145\/3727118","relation":{},"ISSN":["2476-1249"],"issn-type":[{"type":"electronic","value":"2476-1249"}],"subject":[],"published":{"date-parts":[[2025,5,27]]},"assertion":[{"value":"2025-06-03","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}