{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,25]],"date-time":"2026-06-25T16:46:26Z","timestamp":1782405986434,"version":"3.54.5"},"reference-count":57,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2026,6,25]],"date-time":"2026-06-25T00:00:00Z","timestamp":1782345600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/legalcode"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["62232011, and U25B2021"],"award-info":[{"award-number":["62232011, and U25B2021"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Natural Science Foundation of Shanghai Municipality","award":["25ZR1402241"],"award-info":[{"award-number":["25ZR1402241"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Archit. Code Optim."],"published-print":{"date-parts":[[2026,6,30]]},"abstract":"<jats:p>\n                    Microservices are widely shared in production user-facing applications. These shared microservices have various resource usage patterns when queries from different call graphs of different services access them. However, existing microservice management works fail to efficiently scale resources for them, mainly due to the lack of fine-grained scheduling of diverse queries. We therefore propose\n                    <jats:bold>Delphinus<\/jats:bold>\n                    , a runtime system that efficiently manages resources for shared microservices while ensuring the Quality-of-Service (QoS). Delphinus comprises a\n                    <jats:italic toggle=\"yes\">group-oriented query scheduler<\/jats:italic>\n                    and a\n                    <jats:italic toggle=\"yes\">borrowing-based load adapter<\/jats:italic>\n                    . The query scheduler identifies diverse queries, groups the containers of shared microservices, and schedules the queries into separate groups. The load adapter efficiently scales resources for shared microservices, and fully utilizes the idle containers among groups when the loads of diverse queries change. Results show that Delphinus reduces CPU and memory usage by 40.1% and 36.4% for shared microservices, respectively, compared to state-of-the-art works.\n                  <\/jats:p>","DOI":"10.1145\/3815585","type":"journal-article","created":{"date-parts":[[2026,5,20]],"date-time":"2026-05-20T11:24:59Z","timestamp":1779276299000},"page":"1-26","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Delphinus: Improving Resource Efficiency of Applications with Shared Microservices and Diverse Queries"],"prefix":"10.1145","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5470-210X","authenticated-orcid":false,"given":"Jiuchen","family":"Shi","sequence":"first","affiliation":[{"name":"Shanghai Jiao Tong University","place":["Shanghai, China"]},{"name":"The Hong Kong Polytechnic University","place":["Shanghai, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-2027-7138","authenticated-orcid":false,"given":"Jinyuan","family":"Chen","sequence":"additional","affiliation":[{"name":"Shanghai Jiao Tong University","place":["Shanghai, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5832-0347","authenticated-orcid":false,"given":"Quan","family":"Chen","sequence":"additional","affiliation":[{"name":"Shanghai Jiao Tong University","place":["Shanghai, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5117-7162","authenticated-orcid":false,"given":"Kaihua","family":"Fu","sequence":"additional","affiliation":[{"name":"The Hong Kong University of Science and Technology","place":["Hong Kong, Hong Kong"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-6895-362X","authenticated-orcid":false,"given":"Fanrong","family":"Du","sequence":"additional","affiliation":[{"name":"Shanghai Jiao Tong University","place":["Shanghai, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4706-8451","authenticated-orcid":false,"given":"Zijun","family":"Li","sequence":"additional","affiliation":[{"name":"Shanghai Jiao Tong University","place":["Shanghai, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3276-1202","authenticated-orcid":false,"given":"Deze","family":"Zeng","sequence":"additional","affiliation":[{"name":"China University of Geosciences","place":["Wuhan, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2725-2529","authenticated-orcid":false,"given":"Jiannong","family":"Cao","sequence":"additional","affiliation":[{"name":"The Hong Kong Polytechnic University","place":["Hong Kong, Hong Kong"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8824-631X","authenticated-orcid":false,"given":"Shuo","family":"Quan","sequence":"additional","affiliation":[{"name":"Cloud Computing Research Institute, China Telecom","place":["Beijing, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3472-1717","authenticated-orcid":false,"given":"Jie","family":"Wu","sequence":"additional","affiliation":[{"name":"Cloud Computing Research Institute, China Telecom","place":["Beijing, China"]},{"name":"Temple University","place":["Beijing, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0034-2302","authenticated-orcid":false,"given":"Minyi","family":"Guo","sequence":"additional","affiliation":[{"name":"Shanghai Jiao Tong University","place":["Shanghai, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2026,6,25]]},"reference":[{"key":"e_1_3_1_2_2","unstructured":"HTTP2: Create additional connections when maximum active streams is reached. 2020. Retrieved May 4 2026 from https:\/\/github.com\/dotnet\/runtime\/issues\/35088"},{"key":"e_1_3_1_3_2","first-page":"419","volume-title":"Proceedings of the 17th USENIX Symposium on Networked Systems Design and Implementation","author":"Agache Alexandru","year":"2020","unstructured":"Alexandru Agache, Marc Brooker, Alexandra Iordache, Anthony Liguori, Rolf Neugebauer, Phil Piwonka, and Diana-Maria Popa. 2020. Firecracker: Lightweight virtualization for serverless applications. In Proceedings of the 17th USENIX Symposium on Networked Systems Design and Implementation. 419\u2013434."},{"key":"e_1_3_1_4_2","unstructured":"Azure Container Apps. 2025. Retrieved May 4 2026 from https:\/\/azure.microsoft.com\/en-us\/products\/"},{"key":"e_1_3_1_5_2","unstructured":"Atomicity and Transactions. 2026. Retrieved May 4 2026 from https:\/\/www.mongodb.com\/docs\/manual\/core\/write-operations-atomicity\/"},{"key":"e_1_3_1_6_2","doi-asserted-by":"publisher","DOI":"10.1145\/3472883.3486999"},{"key":"e_1_3_1_7_2","unstructured":"Load Balancing. 2026. Retrieved May 4 2026 from https:\/\/deepwiki.com\/grpc\/grpc-go\/4-load-balancing"},{"key":"e_1_3_1_8_2","unstructured":"Online Boutique. 2025. Retrieved May 4 2026 from https:\/\/github.com\/GoogleCloudPlatform\/microservices-demo\/"},{"key":"e_1_3_1_9_2","unstructured":"cgroups(7) \u2013 Linux manual page. 2024. Retrieved May 4 2026 from https:\/\/man7.org\/linux\/man-pages\/man7\/cgroups.7.html"},{"key":"e_1_3_1_10_2","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1007\/978-981-95-1021-4_15","volume-title":"Proceedings of the Advanced Parallel Processing Technologies","author":"Chen Jinyuan","year":"2026","unstructured":"Jinyuan Chen, Jiuchen Shi, Quan Chen, Lin Gu, and Minyi Guo. 2026. Veyth: Adaptive container placement for optimizing cross-server network traffic of microservice applications. In Proceedings of the Advanced Parallel Processing Technologies. 201\u2013211."},{"key":"e_1_3_1_11_2","first-page":"424","volume-title":"Proceedings of the 2024 ACM\/IEEE 51st Annual International Symposium on Computer Architecture","author":"Chen Liao","year":"2024","unstructured":"Liao Chen, Shutian Luo, Chenyu Lin, Zizhao Mo, Huanle Xu, Kejiang Ye, and Chengzhong Xu. 2024. Derm: SLA-aware resource management for highly dynamic microservices. In Proceedings of the 2024 ACM\/IEEE 51st Annual International Symposium on Computer Architecture. 424\u2013436."},{"key":"e_1_3_1_12_2","first-page":"181","volume-title":"Proceedings of the 17th European Conference on Computer Systems","author":"Chow Ka-Ho","year":"2022","unstructured":"Ka-Ho Chow, Umesh Deshpande, Sangeetha Seshadri, and Ling Liu. 2022. DeepRest: Deep resource estimation for interactive microservices. In Proceedings of the 17th European Conference on Computer Systems. 181\u2013198."},{"key":"e_1_3_1_13_2","first-page":"895","volume-title":"Proceedings of the 39th ACM International Conference on Supercomputing","author":"Du Fanrong","year":"2025","unstructured":"Fanrong Du, Jiuchen Shi, Quan Chen, Pu Pang, Li Li, and Minyi Guo. 2025. Generating microservice graphs with production characteristics for efficient resource scaling. In Proceedings of the 39th ACM International Conference on Supercomputing. 895\u2013910."},{"issue":"8","key":"e_1_3_1_14_2","first-page":"1825","article-title":"Adaptive resource efficient microservice deployment in cloud-edge continuum","volume":"33","author":"Fu Kaihua","year":"2021","unstructured":"Kaihua Fu, Wei Zhang, Quan Chen, Deze Zeng, and Minyi Guo. 2021. Adaptive resource efficient microservice deployment in cloud-edge continuum. IEEE Transactions on Parallel and Distributed Systems 33, 8 (2021), 1825\u20131840.","journal-title":"IEEE Transactions on Parallel and Distributed Systems"},{"key":"e_1_3_1_15_2","doi-asserted-by":"publisher","DOI":"10.1145\/3445814.3446700"},{"key":"e_1_3_1_16_2","first-page":"3","volume-title":"Proceedings of the 24th International Conference on Architectural Support for Programming Languages and Operating Systems","author":"Gan Yu","year":"2019","unstructured":"Yu Gan, Yanqi Zhang, Dailun Cheng, Ankitha Shetty, Priyal Rathi, Nayan Katarki, Ariana Bruno, Justin Hu, Brian Ritchken, Brendon Jackson, et\u00a0al. 2019. An open-source benchmark suite for microservices and their hardware-software implications for cloud and edge systems. In Proceedings of the 24th International Conference on Architectural Support for Programming Languages and Operating Systems. 3\u201318."},{"key":"e_1_3_1_17_2","doi-asserted-by":"publisher","DOI":"10.1145\/3297858.3304004"},{"key":"e_1_3_1_18_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICDCS.2019.00197"},{"key":"e_1_3_1_19_2","unstructured":"gRPC. 2026. Retrieved May 4 2026 from https:\/\/grpc.io\/"},{"key":"e_1_3_1_20_2","doi-asserted-by":"publisher","DOI":"10.1145\/3502181.3531460"},{"key":"e_1_3_1_21_2","first-page":"419","volume-title":"Proceedings of the 2023 USENIX Annual Technical Conference","author":"Huye Darby","year":"2023","unstructured":"Darby Huye, Yuri Shkuro, and Raja R. Sambasivan. 2023. Lifting the veil on Meta\u2019s microservice architecture: Analyses of topology and request workflows. In Proceedings of the 2023 USENIX Annual Technical Conference. 419\u2013432."},{"key":"e_1_3_1_22_2","unstructured":"Jaeger. 2025. Retrieved May 4 2026 from https:\/\/www.jaegertracing.io\/"},{"key":"e_1_3_1_23_2","doi-asserted-by":"publisher","DOI":"10.1145\/3302424.3303958"},{"key":"e_1_3_1_24_2","unstructured":"Kubernetes. 2025. Retrieved May 4 2026 from kubernetes.io"},{"key":"e_1_3_1_25_2","first-page":"287","volume-title":"Proceedings of the 28th ACM International Conference on Architectural Support for Programming Languages and Operating Systems","author":"Li Ye","year":"2023","unstructured":"Ye Li, Jian Tan, Bin Wu, Xiao He, and Feifei Li. 2023. ShapleyIQ: Influence quantification by shapley values for performance debugging of microservices. In Proceedings of the 28th ACM International Conference on Architectural Support for Programming Languages and Operating Systems. 287\u2013323."},{"key":"e_1_3_1_26_2","first-page":"53","volume-title":"Proceedings of the 2022 USENIX Annual Technical Conference","author":"Li Zijun","year":"2022","unstructured":"Zijun Li, Jiagan Cheng, Quan Chen, Eryu Guan, Zizheng Bian, Yi Tao, Bin Zha, Qiang Wang, Weidong Han, and Minyi Guo. 2022. RunD: A lightweight secure container runtime for high-density deployment and high-concurrency startup in serverless computing. In Proceedings of the 2022 USENIX Annual Technical Conference. 53\u201368."},{"key":"e_1_3_1_27_2","first-page":"69","volume-title":"Proceedings of the 2022 USENIX Annual Technical Conference","author":"Li Zijun","year":"2022","unstructured":"Zijun Li, Linsong Guo, Quan Chen, Jiagan Cheng, Chuhao Xu, Deze Zeng, Zhuo Song, Tao Ma, Yong Yang, Chao Li, et\u00a0al. 2022. Help rather than recycle: Alleviating cold startup in serverless computing through inter-function container sharing. In Proceedings of the 2022 USENIX Annual Technical Conference. 69\u201384."},{"key":"e_1_3_1_28_2","doi-asserted-by":"publisher","DOI":"10.1145\/3631607"},{"key":"e_1_3_1_29_2","doi-asserted-by":"publisher","DOI":"10.1145\/3472883.3487003"},{"key":"e_1_3_1_30_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPDS.2022.3174631"},{"key":"e_1_3_1_31_2","first-page":"62","volume-title":"Proceedings of the 28th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 1","author":"Luo Shutian","year":"2022","unstructured":"Shutian Luo, Huanle Xu, Kejiang Ye, Guoyao Xu, Liping Zhang, Jian He, Guodong Yang, and Chengzhong Xu. 2022. Erms: Efficient resource management for shared microservices with SLA guarantees. In Proceedings of the 28th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 1. 62\u201377."},{"key":"e_1_3_1_32_2","doi-asserted-by":"publisher","DOI":"10.1145\/3542929.3563477"},{"key":"e_1_3_1_33_2","unstructured":"Is memcached atomic?2026. Retrieved May 4 2026 from https:\/\/docs.memcached.org\/userguide\/faq\/#is-memcached-atomic"},{"key":"e_1_3_1_34_2","doi-asserted-by":"crossref","first-page":"442","DOI":"10.1145\/3472883.3486985","volume-title":"Proceedings of the ACM Symposium on Cloud Computing","author":"Mirhosseini Amirhossein","year":"2021","unstructured":"Amirhossein Mirhosseini, Sameh Elnikety, and Thomas F Wenisch. 2021. Parslo: A gradient descent-based approach for near-optimal partial SLO allotment in microservices. In Proceedings of the ACM Symposium on Cloud Computing. 442\u2013457."},{"key":"e_1_3_1_35_2","first-page":"207","volume-title":"Proceedings of the 2020 IEEE International Symposium on High Performance Computer Architecture","author":"Mirhosseini Amirhossein","year":"2020","unstructured":"Amirhossein Mirhosseini, Brendan L. West, Geoffrey W. Blake, and Thomas F. Wenisch. 2020. Q-Zilla: A scheduling framework and core microarchitecture for tail-tolerant microservices. In Proceedings of the 2020 IEEE International Symposium on High Performance Computer Architecture. 207\u2013219."},{"key":"e_1_3_1_36_2","unstructured":"Microservices Engine (MSE). 2025. Retrieved May 4 2026 from https:\/\/www.alibabacloud.com\/product\/microservices-engine"},{"key":"e_1_3_1_37_2","unstructured":"Limiting number of pendingStreams. 2026. Retrieved May 4 2026 from https:\/\/groups.google.com\/g\/grpc-io\/c\/9IbBfoOezJQ"},{"key":"e_1_3_1_38_2","unstructured":"Custom Load Balancing Policies. 2026. Retrieved May 4 2026 from https:\/\/grpc.io\/docs\/guides\/custom-load-balancing\/"},{"key":"e_1_3_1_39_2","first-page":"805","volume-title":"Proceedings of the 14th USENIX Symposium on Operating Systems Design and Implementation","author":"Qiu Haoran","year":"2020","unstructured":"Haoran Qiu, Subho S. Banerjee, Saurabh Jha, Zbigniew T. Kalbarczyk, and Ravishankar K. Iyer. 2020. FIRM: An intelligent fine-grained resource management framework for SLO-oriented microservices. In Proceedings of the 14th USENIX Symposium on Operating Systems Design and Implementation. 805\u2013825."},{"key":"e_1_3_1_40_2","unstructured":"Concurrent request\/connection limits for Go servers. 2026. Retrieved May 4 2026 from https:\/\/pkg.go.dev\/github.com\/evanj\/concurrentlimit"},{"key":"e_1_3_1_41_2","doi-asserted-by":"publisher","DOI":"10.1145\/3600006.3613156"},{"key":"e_1_3_1_42_2","doi-asserted-by":"publisher","DOI":"10.1145\/3542929.3563490"},{"key":"e_1_3_1_43_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPDS.2024.3425931"},{"key":"e_1_3_1_44_2","first-page":"324","volume-title":"Proceedings of the 2022 IEEE International Parallel and Distributed Processing Symposium","author":"Shi Jiuchen","year":"2022","unstructured":"Jiuchen Shi, Jiawen Wang, Kaihua Fu, Quan Chen, Deze Zeng, and Minyi Guo. 2022. QoS-awareness of microservices with excessive loads via inter-datacenter scheduling. In Proceedings of the 2022 IEEE International Parallel and Distributed Processing Symposium. 324\u2013334."},{"key":"e_1_3_1_45_2","first-page":"403","volume-title":"Proceedings of the 2023 USENIX Annual Technical Conference","author":"Shi Jiuchen","year":"2023","unstructured":"Jiuchen Shi, Hang Zhang, Zhixin Tong, Quan Chen, Kaihua Fu, and Minyi Guo. 2023. Nodens: Enabling resource efficient and fast QoS recovery of dynamic microservice applications in datacenters. In Proceedings of the 2023 USENIX Annual Technical Conference. 403\u2013417."},{"key":"e_1_3_1_46_2","first-page":"1","volume-title":"Proceedings of the 2018 IEEE International Symposium on Workload Characterization","author":"Sriraman Akshitha","year":"2018","unstructured":"Akshitha Sriraman and Thomas F. Wenisch. 2018. \\(\\mu\\) suite: A benchmark suite for microservices. In Proceedings of the 2018 IEEE International Symposium on Workload Characterization. 1\u201312."},{"key":"e_1_3_1_47_2","doi-asserted-by":"publisher","DOI":"10.1145\/3127479.3132020"},{"key":"e_1_3_1_48_2","unstructured":"Prometheus Monitoring system and time series database. 2025. Retrieved May 4 2026 from https:\/\/prometheus.io\/"},{"key":"e_1_3_1_49_2","unstructured":"tc(8) \u2013 Linux manual page. 2025. Retrieved May 4 2026 from https:\/\/man7.org\/linux\/man-pages\/man8\/tc.8.html"},{"key":"e_1_3_1_50_2","unstructured":"Introduction to microservices. 2021. Retrieved May 4 2026 from https:\/\/cloud.google.com\/architecture\/microservices-architecture-introduction"},{"key":"e_1_3_1_51_2","doi-asserted-by":"publisher","DOI":"10.1145\/3190645"},{"key":"e_1_3_1_52_2","first-page":"149","volume-title":"Proceedings of the 21st USENIX Symposium on Networked Systems Design and Implementation","author":"Wang Zibo","year":"2024","unstructured":"Zibo Wang, Pinghe Li, Chieh-Jan Mike Liang, Feng Wu, and Francis Y. Yan. 2024. Autothrottle: A practical Bi-level approach to resource management for SLO-targeted microservices. In Proceedings of the 21st USENIX Symposium on Networked Systems Design and Implementation. 149\u2013165."},{"key":"e_1_3_1_53_2","doi-asserted-by":"publisher","DOI":"10.1145\/3503222.3507721"},{"key":"e_1_3_1_54_2","doi-asserted-by":"publisher","DOI":"10.1145\/3445814.3446693"},{"key":"e_1_3_1_55_2","first-page":"954","volume-title":"Proceedings of the 2024 IEEE International Symposium on High-Performance Computer Architecture","author":"Zhang Yanqi","year":"2024","unstructured":"Yanqi Zhang, Zhuangzhuang Zhou, Sameh Elnikety, and Christina Delimitrou. 2024. Ursa: Lightweight resource management for cloud-native microservices. In Proceedings of the 2024 IEEE International Symposium on High-Performance Computer Architecture. 954\u2013969."},{"key":"e_1_3_1_56_2","doi-asserted-by":"publisher","DOI":"10.1145\/3342195.3387534"},{"key":"e_1_3_1_57_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2018.2887384"},{"key":"e_1_3_1_58_2","doi-asserted-by":"publisher","DOI":"10.1145\/3605573.3605646"}],"container-title":["ACM Transactions on Architecture and Code Optimization"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3815585","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,25]],"date-time":"2026-06-25T15:53:41Z","timestamp":1782402821000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3815585"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,6,25]]},"references-count":57,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2026,6,30]]}},"alternative-id":["10.1145\/3815585"],"URL":"https:\/\/doi.org\/10.1145\/3815585","relation":{},"ISSN":["1544-3566","1544-3973"],"issn-type":[{"value":"1544-3566","type":"print"},{"value":"1544-3973","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,6,25]]},"assertion":[{"value":"2025-08-20","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-04-21","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-06-25","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}