{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,18]],"date-time":"2025-12-18T14:19:20Z","timestamp":1766067560033,"version":"build-2065373602"},"reference-count":18,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2022,7,2]],"date-time":"2022-07-02T00:00:00Z","timestamp":1656720000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Algorithms"],"abstract":"<jats:p>Serverless computing has grown massively in popularity over the last few years, and has provided developers with a way to deploy function-sized code units without having to take care of the actual servers or deal with logging, monitoring, and scaling of their code. High-performance computing (HPC) clusters can profit from improved serverless resource sharing capabilities compared to reservation-based systems such as Slurm. However, before running self-hosted serverless platforms in HPC becomes a viable option, serverless platforms must be able to deliver a decent level of performance. Other researchers have already pointed out that there is a distinct lack of studies in the area of comparative benchmarks on serverless platforms, especially for open-source self-hosted platforms. This study takes a step towards filling this gap by systematically benchmarking two promising self-hosted Kubernetes-based serverless platforms in comparison. While the resulting benchmarks signal potential, they demonstrate that many opportunities for performance improvements in serverless computing are being left on the table.<\/jats:p>","DOI":"10.3390\/a15070234","type":"journal-article","created":{"date-parts":[[2022,7,2]],"date-time":"2022-07-02T11:12:35Z","timestamp":1656760355000},"page":"234","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Performance Evaluation of Open-Source Serverless Platforms for Kubernetes"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7384-7304","authenticated-orcid":false,"given":"Jonathan","family":"Decker","sequence":"first","affiliation":[{"name":"Institute for Computer Science, Universit\u00e4t G\u00f6ttingen, Goldschmidtstra\u00dfe 7, 37077 G\u00f6ttingen, Germany"}]},{"given":"Piotr","family":"Kasprzak","sequence":"additional","affiliation":[{"name":"GWDG, Burckhardtweg 4, 37077 G\u00f6ttingen, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6915-1179","authenticated-orcid":false,"given":"Julian Martin","family":"Kunkel","sequence":"additional","affiliation":[{"name":"Institute for Computer Science, Universit\u00e4t G\u00f6ttingen, Goldschmidtstra\u00dfe 7, 37077 G\u00f6ttingen, Germany"},{"name":"GWDG, Burckhardtweg 4, 37077 G\u00f6ttingen, Germany"}]}],"member":"1968","published-online":{"date-parts":[[2022,7,2]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"76","DOI":"10.1145\/3406011","article-title":"What Serverless Computing Is and Should Become: The next Phase of Cloud Computing","volume":"64","author":"Sreekanti","year":"2021","journal-title":"Commun. ACM"},{"key":"ref_2","unstructured":"Jonas, E., Schleier-Smith, J., Sreekanti, V., Tsai, C.C., Khandelwal, A., Pu, Q., Shankar, V., Carreira, J., Krauth, K., and Yadwadkar, N. (2019). Cloud Programming Simplified: A Berkeley View on Serverless Computing. arXiv."},{"key":"ref_3","unstructured":"Mocskos, E., and Nesmachnow, S. (2017, January 11\u201312). FaaSter, Better, Cheaper: The Prospect of Serverless Scientific Computing and HPC. Proceedings of the High Performance Computing, Dresden, Germany."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"110708","DOI":"10.1016\/j.jss.2020.110708","article-title":"Function-as-a-Service Performance Evaluation: A Multivocal Literature Review","volume":"170","author":"Scheuner","year":"2020","journal-title":"J. Syst. Softw."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Van Eyk, E., Scheuner, J., Eismann, S., Abad, C.L., and Iosup, A. (2020, January 25\u201330). Beyond Microbenchmarks: The SPEC-RG Vision for a Comprehensive Serverless Benchmark. Proceedings of the Companion of the ACM\/SPEC International Conference on Performance Engineering (ICPE \u201920), Edmonton, AB, Canada.","DOI":"10.1145\/3375555.3384381"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Beltre, A.M., Saha, P., Govindaraju, M., Younge, A., and Grant, R.E. (2019, January 18). Enabling HPC Workloads on Cloud Infrastructure Using Kubernetes Container Orchestration Mechanisms. Proceedings of the 2019 IEEE\/ACM International Workshop on Containers and New Orchestration Paradigms for Isolated Environments in HPC (CANOPIE-HPC), Denver, CO, USA.","DOI":"10.1109\/CANOPIE-HPC49598.2019.00007"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Kuhlenkamp, J., and Werner, S. (2018, January 17\u201320). Benchmarking FaaS Platforms: Call for Community Participation. Proceedings of the 2018 IEEE\/ACM International Conference on Utility and Cloud Computing Companion (UCC Companion), Zurich, Switzerland.","DOI":"10.1109\/UCC-Companion.2018.00055"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1109\/MIC.2019.2952061","article-title":"The SPEC-RG Reference Architecture for FaaS: From Microservices and Containers to Serverless Platforms","volume":"23","author":"Grohmann","year":"2019","journal-title":"IEEE Internet Comput."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1109\/MS.2020.3023302","article-title":"Serverless Applications: Why, When, and How?","volume":"38","author":"Eismann","year":"2021","journal-title":"IEEE Softw."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"70","DOI":"10.1016\/j.procs.2020.06.010","article-title":"Performance Analysis of Various Server Hosting Techniques","volume":"173","author":"Jain","year":"2020","journal-title":"Procedia Comput. Sci."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"e137","DOI":"10.1002\/itl2.137","article-title":"HPC in the Cloud: Performance Comparison of Function as a Service (FaaS) vs Infrastructure as a Service (IaaS)","volume":"3","author":"Malla","year":"2020","journal-title":"Internet Technol. Lett."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1186\/s13677-021-00231-z","article-title":"Container Orchestration on HPC Systems through Kubernetes","volume":"10","author":"Zhou","year":"2021","journal-title":"J. Cloud Comput."},{"key":"ref_13","unstructured":"Decker, J. The Potential of Serverless Kubernetes-Based FaaS Platforms for Scientific Computing Workloads, Available online: https:\/\/data.goettingen-research-online.de\/dataset.xhtml?persistentId=doi:10.25625\/6GSJSE."},{"key":"ref_14","unstructured":"Cheney, D. (2016). Cgo | The Acme of Foolishness, Available online: https:\/\/dave.cheney.net\/2016\/01\/18\/cgo-is-not-go."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1080\/2165347X.2015.1024298","article-title":"TESTIMAGES: A Large Data Archive For Display and Algorithm Testing","volume":"17","author":"Asuni","year":"2013","journal-title":"J. Graph. Tools"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Van Eyk, E., Iosup, A., Abad, C.L., Grohmann, J., and Eismann, S. (2018, January 9\u201313). A SPEC RG Cloud Group\u2019s Vision on the Performance Challenges of FaaS Cloud Architectures. Proceedings of the Companion of the 2018 ACM\/SPEC International Conference on Performance Engineering (ICPE \u201918), Berlin, Germany.","DOI":"10.1145\/3185768.3186308"},{"key":"ref_17","unstructured":"Copik, M., Kwasniewski, G., Besta, M., Podstawski, M., and Hoefler, T. (2021, January 6\u201310). SeBS: A Serverless Benchmark Suite for Function-as-a-Service Computing. Proceedings of the 22nd International Middleware Conference (Middleware \u201921), Qu\u00e9bec, QC, Canada."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Satzke, K., Akkus, I.E., Chen, R., Rimac, I., Stein, M., Beck, A., Aditya, P., Vanga, M., and Hilt, V. (2020, January 23\u201326). Efficient GPU Sharing for Serverless Workflows. Proceedings of the 1st Workshop on High Performance Serverless Computing (HiPS \u201921), Stockholm, Sweden.","DOI":"10.1145\/3452413.3464785"}],"container-title":["Algorithms"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-4893\/15\/7\/234\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:42:02Z","timestamp":1760139722000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-4893\/15\/7\/234"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,2]]},"references-count":18,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2022,7]]}},"alternative-id":["a15070234"],"URL":"https:\/\/doi.org\/10.3390\/a15070234","relation":{},"ISSN":["1999-4893"],"issn-type":[{"type":"electronic","value":"1999-4893"}],"subject":[],"published":{"date-parts":[[2022,7,2]]}}}