{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,18]],"date-time":"2026-04-18T16:35:17Z","timestamp":1776530117372,"version":"3.51.2"},"publisher-location":"New York, NY, USA","reference-count":14,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,4,20]],"date-time":"2020-04-20T00:00:00Z","timestamp":1587340800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,4,20]]},"DOI":"10.1145\/3375555.3384381","type":"proceedings-article","created":{"date-parts":[[2020,5,4]],"date-time":"2020-05-04T07:22:45Z","timestamp":1588576965000},"page":"26-31","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":13,"title":["Beyond Microbenchmarks: The SPEC-RG Vision for a Comprehensive Serverless Benchmark"],"prefix":"10.1145","author":[{"given":"Erwin","family":"van Eyk","sequence":"first","affiliation":[{"name":"Vrije Universiteit, Amsterdam, Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Joel","family":"Scheuner","sequence":"additional","affiliation":[{"name":"Chalmers, University of Gothenburg, Gothenburg, Sweden"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Simon","family":"Eismann","sequence":"additional","affiliation":[{"name":"University of Wuerzburg, Wuerzburg, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Cristina L.","family":"Abad","sequence":"additional","affiliation":[{"name":"Escuela Superior Politecnica del Litoral, Guayaquil, Ecuador"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alexandru","family":"Iosup","sequence":"additional","affiliation":[{"name":"Vrije Universiteit, Amsterdam, Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2020,4,20]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"ICPE WS","author":"Eyk Erwin Van","year":"2018","unstructured":"Erwin Van Eyk , Alexandru Iosup , Cristina L. Abad , Johannes Grohmann , and Simon Eismann . 2018 . A SPEC RG Cloud Group's Vision on the Performance Challenges of FaaS Cloud Architectures . In ICPE WS 2018. 21--24. Erwin Van Eyk, Alexandru Iosup, Cristina L. Abad, Johannes Grohmann, and Simon Eismann. 2018. A SPEC RG Cloud Group's Vision on the Performance Challenges of FaaS Cloud Architectures. In ICPE WS 2018. 21--24."},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1002\/cpe.4792"},{"key":"e_1_3_2_1_3_1","volume-title":"Two Steps Back. In 9th Biennial Conference on Innovative Data Systems Research (CIDR) .","author":"Hellerstein Joseph M.","year":"2019","unstructured":"Joseph M. Hellerstein , Jose M. Faleiro , Joseph Gonzalez , Johann Schleier-Smith , Vikram Sreekanti , Alexey Tumanov , and Chenggang Wu . 2019 . Serverless Computing: One Step Forward , Two Steps Back. In 9th Biennial Conference on Innovative Data Systems Research (CIDR) . Joseph M. Hellerstein, Jose M. Faleiro, Joseph Gonzalez, Johann Schleier-Smith, Vikram Sreekanti, Alexey Tumanov, and Chenggang Wu. 2019. Serverless Computing: One Step Forward, Two Steps Back. In 9th Biennial Conference on Innovative Data Systems Research (CIDR) ."},{"key":"e_1_3_2_1_4_1","volume-title":"mbox","author":"Eric Jonas","year":"2019","unstructured":"Eric Jonas et al mbox . 2019 . Cloud Programming Simplified: A Berkeley View on Serverless Computing. CoRR , Vol. abs\/ 1902 .03383 (2019). arxiv: 1902.03383 http:\/\/arxiv.org\/abs\/1902.03383 Eric Jonas et almbox. 2019. Cloud Programming Simplified: A Berkeley View on Serverless Computing. CoRR, Vol. abs\/1902.03383 (2019). arxiv: 1902.03383 http:\/\/arxiv.org\/abs\/1902.03383"},{"key":"e_1_3_2_1_5_1","volume-title":"Evaluation of Production Serverless Computing Environments. In Third International Workshop on Serverless Computing","author":"Lee Hyungro","year":"2018","unstructured":"Hyungro Lee , Kumar Satyam , and Geoffrey C Fox . 2018 . Evaluation of Production Serverless Computing Environments. In Third International Workshop on Serverless Computing ( WoSC) . Hyungro Lee, Kumar Satyam, and Geoffrey C Fox. 2018. Evaluation of Production Serverless Computing Environments. In Third International Workshop on Serverless Computing (WoSC) ."},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICAC.2017.21"},{"key":"e_1_3_2_1_7_1","volume-title":"2017 IEEE 37th International Conference on Distributed Computing Systems Workshops (ICDCSW). 405--410","author":"McGrath G.","unstructured":"G. McGrath and P. R. Brenner . 2017. Serverless Computing: Design, Implementation, and Performance . In 2017 IEEE 37th International Conference on Distributed Computing Systems Workshops (ICDCSW). 405--410 . G. McGrath and P. R. Brenner. 2017. Serverless Computing: Design, Implementation, and Performance. In 2017 IEEE 37th International Conference on Distributed Computing Systems Workshops (ICDCSW). 405--410."},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3135974.3135980"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISPDC.2019.00012"},{"key":"e_1_3_2_1_10_1","volume-title":"The SPEC-RG Reference Architecture for FaaS: From Microservices and Containers to Serverless Platforms","author":"van Eyk Erwin","year":"2019","unstructured":"Erwin van Eyk , Johannes Grohmann , Simon Eismann , Andr\u00e9 Bauer , Laurens Versluis , Lucian Toader , Norbert Schmitt , Nikolas Herbst , Cristina Abad , and Alexandru Iosup . 2019. The SPEC-RG Reference Architecture for FaaS: From Microservices and Containers to Serverless Platforms . IEEE Internet Comp . ( 2019 ). Erwin van Eyk, Johannes Grohmann, Simon Eismann, Andr\u00e9 Bauer, Laurens Versluis, Lucian Toader, Norbert Schmitt, Nikolas Herbst, Cristina Abad, and Alexandru Iosup. 2019. The SPEC-RG Reference Architecture for FaaS: From Microservices and Containers to Serverless Platforms. IEEE Internet Comp. (2019)."},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3154847.3154848"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/MIC.2018.053681358"},{"key":"e_1_3_2_1_13_1","volume-title":"Peeking Behind the Curtains of Serverless Platforms. In 2018 USENIX Annual Technical Conference (USENIX ATC 18)","author":"Wang Liang","year":"2018","unstructured":"Liang Wang , Mengyuan Li , Yinqian Zhang , Thomas Ristenpart , and Michael Swift . 2018 . Peeking Behind the Curtains of Serverless Platforms. In 2018 USENIX Annual Technical Conference (USENIX ATC 18) . USENIX Association, Boston, MA, 133--146. https:\/\/www.usenix.org\/conference\/atc18\/presentation\/wang-liang Liang Wang, Mengyuan Li, Yinqian Zhang, Thomas Ristenpart, and Michael Swift. 2018. Peeking Behind the Curtains of Serverless Platforms. In 2018 USENIX Annual Technical Conference (USENIX ATC 18). USENIX Association, Boston, MA, 133--146. https:\/\/www.usenix.org\/conference\/atc18\/presentation\/wang-liang"},{"key":"e_1_3_2_1_14_1","unstructured":"CNCF Serverless WG. 2018. CNCF WG-Serverless Whitepaper v1.0. https:\/\/github.com\/cncf\/wg-serverless\/blob\/master\/whitepaper\/cncf_serverless_whitepaper_v1.0.pdf. Accessed 2018-07--29.  CNCF Serverless WG. 2018. CNCF WG-Serverless Whitepaper v1.0. https:\/\/github.com\/cncf\/wg-serverless\/blob\/master\/whitepaper\/cncf_serverless_whitepaper_v1.0.pdf. Accessed 2018-07--29."}],"event":{"name":"ICPE '20: ACM\/SPEC International Conference on Performance Engineering","location":"Edmonton AB Canada","acronym":"ICPE '20","sponsor":["SIGMETRICS ACM Special Interest Group on Measurement and Evaluation","SIGSOFT ACM Special Interest Group on Software Engineering"]},"container-title":["Companion of the ACM\/SPEC International Conference on Performance Engineering"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3375555.3384381","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3375555.3384381","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:38:14Z","timestamp":1750199894000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3375555.3384381"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,4,20]]},"references-count":14,"alternative-id":["10.1145\/3375555.3384381","10.1145\/3375555"],"URL":"https:\/\/doi.org\/10.1145\/3375555.3384381","relation":{},"subject":[],"published":{"date-parts":[[2020,4,20]]},"assertion":[{"value":"2020-04-20","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}