{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,9]],"date-time":"2025-12-09T15:48:21Z","timestamp":1765295301761,"version":"3.40.3"},"publisher-location":"Cham","reference-count":37,"publisher":"Springer International Publishing","isbn-type":[{"type":"print","value":"9783030783068"},{"type":"electronic","value":"9783030783075"}],"license":[{"start":{"date-parts":[[2021,7,1]],"date-time":"2021-07-01T00:00:00Z","timestamp":1625097600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,7,1]],"date-time":"2021-07-01T00:00:00Z","timestamp":1625097600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2022]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Serverless computing has become very popular today since it largely simplifies cloud programming. Developers do no longer need to worry about provisioning or operating servers, and they have to pay only for the compute resources used when their code is run. This new cloud paradigm suits well for many applications, and researchers have already begun investigating the feasibility of serverless computing for data analytics. Unfortunately, today\u2019s serverless computing presents important limitations that make it really difficult to support all sorts of analytics workloads. This chapter first starts by analyzing three fundamental trade-offs of today\u2019s serverless computing model and their relationship with data analytics. It studies how by relaxing disaggregation, isolation, and simple scheduling, it is possible to increase the overall computing performance, but at the expense of essential aspects of the model such as elasticity, security, or sub-second activations, respectively. The consequence of these trade-offs is that analytics applications may well end up embracing hybrid systems composed of serverless and serverful components, which we call <jats:italic>ServerMix<\/jats:italic> in this chapter. We will review the existing related work to show that most applications can be actually categorized as <jats:italic>ServerMix<\/jats:italic>.<\/jats:p>","DOI":"10.1007\/978-3-030-78307-5_3","type":"book-chapter","created":{"date-parts":[[2022,4,28]],"date-time":"2022-04-28T07:03:15Z","timestamp":1651129395000},"page":"41-61","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Trade-Offs and Challenges of Serverless Data Analytics"],"prefix":"10.1007","author":[{"given":"Pedro","family":"Garc\u00eda-L\u00f3pez","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Marc","family":"S\u00e1nchez-Artigas","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Simon","family":"Shillaker","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Peter","family":"Pietzuch","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"David","family":"Breitgand","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gil","family":"Vernik","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Pierre","family":"Sutra","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tristan","family":"Tarrant","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ana","family":"Juan-Ferrer","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gerard","family":"Par\u00eds","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2021,7,1]]},"reference":[{"key":"3_CR1","unstructured":"Akkus, I. E., Chen, R., Rimac, I., Stein, M., Satzke, K., Beck, A., Aditya, P., & Hilt, V. (2018). SAND: Towards high-performance serverless computing. In 2018 USENIX annual technical conference (ATC\u201918), (pp. 923\u2013935)."},{"key":"3_CR2","doi-asserted-by":"crossref","unstructured":"Al-Ali, Z., Goodarzy, S., Hunter, E., Ha, S., Han, R., Keller, E., & Rozner, E. (2018). Making serverless computing more serverless. In IEEE 11th international conference on cloud computing (CLOUD\u201918), (pp. 456\u2013459).","DOI":"10.1109\/CLOUD.2018.00064"},{"key":"3_CR3","unstructured":"Amazon: AWS lambda limits (2019). https:\/\/docs.aws.amazon.com\/lambda\/latest\/dg\/limits.html\/"},{"key":"3_CR4","doi-asserted-by":"crossref","unstructured":"Attiya, H., & Welch, J. L. (1991). Sequential consistency versus linearizability (extended abstract). In Proceedings of the third annual ACM symposium on parallel algorithms and architectures (SPAA \u201991), (pp. 304\u2013315).","DOI":"10.1145\/113379.113407"},{"key":"3_CR5","doi-asserted-by":"crossref","unstructured":"Barcelona-Pons, D., S\u00e1nchez-Artigas, M., Par\u00eds, G., Sutra, P., & Garc\u00eda-L\u00f3pez, P. (2019). On the faas track: Building stateful distributed applications with serverless architectures. In Proceedings of the 20th international middleware conference (pp. 41\u201354).","DOI":"10.1145\/3361525.3361535"},{"key":"3_CR6","unstructured":"Boucher, S., Kalia, A., Andersen, D. G., & Kaminsky, M. (2018). Putting the micro back in microservice. In 2018 USENIX annual technical conference (ATC \u201918) (pp. 645\u2013650)."},{"key":"3_CR7","unstructured":"Carreira, J., Fonseca, P., Tumanov, A., Zhang, A. M., & Katz, R. (2018). A case for serverless machine learning. In: Workshop on systems for ML and open source software at NeurIPS."},{"key":"3_CR8","unstructured":"H2020 CloudButton (2019) Serverless data analytics. http:\/\/cloudbutton.eu"},{"key":"3_CR9","unstructured":"Fastly: Fastly Labs\u2014Terrarium (2019). https:\/\/www.fastlylabs.com\/"},{"key":"3_CR10","unstructured":"Fouladi, S., Wahby, R. S., Shacklett, B., Balasubramaniam, K. V., Zeng, W., Bhalerao, R., Sivaraman, A., Porter, G., & Winstein, K. (2017). Encoding, fast and slow: Low-latency video processing using thousands of tiny threads. In Proceedings of the 14th USENIX symposium on networked systems design and implementation (NSDI\u201917) (pp. 363\u2013376)."},{"key":"3_CR11","unstructured":"Fouladi, S., Romero, F., Iter, D., Li, Q., Chatterjee, S., Kozyrakis, C., Zaharia, M., & Winstein, K. (2019). From laptop to lambda: Outsourcing everyday jobs to thousands of transient functional containers. In 2019 USENIX Annual Technical Conference (ATC\u201919) (pp. 475\u2013488)."},{"key":"3_CR12","unstructured":"Gao, P. X., Narayan, A., Karandikar, S., Carreira, J., Han, S., Agarwal, R., Ratnasamy, S., & Shenker, S. (2016). Network requirements for resource disaggregation. In Proceedings of the 12th USENIX conference on operating systems design and implementation (OSDI\u201916) (pp. 249\u2013264)."},{"key":"3_CR13","unstructured":"Garc\u00eda-L\u00f3pez, P., Slominski, A., Shillaker, S., Behrendt, M., & Metzler, B. (2020). Serverless end game: Disaggregation enabling transparency. arXiv preprint arXiv:2006.01251."},{"key":"3_CR14","unstructured":"Gu, J., Lee, Y., Zhang, Y., Chowdhury, M., & Shin, K.G. (2017). Efficient memory disaggregation with infiniswap. In 14th USENIX conference on networked systems design and implementation (NSDI\u201917) (pp. 649\u2013667)."},{"key":"3_CR15","doi-asserted-by":"crossref","unstructured":"Haas, A., Rossberg, A., Schuff, D. L., Titzer, B. L., Holman, M., Gohman, D., Wagner, L., Zakai, A., & Bastien, J. (2017). Bringing the web up to speed with webassembly. In Proceedings of the 38th ACM SIGPLAN conference on programming language design and implementation (PLDI\u201917) (pp. 185\u2013200).","DOI":"10.1145\/3062341.3062363"},{"key":"3_CR16","doi-asserted-by":"crossref","unstructured":"Haas, A., Rossberg, A., Schuff, D. L., Titzer, B. L., Holman, M., Gohman, D., Wagner, L., Zakai, A., & Bastien, J. (2017). Bringing the web up to speed with WebAssembly. In Proceedings of the 38th ACM SIGPLAN conference on programming language design and implementation (PLDI\u201917) (pp. 185\u2013200).","DOI":"10.1145\/3062341.3062363"},{"key":"3_CR17","unstructured":"Hellerstein, J. M., Faleiro, J., Gonzalez, J. E., Schleier-Smith, J., Sreekanti, V., Tumanov, A., & Wu, C. (2019). Serverless computing: One step forward, two steps back. In Conference on innovative data systems research (CIDR\u201919)."},{"issue":"4","key":"3_CR18","doi-asserted-by":"publisher","first-page":"6","DOI":"10.1109\/MIC.2018.043051460","volume":"22","author":"Z Istvan","year":"2018","unstructured":"Istvan, Z., Sidler, D., & Alonso, G. (2018). Active pages 20 years later: Active storage for the cloud. IEEE Internet Computing, 22(4), 6\u201314.","journal-title":"IEEE Internet Computing"},{"key":"3_CR19","doi-asserted-by":"crossref","unstructured":"Jonas, E., Pu, Q., Venkataraman, S., Stoica, I., & Recht, B. (2017). Occupy the cloud: Distributed computing for the 99%. In Proceedings of the 2017 symposium on cloud computing (SoCC\u201917) (pp. 445\u2013451).","DOI":"10.1145\/3127479.3128601"},{"key":"3_CR20","volume-title":"Cloud programming simplified: A Berkeley view on serverless computing","author":"E Jonas","year":"2019","unstructured":"Jonas, E., et al. (2019). Cloud programming simplified: A Berkeley view on serverless computing. https:\/\/arxiv.org\/abs\/1902.03383"},{"key":"3_CR21","doi-asserted-by":"crossref","unstructured":"Kim, Y., & Lin, J. (2018). Serverless data analytics with Flint. CoRR abs\/1803.06354. http:\/\/arxiv.org\/abs\/1803.06354","DOI":"10.1109\/CLOUD.2018.00063"},{"key":"3_CR22","unstructured":"Klimovic, A., Wang, Y., Stuedi, P., Trivedi, A., Pfefferle, J., & Kozyrakis, C. (2018). Pocket: Elastic ephemeral storage for serverless analytics. In Proceedings of the 13th USENIX symposium on operating systems design and implementation (OSDI\u201918) (pp. 427\u2013444)."},{"key":"3_CR23","doi-asserted-by":"crossref","unstructured":"Lamport, L. (1998). The part-time parliament. ACM Transactions on Computer Systems, 16(2), 133\u2013169. doi: http:\/\/doi.acm.org\/10.1145\/279227.279229","DOI":"10.1145\/279227.279229"},{"key":"3_CR24","doi-asserted-by":"crossref","unstructured":"L\u00f3pez, P. G., Arjona, A., Samp\u00e9, J., Slominski, A., Villard, L. (2020). Triggerflow: Trigger-based orchestration of serverless workflows. In: Proceedings of the 14th ACM international conference on distributed and event-based systems (pp. 3\u201314).","DOI":"10.1145\/3401025.3401731"},{"key":"3_CR25","doi-asserted-by":"crossref","unstructured":"Manco, F., Lupu, C., Schmidt, F., Mendes, J., Kuenzer, S., Sati, S., Yasukata, K., Raiciu, C., & Huici, F. (2017). My VM is lighter (and safer) than your container. In Proceedings of the 26th symposium on operating systems principles (SOSP \u201917) (pp. 218\u2013233).","DOI":"10.1145\/3132747.3132763"},{"key":"3_CR26","unstructured":"Oakes, E., Yang, L., Zhou, D., Houck, K., Harter, T., Arpaci-Dusseau, A., & Arpaci-Dusseau, R. (2018). SOCK: Rapid task provisioning with serverless-optimized containers. In: 2018 USENIX annual technical conference (ATC\u201918) (pp. 57\u201370)."},{"key":"3_CR27","unstructured":"Ongaro, D., & Ousterhout, J.K. (2014). In search of an understandable consensus algorithm. In 2014 USENIX conference on USENIX annual technical conference (ATC\u201914) (pp. 305\u2013319)."},{"key":"3_CR28","unstructured":"Pu, Q., Venkataraman, S., & Stoica, I. (2019). Shuffling, fast and slow: Scalable analytics on serverless infrastructure. In: Proceedings of the 16th USENIX symposium on networked systems design and implementation (NSDI\u201919) (pp. 193\u2013206)."},{"key":"3_CR29","unstructured":"Riedel, E., Gibson, G. A., Faloutsos, C. (1998). Active storage for large-scale data mining and multimedia. In Proceedings of the 24rd international conference on very large data bases (VLDB\u201998) (pp. 62\u201373)."},{"key":"3_CR30","series-title":"In Proceedings of the 18th ACM\/IFIP\/USENIX middleware conference (pp. 121\u2013133)","doi-asserted-by":"publisher","DOI":"10.1145\/3135974.3135980","volume-title":"Data-driven serverless functions for object storage","author":"J Samp\u00e9","year":"2017","unstructured":"Samp\u00e9, J., S\u00e1nchez-Artigas, M., Garc\u00eda-L\u00f3pez, P., & Par\u00eds, G. (2017). Data-driven serverless functions for object storage. In Proceedings of the 18th ACM\/IFIP\/USENIX middleware conference (pp. 121\u2013133). ACM, New York."},{"key":"3_CR31","series-title":"In Proceedings of the 19th international middleware conference industry, Middleware \u201918 (pp. 1\u20138)","doi-asserted-by":"publisher","DOI":"10.1145\/3284028.3284029","volume-title":"Serverless data analytics in the IBM Cloud","author":"J Samp\u00e9","year":"2018","unstructured":"Samp\u00e9, J., Vernik, G., S\u00e1nchez-Artigas, M., & Garc\u00eda-L\u00f3pez, P. (2018). Serverless data analytics in the IBM Cloud. In Proceedings of the 19th international middleware conference industry, Middleware \u201918 (pp. 1\u20138). ACM, New York."},{"key":"3_CR32","doi-asserted-by":"publisher","first-page":"68","DOI":"10.1109\/MS.2020.3029994","volume":"38","author":"J Samp\u00e9","year":"2021","unstructured":"Samp\u00e9, J., Garc\u00eda-L\u00f3pez, P., S\u00e1nchez-Artigas, M., Vernik, G., Roca-Llaberia, P., & Arjona, A. (2021). Toward multicloud access transparency in serverless computing. IEEE Software, 38, 68\u201374.","journal-title":"IEEE Software"},{"key":"3_CR33","unstructured":"Shankar, V., Krauth, K., Pu, Q., Jonas, E., Venkataraman, S., Stoica, I., Recht, B., & Ragan-Kelley, J. (2018). Numpywren: Serverless linear algebra. CoRR abs\/1810.09679."},{"key":"3_CR34","unstructured":"Shillaker, S., & Pietzuch, P. (2020). Faasm: Lightweight isolation for efficient stateful serverless computing. arXiv preprint arXiv:2002.09344."},{"key":"3_CR35","unstructured":"Wada, H., Fekete, A., Zhao, L., Lee, K., & Liu, A. (2011). Data consistency properties and the trade-offs in commercial cloud storage: the consumers\u2019 perspective. In Fifth Biennial conference on innovative data systems research (CIDR\u201911) (pp. 134\u2013143)."},{"key":"3_CR36","unstructured":"Zillner, S., Curry, E., Metzger, A., Auer, S., & Seidl, R. (Eds.) (2017). European big data value strategic research & innovation agenda. Big data value association"},{"key":"3_CR37","unstructured":"Zillner, S., et al. (Eds.) (2020). Strategic research, innovation and deployment Agenda\u2014AI, data and robotics partnership. Third Release. BDVA, euRobotics, ELLIS, EurAI and CLAIRE."}],"container-title":["Technologies and Applications for Big Data Value"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/978-3-030-78307-5_3","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,4,28]],"date-time":"2022-04-28T07:06:09Z","timestamp":1651129569000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/978-3-030-78307-5_3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7,1]]},"ISBN":["9783030783068","9783030783075"],"references-count":37,"URL":"https:\/\/doi.org\/10.1007\/978-3-030-78307-5_3","relation":{},"subject":[],"published":{"date-parts":[[2021,7,1]]},"assertion":[{"value":"1 July 2021","order":1,"name":"first_online","label":"First Online","group":{"name":"ChapterHistory","label":"Chapter History"}}]}}