{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,9,17]],"date-time":"2025-09-17T16:32:37Z","timestamp":1758126757563},"reference-count":33,"publisher":"Association for Computing Machinery (ACM)","issue":"12","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. VLDB Endow."],"published-print":{"date-parts":[[2022,8]]},"abstract":"<jats:p>Unlike traditional database systems where data and system availability are tied together, there is a wide class of systems targeting realtime monitoring and analytics over structured logs where these properties can be decoupled. In these systems, responsiveness and freshness of data are often more important than perfectly complete answers. One such system is Meta's Scuba [2].<\/jats:p>\n          <jats:p>Historically, Scuba has favored system availability along with speed and freshness of results over data completeness and durability. While these choices allowed Scuba to grow from terabyte scale to petabyte scale and continue onboarding a variety of use cases, they also came at an operational cost of dealing with incomplete data and managing data loss.<\/jats:p>\n          <jats:p>\n            In this paper, we present the next generation of Scuba's architecture, codenamed\n            <jats:italic>Kraken<\/jats:italic>\n            , which decouples storage management from the query serving system and introduces a single, durable source of truth. This enables tangible improvements to system fault tolerance and query performance while still respecting tolerable bounds of client observed data freshness. We also describe the journey of how we deployed Kraken into full production as we gradually turned off the older system with no user-visible down time.\n          <\/jats:p>","DOI":"10.14778\/3554821.3554841","type":"journal-article","created":{"date-parts":[[2022,9,29]],"date-time":"2022-09-29T22:28:39Z","timestamp":1664490519000},"page":"3522-3534","source":"Crossref","is-referenced-by-count":3,"title":["Meta's next-generation realtime monitoring and analytics platform"],"prefix":"10.14778","volume":"15","author":[{"given":"Stavros","family":"Harizopoulos","sequence":"first","affiliation":[{"name":"Meta Platforms, Inc."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Taylor","family":"Hopper","sequence":"additional","affiliation":[{"name":"Meta Platforms, Inc."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Morton","family":"Mo","sequence":"additional","affiliation":[{"name":"Meta Platforms, Inc."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shyam Sundar","family":"Chandrasekaran","sequence":"additional","affiliation":[{"name":"Meta Platforms, Inc."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tongguang","family":"Chen","sequence":"additional","affiliation":[{"name":"Meta Platforms, Inc."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yan","family":"Cui","sequence":"additional","affiliation":[{"name":"Meta Platforms, Inc."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nandini","family":"Ganesh","sequence":"additional","affiliation":[{"name":"Meta Platforms, Inc."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gary","family":"Helmling","sequence":"additional","affiliation":[{"name":"Meta Platforms, Inc."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hieu","family":"Pham","sequence":"additional","affiliation":[{"name":"Meta Platforms, Inc."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sebastian","family":"Wong","sequence":"additional","affiliation":[{"name":"Meta Platforms, Inc."}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,9,29]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1561\/1900000024"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.14778\/2536222.2536231"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.14778\/3476311.3476377"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/2829988.2790038"},{"key":"e_1_2_1_5_1","volume-title":"Nikita Mikhaylin, Hung ching Lee, Xiaoyan Zhao, Guanzhong Xu, Luis Antonio Perez, Farhad Shahmohammadi, Tran Bui, Neil McKay, Vera Lychagina, and Brett Elliott.","author":"Chattopadhyay Biswapesh","year":"2019","unstructured":"Biswapesh Chattopadhyay , Priyam Dutta , Weiran Liu , Ott Tinn , Andrew McCormick , Aniket Mokashi , Paul Harvey , Hector Gonzalez , David Lomax , Sagar Mittal , Roee Aharon Ebenstein , Nikita Mikhaylin, Hung ching Lee, Xiaoyan Zhao, Guanzhong Xu, Luis Antonio Perez, Farhad Shahmohammadi, Tran Bui, Neil McKay, Vera Lychagina, and Brett Elliott. 2019 . Procella : Unifying serving and analytical data at YouTube. PVLDB 12(12) (2019), 2022--2034. https:\/\/dl.acm.org\/citation.cfm?id=3360438 Biswapesh Chattopadhyay, Priyam Dutta, Weiran Liu, Ott Tinn, Andrew McCormick, Aniket Mokashi, Paul Harvey, Hector Gonzalez, David Lomax, Sagar Mittal, Roee Aharon Ebenstein, Nikita Mikhaylin, Hung ching Lee, Xiaoyan Zhao, Guanzhong Xu, Luis Antonio Perez, Farhad Shahmohammadi, Tran Bui, Neil McKay, Vera Lychagina, and Brett Elliott. 2019. Procella: Unifying serving and analytical data at YouTube. PVLDB 12(12) (2019), 2022--2034. https:\/\/dl.acm.org\/citation.cfm?id=3360438"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/1559845.1559945"},{"key":"e_1_2_1_7_1","unstructured":"ClickHouse. 2022. ClickHouse - Fast Open-Source OLAP DBMS. https:\/\/web.archive.org\/web\/20220621010451\/https:\/\/clickhouse.com\/.  ClickHouse. 2022. ClickHouse - Fast Open-Source OLAP DBMS. https:\/\/web.archive.org\/web\/20220621010451\/https:\/\/clickhouse.com\/."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2882903.2903741"},{"key":"e_1_2_1_9_1","volume-title":"Elasticsearch: The Official Distributed Search & Analytics Engine | Elastic. https:\/\/web.archive.org\/web\/20220602153647\/https:\/\/www.elastic.co\/elasticsearch\/.","year":"2022","unstructured":"Elasticsearch. 2022 . Elasticsearch: The Official Distributed Search & Analytics Engine | Elastic. https:\/\/web.archive.org\/web\/20220602153647\/https:\/\/www.elastic.co\/elasticsearch\/. Elasticsearch. 2022. Elasticsearch: The Official Distributed Search & Analytics Engine | Elastic. https:\/\/web.archive.org\/web\/20220602153647\/https:\/\/www.elastic.co\/elasticsearch\/."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.14778\/1687553.1687567"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2588555.2595642"},{"key":"e_1_2_1_12_1","unstructured":"Google. 2022. BigQuery: Cloud Data Warehouse | Google Cloud. https:\/\/web.archive.org\/web\/20220602225903\/https:\/\/cloud.google.com\/bigquery\/.  Google. 2022. BigQuery: Cloud Data Warehouse | Google Cloud. https:\/\/web.archive.org\/web\/20220602225903\/https:\/\/cloud.google.com\/bigquery\/."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2723372.2742795"},{"key":"e_1_2_1_14_1","volume-title":"Proceedings of the 2010 USENIX Conference on USENIX Annual Technical Conference","author":"Hunt Patrick","year":"2010","unstructured":"Patrick Hunt , Mahadev Konar , Flavio P. Junqueira , and Benjamin Reed . 2010 . ZooKeeper: Wait-Free Coordination for Internet-Scale Systems . In Proceedings of the 2010 USENIX Conference on USENIX Annual Technical Conference ( Boston, MA) (USENIXATC'10). USENIX Association, USA, 11. Patrick Hunt, Mahadev Konar, Flavio P. Junqueira, and Benjamin Reed. 2010. ZooKeeper: Wait-Free Coordination for Internet-Scale Systems. In Proceedings of the 2010 USENIX Conference on USENIX Annual Technical Conference (Boston, MA) (USENIXATC'10). USENIX Association, USA, 11."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3183713.3190661"},{"key":"e_1_2_1_16_1","volume-title":"Scribe: Transporting petabytes per hour via a distributed, buffered queueing system. https:\/\/engineering.fb.com\/2019\/10\/07\/data-infrastructure\/scribe\/","author":"Karpathiotakis Manolis","year":"2020","unstructured":"Manolis Karpathiotakis , Dino Wernli , and Milos Stojanovic . 2020 . Scribe: Transporting petabytes per hour via a distributed, buffered queueing system. https:\/\/engineering.fb.com\/2019\/10\/07\/data-infrastructure\/scribe\/ Manolis Karpathiotakis, Dino Wernli, and Milos Stojanovic. 2020. Scribe: Transporting petabytes per hour via a distributed, buffered queueing system. https:\/\/engineering.fb.com\/2019\/10\/07\/data-infrastructure\/scribe\/"},{"key":"e_1_2_1_17_1","volume-title":"Impala: A Modern, Open-Source SQL Engine for Hadoop. In Seventh Biennial Conference on Innovative Data Systems Research, CIDR","author":"Kornacker Marcel","year":"2015","unstructured":"Marcel Kornacker , Alexander Behm , Victor Bittorf , Taras Bobrovytsky , Casey Ching , Alan Choi , Justin Erickson , Martin Grund , Daniel Hecht , Matthew Jacobs , Ishaan Joshi , Lenni Kuff , Dileep Kumar , Alex Leblang , Nong Li , Ippokratis Pandis , Henry Robinson , David Rorke , Silvius Rus , John Russell , Dimitris Tsirogiannis , Skye Wanderman-Milne , and Michael Yoder . 2015 . Impala: A Modern, Open-Source SQL Engine for Hadoop. In Seventh Biennial Conference on Innovative Data Systems Research, CIDR 2015, Asilomar, CA , USA, January 4--7, 2015, Online Proceedings . www.cidrdb.org. http:\/\/cidrdb.org\/cidr2015\/Papers\/CIDR15_Paper28.pdf Marcel Kornacker, Alexander Behm, Victor Bittorf, Taras Bobrovytsky, Casey Ching, Alan Choi, Justin Erickson, Martin Grund, Daniel Hecht, Matthew Jacobs, Ishaan Joshi, Lenni Kuff, Dileep Kumar, Alex Leblang, Nong Li, Ippokratis Pandis, Henry Robinson, David Rorke, Silvius Rus, John Russell, Dimitris Tsirogiannis, Skye Wanderman-Milne, and Michael Yoder. 2015. Impala: A Modern, Open-Source SQL Engine for Hadoop. In Seventh Biennial Conference on Innovative Data Systems Research, CIDR 2015, Asilomar, CA, USA, January 4--7, 2015, Online Proceedings. www.cidrdb.org. http:\/\/cidrdb.org\/cidr2015\/Papers\/CIDR15_Paper28.pdf"},{"key":"e_1_2_1_18_1","volume-title":"Proceedings of NetDB'11 the 6th Workshop on Networking Meets Databases. Association for Computing Machinery","author":"Kreps Jay","year":"2011","unstructured":"Jay Kreps , Neha Narkhede , and Jun Rao . 2011 . Kafka: a Distributed Messaging System for Log Processing . In Proceedings of NetDB'11 the 6th Workshop on Networking Meets Databases. Association for Computing Machinery , New York, NY, USA. https:\/\/books.google.com\/books?id=QRecswEACAAJ Jay Kreps, Neha Narkhede, and Jun Rao. 2011. Kafka: a Distributed Messaging System for Log Processing. In Proceedings of NetDB'11 the 6th Workshop on Networking Meets Databases. Association for Computing Machinery, New York, NY, USA. https:\/\/books.google.com\/books?id=QRecswEACAAJ"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.14778\/2367502.2367518"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3477132.3483546"},{"key":"e_1_2_1_21_1","unstructured":"Mark Marchukov. 2018. LogDevice: A distributed data store for logs. https:\/\/engineering.fb.com\/2017\/08\/31\/core-data\/logdevice-a-distributed-data-store-for-logs\/  Mark Marchukov. 2018. LogDevice: A distributed data store for logs. https:\/\/engineering.fb.com\/2017\/08\/31\/core-data\/logdevice-a-distributed-data-store-for-logs\/"},{"key":"e_1_2_1_22_1","unstructured":"Sarang Masti. 2021. How we built a general purpose key value store for Facebook with zippydb. https:\/\/engineering.fb.com\/2021\/08\/06\/core-data\/zippydb\/  Sarang Masti. 2021. How we built a general purpose key value store for Facebook with zippydb. https:\/\/engineering.fb.com\/2021\/08\/06\/core-data\/zippydb\/"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE48307.2020.00141"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.14778\/1920841.1920886"},{"key":"e_1_2_1_25_1","unstructured":"Guido Moerkotte. 1998. Small Materialized Aggregates: A Light Weight Index Structure for Data Warehousing. In VLDB.  Guido Moerkotte. 1998. Small Materialized Aggregates: A Light Weight Index Structure for Data Warehousing. In VLDB."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.14778\/2824032.2824078"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.14778\/3229863.3229871"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2019.00196"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/2815400.2815401"},{"key":"e_1_2_1_30_1","volume-title":"Rockset: Real-time analytics at Cloud Scale. https:\/\/web.archive.org\/web\/20220602005913\/https:\/\/rockset.com\/.","author":"Venkataramani Venkat","year":"2022","unstructured":"Venkat Venkataramani and Dhruba Borthakur . 2022 . Rockset: Real-time analytics at Cloud Scale. https:\/\/web.archive.org\/web\/20220602005913\/https:\/\/rockset.com\/. Venkat Venkataramani and Dhruba Borthakur. 2022. Rockset: Real-time analytics at Cloud Scale. https:\/\/web.archive.org\/web\/20220602005913\/https:\/\/rockset.com\/."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-03422-0_7"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/2588555.2595631"},{"key":"e_1_2_1_33_1","volume-title":"11th Conference on Innovative Data Systems Research, CIDR 2021, Virtual Event, January 11--15, 2021, Online Proceedings. www.cidrdb.org. http:\/\/cidrdb.org\/cidr2021\/papers\/cidr2021_paper17","author":"Zaharia Matei","year":"2021","unstructured":"Matei Zaharia , Ali Ghodsi 0002, Reynold Xin , and Michael Armbrust . 2021 . Lakehouse: A New Generation of Open Platforms that Unify Data Warehousing and Advanced Analytics . In 11th Conference on Innovative Data Systems Research, CIDR 2021, Virtual Event, January 11--15, 2021, Online Proceedings. www.cidrdb.org. http:\/\/cidrdb.org\/cidr2021\/papers\/cidr2021_paper17 .pdf Matei Zaharia, Ali Ghodsi 0002, Reynold Xin, and Michael Armbrust. 2021. Lakehouse: A New Generation of Open Platforms that Unify Data Warehousing and Advanced Analytics. In 11th Conference on Innovative Data Systems Research, CIDR 2021, Virtual Event, January 11--15, 2021, Online Proceedings. www.cidrdb.org. http:\/\/cidrdb.org\/cidr2021\/papers\/cidr2021_paper17.pdf"}],"container-title":["Proceedings of the VLDB Endowment"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.14778\/3554821.3554841","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,28]],"date-time":"2022-12-28T11:28:34Z","timestamp":1672226914000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.14778\/3554821.3554841"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8]]},"references-count":33,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2022,8]]}},"alternative-id":["10.14778\/3554821.3554841"],"URL":"https:\/\/doi.org\/10.14778\/3554821.3554841","relation":{},"ISSN":["2150-8097"],"issn-type":[{"value":"2150-8097","type":"print"}],"subject":[],"published":{"date-parts":[[2022,8]]}}}