{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,1]],"date-time":"2025-11-01T14:06:16Z","timestamp":1762005976722,"version":"build-2065373602"},"reference-count":43,"publisher":"Association for Computing Machinery (ACM)","issue":"12","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. VLDB Endow."],"published-print":{"date-parts":[[2018,8]]},"abstract":"<jats:p>We describe how we evolve Omid, a transaction processing system for Apache HBase, to power Apache Phoenix, a cloud-grade real-time SQL analytics engine.<\/jats:p>\n          <jats:p>\n            Omid was originally designed for data processing pipelines at Yahoo, which are, by and large, throughput-oriented monolithic NoSQL applications. Providing a platform to support converged real-time transaction processing and analytics applications - dubbed\n            <jats:italic>translytics<\/jats:italic>\n            - introduces new functional and performance requirements. For example, SQL support is key for developer productivity, multi-tenancy is essential for cloud deployment, and latency is cardinal for just-in-time data ingestion and analytics insights.\n          <\/jats:p>\n          <jats:p>\n            We discuss our efforts to adapt Omid to these new domains, as part of the process of integrating it into Phoenix as the transaction processing backend. A central piece of our work is latency reduction in Omid's protocol, which also improves scalability. Under light load, the new protocol's latency is 4x to 5x smaller than the legacy Omid's, whereas under increased loads it is an order of magnitude faster. We further describe a\n            <jats:italic>fast path<\/jats:italic>\n            protocol for single-key transactions, which enables processing them almost as fast as native HBase operations.\n          <\/jats:p>","DOI":"10.14778\/3229863.3229868","type":"journal-article","created":{"date-parts":[[2018,9,10]],"date-time":"2018-09-10T12:12:28Z","timestamp":1536581548000},"page":"1795-1808","source":"Crossref","is-referenced-by-count":6,"title":["Taking omid to the clouds"],"prefix":"10.14778","volume":"11","author":[{"given":"Ohad","family":"Shacham","sequence":"first","affiliation":[{"name":"Yahoo Research"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yonatan","family":"Gottesman","sequence":"additional","affiliation":[{"name":"Yahoo Research"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Aran","family":"Bergman","sequence":"additional","affiliation":[{"name":"Technion"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Edward","family":"Bortnikov","sequence":"additional","affiliation":[{"name":"Yahoo Research"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Eshcar","family":"Hillel","sequence":"additional","affiliation":[{"name":"Yahoo Research"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Idit","family":"Keidar","sequence":"additional","affiliation":[{"name":"Technion and Yahoo Research"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2018,8]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"Amazon EMR. https:\/\/aws.amazon.com\/emr\/.  Amazon EMR. https:\/\/aws.amazon.com\/emr\/."},{"key":"e_1_2_1_2_1","unstructured":"Apache HBase. http:\/\/hbase.apache.org.  Apache HBase. http:\/\/hbase.apache.org."},{"key":"e_1_2_1_3_1","unstructured":"The Apache Hive data warehouse. https:\/\/hive.apache.org.  The Apache Hive data warehouse. https:\/\/hive.apache.org."},{"key":"e_1_2_1_4_1","unstructured":"Apache Impala. https:\/\/impala.apache.org.  Apache Impala. https:\/\/impala.apache.org."},{"key":"e_1_2_1_5_1","unstructured":"Apache Omid. https:\/\/omid.incubator.apache.org\/.  Apache Omid. https:\/\/omid.incubator.apache.org\/."},{"key":"e_1_2_1_6_1","unstructured":"Apache phoenix. https:\/\/phoenix.apache.org.  Apache phoenix. https:\/\/phoenix.apache.org."},{"key":"e_1_2_1_7_1","unstructured":"Chatter. https:\/\/www.salesforce.com\/eu\/products\/chatter\/overview\/.  Chatter. https:\/\/www.salesforce.com\/eu\/products\/chatter\/overview\/."},{"key":"e_1_2_1_8_1","unstructured":"CockroachDB. https:\/\/github.com\/cockroachdb\/cockroach\/blob\/master\/docs\/design.md.  CockroachDB. https:\/\/github.com\/cockroachdb\/cockroach\/blob\/master\/docs\/design.md."},{"key":"e_1_2_1_9_1","unstructured":"Omid-82. https:\/\/issues.apache.org\/jira\/browse\/OMID-82.  Omid-82. https:\/\/issues.apache.org\/jira\/browse\/OMID-82."},{"key":"e_1_2_1_10_1","unstructured":"Omid-90. https:\/\/issues.apache.org\/jira\/browse\/OMID-90.  Omid-90. https:\/\/issues.apache.org\/jira\/browse\/OMID-90."},{"key":"e_1_2_1_11_1","unstructured":"Opentsdb - the scalable time series database. http:\/\/opentsdb.net.  Opentsdb - the scalable time series database. http:\/\/opentsdb.net."},{"key":"e_1_2_1_12_1","unstructured":"Phoenix-3623. https:\/\/issues.apache.org\/jira\/browse\/PHOENIX-3623.  Phoenix-3623. https:\/\/issues.apache.org\/jira\/browse\/PHOENIX-3623."},{"key":"e_1_2_1_13_1","unstructured":"RocksDB. http:\/\/rocksdb.org\/.  RocksDB. http:\/\/rocksdb.org\/."},{"key":"e_1_2_1_14_1","unstructured":"Tephra: Transactions for Apache HBase. https:\/\/tephra.io.  Tephra: Transactions for Apache HBase. https:\/\/tephra.io."},{"key":"e_1_2_1_15_1","unstructured":"The Forrester Wave: Translytical Data Platforms Q4 2017. https:\/\/reprints.forrester.com\/#\/assets\/2\/364\/RES134282\/reports.  The Forrester Wave: Translytical Data Platforms Q4 2017. https:\/\/reprints.forrester.com\/#\/assets\/2\/364\/RES134282\/reports."},{"key":"e_1_2_1_16_1","unstructured":"Who is using Phoenix? https:\/\/phoenix.apache.org\/who_is_using.html.  Who is using Phoenix? https:\/\/phoenix.apache.org\/who_is_using.html."},{"key":"e_1_2_1_17_1","unstructured":"Yahoo Japan: Hortonworks customer profile. https:\/\/hortonworks.com\/customers\/yahoo-japan-corporation\/.  Yahoo Japan: Hortonworks customer profile. https:\/\/hortonworks.com\/customers\/yahoo-japan-corporation\/."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2815400.2815413"},{"key":"e_1_2_1_19_1","first-page":"223","volume-title":"Proceedings of the Conference on Innovative Data system Research (CIDR)","author":"Baker J.","year":"2011"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/2517349.2522732"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/223784.223785"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/1989323.1989438"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/2611354.2611366"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/1365815.1365816"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/1807128.1807152"},{"key":"e_1_2_1_26_1","first-page":"261","volume-title":"10th USENIX Symposium on Operating Systems Design and Implementation (OSDI 12)","author":"Corbett J. C.","year":"2012"},{"key":"e_1_2_1_27_1","first-page":"21","volume-title":"Proceedings of the 2012 USENIX Conference on Annual Technical Conference, USENIX ATC'12","author":"Cowling J.","year":"2012"},{"key":"e_1_2_1_28_1","first-page":"401","volume-title":"11th USENIX Symposium on Networked Systems Design and Implementation (NSDI 14)","author":"Dragojevi\u0107 A.","year":"2014"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/2815400.2815425"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/RELDIS.2005.14"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2342356.2342360"},{"key":"e_1_2_1_32_1","unstructured":"R. Escriva B. Wong and E. G. Sirer. Warp: Lightweight multi-key transactions for key-value stores. CoRR abs\/1509.07815 2015.  R. Escriva B. Wong and E. G. Sirer. Warp: Lightweight multi-key transactions for key-value stores. CoRR abs\/1509.07815 2015."},{"volume-title":"LADIS","year":"2013","author":"Eyal I.","key":"e_1_2_1_33_1"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2014.6816691"},{"key":"e_1_2_1_35_1","unstructured":"J. Gray and A. Reuter. Transaction Processing: Concepts and Techniques. Morgan Kaufmann Publishers Inc. San Francisco CA USA 1st edition 1992.   J. Gray and A. Reuter. Transaction Processing: Concepts and Techniques . Morgan Kaufmann Publishers Inc. San Francisco CA USA 1st edition 1992."},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/191839.191886"},{"key":"e_1_2_1_37_1","doi-asserted-by":"crossref","unstructured":"S. Kulkarni M. Demirbas D. Madeppa B. Avva and M. Leone. Logical physical clocks and consistent snapshots in globally distributed databases. 2014.  S. Kulkarni M. Demirbas D. Madeppa B. Avva and M. Leone. Logical physical clocks and consistent snapshots in globally distributed databases. 2014.","DOI":"10.1007\/978-3-319-14472-6_2"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.14778\/2350229.2350261"},{"volume-title":"9th USENIX Symposium on Operating Systems Design and Implementation (OSDI 10)","year":"2010","author":"Peng D.","key":"e_1_2_1_39_1"},{"volume-title":"15th USENIX Conference on File and Storage Technologies (FAST)","year":"2017","author":"Shacham O.","key":"e_1_2_1_40_1"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.14778\/2536222.2536232"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/2213836.2213838"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/2815400.2815419"}],"container-title":["Proceedings of the VLDB Endowment"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.14778\/3229863.3229868","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,28]],"date-time":"2022-12-28T10:07:18Z","timestamp":1672222038000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.14778\/3229863.3229868"}},"subtitle":["fast, scalable transactions for real-time cloud analytics"],"short-title":[],"issued":{"date-parts":[[2018,8]]},"references-count":43,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2018,8]]}},"alternative-id":["10.14778\/3229863.3229868"],"URL":"https:\/\/doi.org\/10.14778\/3229863.3229868","relation":{},"ISSN":["2150-8097"],"issn-type":[{"type":"print","value":"2150-8097"}],"subject":[],"published":{"date-parts":[[2018,8]]}}}