{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,24]],"date-time":"2026-06-24T01:08:24Z","timestamp":1782263304240,"version":"3.54.5"},"reference-count":39,"publisher":"Association for Computing Machinery (ACM)","issue":"12","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. VLDB Endow."],"published-print":{"date-parts":[[2019,8]]},"abstract":"<jats:p>With data explosion in scale and variety, OLAP databases play an increasingly important role in serving real-time analysis with low latency (e.g., hundreds of milliseconds), especially when incoming queries are complex and ad hoc in nature. Moreover, these systems are expected to provide high query concurrency and write throughput, and support queries over structured and complex data types (e.g., JSON, vector and texts).<\/jats:p>\n          <jats:p>In this paper, we introduce AnalyticDB, a real-time OLAP database system developed at Alibaba. AnalyticDB maintains all-column indexes in an asynchronous manner with acceptable overhead, which provides low latency for complex ad-hoc queries. Its storage engine extends hybrid row-column layout for fast retrieval of both structured data and data of complex types. To handle large-scale data with high query concurrency and write throughput, AnalyticDB decouples read and write access paths. To further reduce query latency, novel storage-aware SQL optimizer and execution engine are developed to fully utilize the advantages of the underlying storage and indexes. AnalyticDB has been successfully deployed on Alibaba Cloud to serve numerous customers (both large and small). It is capable of holding 100 trillion rows of records, i.e., 10PB+ in size. At the same time, it is able to serve 10m+ writes and 100k+ queries per second, while completing complex queries within hundreds of milliseconds.<\/jats:p>","DOI":"10.14778\/3352063.3352124","type":"journal-article","created":{"date-parts":[[2019,9,18]],"date-time":"2019-09-18T18:36:11Z","timestamp":1568831771000},"page":"2059-2070","source":"Crossref","is-referenced-by-count":63,"title":["AnalyticDB"],"prefix":"10.14778","volume":"12","author":[{"given":"Chaoqun","family":"Zhan","sequence":"first","affiliation":[{"name":"Alibaba Group"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Maomeng","family":"Su","sequence":"additional","affiliation":[{"name":"Alibaba Group"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chuangxian","family":"Wei","sequence":"additional","affiliation":[{"name":"Alibaba Group"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaoqiang","family":"Peng","sequence":"additional","affiliation":[{"name":"Alibaba Group"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Liang","family":"Lin","sequence":"additional","affiliation":[{"name":"Alibaba Group"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sheng","family":"Wang","sequence":"additional","affiliation":[{"name":"Alibaba Group"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhe","family":"Chen","sequence":"additional","affiliation":[{"name":"Alibaba Group"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Feifei","family":"Li","sequence":"additional","affiliation":[{"name":"Alibaba Group"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yue","family":"Pan","sequence":"additional","affiliation":[{"name":"Alibaba Group"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fang","family":"Zheng","sequence":"additional","affiliation":[{"name":"Alibaba Group"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chengliang","family":"Chai","sequence":"additional","affiliation":[{"name":"Alibaba Group"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2019,8]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"Alibaba Cloud. https:\/\/www.alibabacloud.com.  Alibaba Cloud. https:\/\/www.alibabacloud.com."},{"key":"e_1_2_1_2_1","unstructured":"ANTLR ASM. https:\/\/www.antlr.org.  ANTLR ASM. https:\/\/www.antlr.org."},{"key":"e_1_2_1_3_1","unstructured":"Apache ORC File. https:\/\/orc.apache.org\/.  Apache ORC File. https:\/\/orc.apache.org\/."},{"key":"e_1_2_1_4_1","unstructured":"Benchmarking Nearest Neighbours. https:\/\/github.com\/erikbern\/ann-benchmarks.  Benchmarking Nearest Neighbours. https:\/\/github.com\/erikbern\/ann-benchmarks."},{"key":"e_1_2_1_5_1","unstructured":"Greenplum. https:\/\/greenplum.org\/.  Greenplum. https:\/\/greenplum.org\/."},{"key":"e_1_2_1_6_1","unstructured":"MySQL. https:\/\/www.mysql.com\/.  MySQL. https:\/\/www.mysql.com\/."},{"key":"e_1_2_1_7_1","unstructured":"Pangu. https:\/\/www.alibabacloud.com\/blog\/pangu---the-high-performance-distributed-file-system-by-alibaba-cloud_594059.  Pangu. https:\/\/www.alibabacloud.com\/blog\/pangu---the-high-performance-distributed-file-system-by-alibaba-cloud_594059."},{"key":"e_1_2_1_8_1","unstructured":"PostgreSQL. https:\/\/www.postgresql.org\/.  PostgreSQL. https:\/\/www.postgresql.org\/."},{"key":"e_1_2_1_9_1","unstructured":"Presto. https:\/\/prestodb.io\/.  Presto. https:\/\/prestodb.io\/."},{"key":"e_1_2_1_10_1","unstructured":"Teradata Database. http:\/\/www.teradata.com.  Teradata Database. http:\/\/www.teradata.com."},{"key":"e_1_2_1_11_1","unstructured":"TPC-H Benchmark. http:\/\/www.tpc.org\/tpch\/.  TPC-H Benchmark. http:\/\/www.tpc.org\/tpch\/."},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/1376616.1376712"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2723372.2742797"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/1283920.1283933"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/319996.319998"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/356770.356776"},{"key":"e_1_2_1_17_1","volume-title":"Introduction to algorithms","author":"Cormen T. H.","year":"2009","unstructured":"T. H. Cormen , C. E. Leiserson , R. L. Rivest , and C. Stein . Introduction to algorithms . MIT press , 2009 . T. H. Cormen, C. E. Leiserson, R. L. Rivest, and C. Stein. Introduction to algorithms. MIT press, 2009."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/1327452.1327492"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/974121.974142"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.14778\/1921071.1921077"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2723372.2742795"},{"key":"e_1_2_1_22_1","first-page":"1312","volume-title":"IJCAI","author":"Hajebi K.","year":"2011","unstructured":"K. Hajebi , Y. Abbasi-Yadkori , H. Shahbazi , and H. Zhang . Fast approximate nearest-neighbor search with k-nearest neighbor graph . In IJCAI , pages 1312 -- 1317 , 2011 . K. Hajebi, Y. Abbasi-Yadkori, H. Shahbazi, and H. Zhang. Fast approximate nearest-neighbor search with k-nearest neighbor graph. In IJCAI, pages 1312--1317, 2011."},{"key":"e_1_2_1_23_1","first-page":"487","volume-title":"VLDB","author":"Harizopoulos S.","year":"2006","unstructured":"S. Harizopoulos , V. Liang , D. J. Abadi , and S. Madden . Performance tradeoffs in read-optimized databases . In VLDB , pages 487 -- 498 . VLDB Endowment , 2006 . S. Harizopoulos, V. Liang, D. J. Abadi, and S. Madden. Performance tradeoffs in read-optimized databases. In VLDB, pages 487--498. VLDB Endowment, 2006."},{"key":"e_1_2_1_24_1","volume-title":"USENIX ATC","author":"Hunt P.","year":"2010","unstructured":"P. Hunt , M. Konar , F. P. Junqueira , and B. Reed . Zookeeper: Wait-free coordination for internet-scale systems . In USENIX ATC , volume 8 . Boston, MA , USA , 2010 . P. Hunt, M. Konar, F. P. Junqueira, and B. Reed. Zookeeper: Wait-free coordination for internet-scale systems. In USENIX ATC, volume 8. Boston, MA, USA, 2010."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3183713.3190661"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2010.57"},{"key":"e_1_2_1_27_1","volume-title":"An introduction to Bayesian networks","author":"Jensen F. V.","year":"1996","unstructured":"F. V. Jensen . An introduction to Bayesian networks , volume 210 . UCL press London , 1996 . F. V. Jensen. An introduction to Bayesian networks, volume 210. UCL press London, 1996."},{"key":"e_1_2_1_28_1","first-page":"9","volume-title":"Cidr","volume":"1","author":"Kornacker M.","year":"2015","unstructured":"M. Kornacker , A. Behm , V. Bittorf , T. Bobrovytsky , C. Ching , A. Choi , J. Erickson , M. Grund , D. Hecht , M. Jacobs , : A modern, open-source sql engine for hadoop . In Cidr , volume 1 , page 9 , 2015 . M. Kornacker, A. Behm, V. Bittorf, T. Bobrovytsky, C. Ching, A. Choi, J. Erickson, M. Grund, D. Hecht, M. Jacobs, et al. Impala: A modern, open-source sql engine for hadoop. In Cidr, volume 1, page 9, 2015."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.14778\/2367502.2367518"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/971701.50204"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.14778\/1920841.1920886"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.14778\/2002938.2002940"},{"key":"e_1_2_1_33_1","first-page":"2018","article-title":"An inside look at google bigquery.(2012)","volume":"29","author":"Sato K.","year":"2012","unstructured":"K. Sato . An inside look at google bigquery.(2012) . Retrieved Jan , 29 : 2018 , 2012 . K. Sato. An inside look at google bigquery.(2012). Retrieved Jan, 29:2018, 2012.","journal-title":"Retrieved Jan"},{"key":"e_1_2_1_34_1","first-page":"553","volume-title":"VLDB","author":"Stonebraker M.","year":"2005","unstructured":"M. Stonebraker , D. J. Abadi , A. Batkin , X. Chen , M. Cherniack , M. Ferreira , E. Lau , A. Lin , S. Madden , E. O'Neil , : a column-oriented dbms . In VLDB , pages 553 -- 564 . VLDB Endowment , 2005 . M. Stonebraker, D. J. Abadi, A. Batkin, X. Chen, M. Cherniack, M. Ferreira, E. Lau, A. Lin, S. Madden, E. O'Neil, et al. C-store: a column-oriented dbms. In VLDB, pages 553--564. VLDB Endowment, 2005."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.14778\/1687553.1687609"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2588555.2595631"},{"key":"e_1_2_1_37_1","first-page":"2","volume-title":"NSDI","author":"Zaharia M.","year":"2012","unstructured":"M. Zaharia , M. Chowdhury , T. Das , A. Dave , J. Ma , M. McCauley , M. J. Franklin , S. Shenker , and I. Stoica . Resilient distributed datasets: A fault-tolerant abstraction for in-memory cluster computing . In NSDI , pages 2 -- 2 . USENIX Association , 2012 . M. Zaharia, M. Chowdhury, T. Das, A. Dave, J. Ma, M. McCauley, M. J. Franklin, S. Shenker, and I. Stoica. Resilient distributed datasets: A fault-tolerant abstraction for in-memory cluster computing. In NSDI, pages 2--2. USENIX Association, 2012."},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.14778\/2733004.2733012"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2006.150"}],"container-title":["Proceedings of the VLDB Endowment"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.14778\/3352063.3352124","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,28]],"date-time":"2022-12-28T10:43:42Z","timestamp":1672224222000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.14778\/3352063.3352124"}},"subtitle":["real-time OLAP database system at Alibaba cloud"],"short-title":[],"issued":{"date-parts":[[2019,8]]},"references-count":39,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2019,8]]}},"alternative-id":["10.14778\/3352063.3352124"],"URL":"https:\/\/doi.org\/10.14778\/3352063.3352124","relation":{},"ISSN":["2150-8097"],"issn-type":[{"value":"2150-8097","type":"print"}],"subject":[],"published":{"date-parts":[[2019,8]]}}}