{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,9,19]],"date-time":"2025-09-19T09:17:22Z","timestamp":1758273442013},"reference-count":32,"publisher":"Association for Computing Machinery (ACM)","issue":"12","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. VLDB Endow."],"published-print":{"date-parts":[[2018,8]]},"abstract":"<jats:p>Huawei Fusion Insight Libr A (FI-MPPDB) is a petabyte scale enterprise analytics platform developed by the Huawei data-base group. It started as a prototype more than five years ago, and is now being used by many enterprise customers over the globe, including some of the world's largest financial institutions. Our product direction and enhancements have been mainly driven by customer requirements in the fast evolving Chinese market.<\/jats:p>\n          <jats:p>This paper describes the architecture of FI-MPPDB and some of its major enhancements. In particular, we focus on top four requirements from our customers related to data analytics on the cloud: system availability, auto tuning, query over heterogeneous data models on the cloud, and the ability to utilize powerful modern hardware for good performance. We present our latest advancements in the above areas including online expansion, auto tuning in query optimizer, SQL on HDFS, and intelligent JIT compiled execution. Finally, we present some experimental results to demonstrate the effectiveness of these technologies.<\/jats:p>","DOI":"10.14778\/3229863.3229870","type":"journal-article","created":{"date-parts":[[2018,9,10]],"date-time":"2018-09-10T12:12:28Z","timestamp":1536581548000},"page":"1822-1834","source":"Crossref","is-referenced-by-count":11,"title":["Fusion insight librA"],"prefix":"10.14778","volume":"11","author":[{"given":"Le","family":"Cai","sequence":"first","affiliation":[{"name":"Huawei America Research"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jianjun","family":"Chen","sequence":"additional","affiliation":[{"name":"Huawei America Research"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jun","family":"Chen","sequence":"additional","affiliation":[{"name":"Huawei America Research"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yu","family":"Chen","sequence":"additional","affiliation":[{"name":"Huawei America Research"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kuorong","family":"Chiang","sequence":"additional","affiliation":[{"name":"Huawei America Research"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Marko","family":"Dimitrijevic","sequence":"additional","affiliation":[{"name":"Huawei America Research"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yonghua","family":"Ding","sequence":"additional","affiliation":[{"name":"Huawei America Research"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yu","family":"Dong","sequence":"additional","affiliation":[{"name":"Huawei America Research"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ahmad","family":"Ghazal","sequence":"additional","affiliation":[{"name":"Huawei America Research"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jacques","family":"Hebert","sequence":"additional","affiliation":[{"name":"Huawei America Research"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kamini","family":"Jagtiani","sequence":"additional","affiliation":[{"name":"Huawei America Research"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Suzhen","family":"Lin","sequence":"additional","affiliation":[{"name":"Huawei America Research"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ye","family":"Liu","sequence":"additional","affiliation":[{"name":"Huawei America Research"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Demai","family":"Ni","sequence":"additional","affiliation":[{"name":"Huawei America Research"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chunfeng","family":"Pei","sequence":"additional","affiliation":[{"name":"Huawei America Research"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jason","family":"Sun","sequence":"additional","affiliation":[{"name":"Huawei America Research"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yongyan","family":"Wang","sequence":"additional","affiliation":[{"name":"Huawei America Research"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Li","family":"Zhang","sequence":"additional","affiliation":[{"name":"Huawei America Research"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mingyi","family":"Zhang","sequence":"additional","affiliation":[{"name":"Huawei America Research"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Cheng","family":"Zhu","sequence":"additional","affiliation":[{"name":"Huawei America Research"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2018,8]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"Amazon Athena - Amazon. https:\/\/aws.amazon.com\/athena\/.  Amazon Athena - Amazon. https:\/\/aws.amazon.com\/athena\/."},{"key":"e_1_2_1_2_1","unstructured":"Amazon Redshift - Amazon. https:\/\/aws.amazon.com\/redshift\/.  Amazon Redshift - Amazon. https:\/\/aws.amazon.com\/redshift\/."},{"key":"e_1_2_1_3_1","unstructured":"Amazon Redshift Spectrum - Amazon. https:\/\/aws.amazon.com\/redshift\/spectrum\/.  Amazon Redshift Spectrum - Amazon. https:\/\/aws.amazon.com\/redshift\/spectrum\/."},{"key":"e_1_2_1_4_1","unstructured":"Apache - HBase. https:\/\/hbase.apache.org\/.  Apache - HBase. https:\/\/hbase.apache.org\/."},{"key":"e_1_2_1_5_1","unstructured":"Apache - Hive. https:\/\/hive.apache.org\/.  Apache - Hive. https:\/\/hive.apache.org\/."},{"key":"e_1_2_1_6_1","unstructured":"Apache - ORC. https:\/\/orc.apache.org\/.  Apache - ORC. https:\/\/orc.apache.org\/."},{"key":"e_1_2_1_7_1","unstructured":"Apache - Parquet. https:\/\/parquet.apache.org\/.  Apache - Parquet. https:\/\/parquet.apache.org\/."},{"key":"e_1_2_1_8_1","unstructured":"Apache HAWQ - Apache. http:\/\/spark.apache.org\/sql\/.  Apache HAWQ - Apache. http:\/\/spark.apache.org\/sql\/."},{"key":"e_1_2_1_9_1","unstructured":"FusionInsight MPPDB - Huawei. http:\/\/e.huawei.com\/us\/products\/cloud-computing-dc\/cloud-computing\/bigdata\/fusioninsight.  FusionInsight MPPDB - Huawei. http:\/\/e.huawei.com\/us\/products\/cloud-computing-dc\/cloud-computing\/bigdata\/fusioninsight."},{"key":"e_1_2_1_10_1","unstructured":"Greenplum Database - Pivotal. http:\/\/www.greenplum.com.  Greenplum Database - Pivotal. http:\/\/www.greenplum.com."},{"key":"e_1_2_1_11_1","unstructured":"Hadoop - Apache. http:\/\/hadoop.apache.org\/.  Hadoop - Apache. http:\/\/hadoop.apache.org\/."},{"key":"e_1_2_1_12_1","unstructured":"MemSQL. https:\/\/www.memsql.com\/.  MemSQL. https:\/\/www.memsql.com\/."},{"key":"e_1_2_1_13_1","unstructured":"Oracle Autonomous Database Strategy White Paper. http:\/\/www.oracle.com\/us\/products\/database\/autonomous-database-strategy-wp-4124741.pdf.  Oracle Autonomous Database Strategy White Paper. http:\/\/www.oracle.com\/us\/products\/database\/autonomous-database-strategy-wp-4124741.pdf."},{"key":"e_1_2_1_14_1","unstructured":"Postgres-XC. https:\/\/sourceforge.net\/projects\/postgres-xc\/.  Postgres-XC. https:\/\/sourceforge.net\/projects\/postgres-xc\/."},{"key":"e_1_2_1_15_1","unstructured":"Snowflake - Snowflake. https:\/\/www.snowflake.net\/.  Snowflake - Snowflake. https:\/\/www.snowflake.net\/."},{"key":"e_1_2_1_16_1","unstructured":"Spark SQL & DataFrames - Apache. http:\/\/spark.apache.org\/sql\/.  Spark SQL & DataFrames - Apache. http:\/\/spark.apache.org\/sql\/."},{"key":"e_1_2_1_17_1","unstructured":"Transwarp Inceptor. http:\/\/www.transwarp.cn\/.  Transwarp Inceptor. http:\/\/www.transwarp.cn\/."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/B978-012088469-8.50097-8"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3035918.3064029"},{"issue":"12","key":"e_1_2_1_20_1","first-page":"1249","volume":"4","author":"Cohen J.","year":"2011","journal-title":"Online Expansion of Large-scale Data Warehouses. In PVLDB"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDEW.2012.45"},{"key":"e_1_2_1_22_1","volume-title":"Adaptive Query Optimization in PostgreSQL. In PGCon 2017 Conference","author":"Ivanov O.","year":"2017"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/1995441.1995446"},{"key":"e_1_2_1_24_1","volume-title":"In Proc. CIDR15","author":"Kornacker M.","year":"2015"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.5555\/2886444.2886453"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1014333932021"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.14778\/2002938.2002940"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.14778\/2733004.2733023"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/2213836.2213953"},{"key":"e_1_2_1_30_1","volume-title":"Proceedings of the 27th VLDB Conference","author":"Stillger M.","year":"2001"},{"key":"e_1_2_1_31_1","volume-title":"Beyond Conventional Data Warehousing -Massively Parallel Data Processing with Greenplum Database. In In Proc. BIRTE","author":"Waas F.","year":"2008"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3003665.3003669"}],"container-title":["Proceedings of the VLDB Endowment"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.14778\/3229863.3229870","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,28]],"date-time":"2022-12-28T10:10:31Z","timestamp":1672222231000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.14778\/3229863.3229870"}},"subtitle":["huawei's enterprise cloud data analytics platform"],"short-title":[],"issued":{"date-parts":[[2018,8]]},"references-count":32,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2018,8]]}},"alternative-id":["10.14778\/3229863.3229870"],"URL":"https:\/\/doi.org\/10.14778\/3229863.3229870","relation":{},"ISSN":["2150-8097"],"issn-type":[{"value":"2150-8097","type":"print"}],"subject":[],"published":{"date-parts":[[2018,8]]}}}