{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,29]],"date-time":"2026-10-29T01:05:46Z","timestamp":1793235946878,"version":"4.5.0"},"reference-count":38,"publisher":"Association for Computing Machinery (ACM)","issue":"5","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. VLDB Endow."],"published-print":{"date-parts":[[2024,1]]},"abstract":"<jats:p>In this paper, we propose, HyBench, a new benchmark for HTAP databases. First, we generate the testing data by simulating a representative HTAP application. We particularly develop a time-dependent generation phase and an anomaly generation phase for testing HTAP with large cardinality and various anomalies. Second, we propose a set of hybrid workloads. Specifically, we design 18 read\/write transactions, 13 analytical queries, and a mix workload of 6 analytical transactions and 6 interactive queries. We also develop a graph-based parameter curation method to control the access patterns including skew access and data contention of the hybrid workload. Third, we propose a unified metric for quantifying the overall HTAP performance. Particularly, we introduce a query-driven method that evaluates the data freshness (lag time between analytics and transactions). Then we introduce a three-phase execution rule to compute a unified metric, combining the performance of OLTP (TPS), OLAP (QPS), and OLXP (XPS) and data freshness. To verify the effectiveness of HyBench and to debunk the myth of different HTAP architectures, extensive experiments have been conducted over five HTAP databases.<\/jats:p>","DOI":"10.14778\/3641204.3641206","type":"journal-article","created":{"date-parts":[[2024,5,2]],"date-time":"2024-05-02T18:05:43Z","timestamp":1714673143000},"page":"939-951","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":37,"title":["HyBench: A New Benchmark for HTAP Databases"],"prefix":"10.14778","volume":"17","author":[{"given":"Chao","family":"Zhang","sequence":"first","affiliation":[{"name":"Tsinghua University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Guoliang","family":"Li","sequence":"additional","affiliation":[{"name":"Tsinghua University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tao","family":"Lv","sequence":"additional","affiliation":[{"name":"China Software Testing Center"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2024,5,2]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"TPCTC (Lecture Notes in Computer Science)","author":"Boncz Peter A.","unstructured":"Peter A. Boncz, Thomas Neumann, and Orri Erling. 2013. TPC-H Analyzed: Hidden Messages and Lessons Learned from an Influential Benchmark. In TPCTC (Lecture Notes in Computer Science), Vol. 8391. Springer, 61--76."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3030207.3030228"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/1988842.1988850"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/1807128.1807152"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.14778\/3389133.3389138"},{"key":"e_1_2_1_6_1","doi-asserted-by":"crossref","unstructured":"Orri Erling Alex Averbuch Josep Larriba-Pey Hassan Chafi Andrey Gubichev Arnau Prat Minh-Duc Pham and Peter Boncz. 2015. The LDBC social network benchmark: Interactive workload. In SIGMOD. 619--630.","DOI":"10.1145\/2723372.2742786"},{"key":"e_1_2_1_7_1","unstructured":"Google AlloyDB. 2023. AlloyDB Omni overview. https:\/\/cloud.google.com\/alloydb\/docs\/omni"},{"key":"e_1_2_1_8_1","doi-asserted-by":"crossref","unstructured":"Jim Gray. 1993. Database and Transaction Processing Performance Handbook.","DOI":"10.1145\/130283.130288"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3340531.3412174"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.14778\/3415478.3415535"},{"key":"e_1_2_1_11_1","volume-title":"Semantically Consistent, and Domain-specific are Essential in Benchmarking, Designing, and Implementing HTAP Systems","author":"Kang Guoxin","year":"1822","unstructured":"Guoxin Kang, Lei Wang, Wanling Gao, Fei Tang, and Jianfeng Zhan. 2022. OLxP-Bench: Real-time, Semantically Consistent, and Domain-specific are Essential in Benchmarking, Designing, and Implementing HTAP Systems. In ICDE. IEEE, 1822--1834."},{"key":"e_1_2_1_12_1","doi-asserted-by":"crossref","unstructured":"Tirthankar Lahiri Shasank Chavan Maria Colgan Dinesh Das Amit Ganesh Mike Gleeson Sanket Hase Allison Holloway Jesse Kamp Teck-Hua Lee et al. 2015. Oracle Database In-Memory: A Dual Format In-Memory Database. In ICDE. IEEE 1253--1258.","DOI":"10.1109\/ICDE.2015.7113373"},{"key":"e_1_2_1_13_1","first-page":"1740","article-title":"Real-Time Analytical Processing with SQL Server","volume":"8","author":"Larson Per-\u00c5ke","year":"2015","unstructured":"Per-\u00c5ke Larson, Adrian Birka, Eric N Hanson, Weiyun Huang, Michal Nowakiewicz, and Vassilis Papadimos. 2015. Real-Time Analytical Processing with SQL Server. VLDB 8, 12 (2015), 1740--1751.","journal-title":"VLDB"},{"key":"e_1_2_1_14_1","first-page":"3758","article-title":"Cloud Databases: New Techniques, Challenges, and Opportunities","volume":"15","author":"Li Guoliang","year":"2022","unstructured":"Guoliang Li, Haowen Dong, and Chao Zhang. 2022. Cloud Databases: New Techniques, Challenges, and Opportunities. VLDB 15, 12 (2022), 3758--3761.","journal-title":"VLDB"},{"key":"e_1_2_1_15_1","doi-asserted-by":"crossref","unstructured":"Guoliang Li and Chao Zhang. 2022. HTAP Databases: What is New and What is Next. In SIGMOD. 2483--2488.","DOI":"10.1145\/3514221.3522565"},{"key":"e_1_2_1_16_1","volume-title":"CIKM. ACM","author":"Liu Ziqi","year":"2018","unstructured":"Ziqi Liu, Chaochao Chen, Xinxing Yang, Jun Zhou, Xiaolong Li, and Le Song. 2018. Heterogeneous Graph Neural Networks for Malicious Account Detection. In CIKM. ACM, 2077--2085."},{"key":"e_1_2_1_17_1","volume-title":"How a little ant challenges giant banks? The rise of Ant Financial (Alipay)'s fintech empire and relevant regulatory concerns","author":"Lerong Lu.","year":"2018","unstructured":"Lerong Lu. 2018. How a little ant challenges giant banks? The rise of Ant Financial (Alipay)'s fintech empire and relevant regulatory concerns. International Company and Commercial Law Review (2018), Sweet & Maxwell, ISSN (2018), 0958--5214."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3514221.3526148"},{"key":"e_1_2_1_19_1","unstructured":"MySQL 8.0. 2023. Consistent Nonlocking Reads. https:\/\/dev.mysql.com\/doc\/refman\/8.0\/en\/innodb-consistent-read.html"},{"key":"e_1_2_1_20_1","unstructured":"MySQL Heatwave. 2021. Real-time Analytics for MySQL Database Service."},{"key":"e_1_2_1_21_1","doi-asserted-by":"crossref","unstructured":"Thomas Neumann Tobias M\u00fchlbauer and Alfons Kemper. 2015. Fast Serializable Multi-Version Concurrency Control for Main-Memory Database Systems. In SIGMOD. 677--689.","DOI":"10.1145\/2723372.2749436"},{"key":"e_1_2_1_22_1","volume-title":"TPCTC (Lecture Notes in Computer Science)","author":"O'Neil Patrick E.","unstructured":"Patrick E. O'Neil, Elizabeth J. O'Neil, Xuedong Chen, and Stephen Revilak. 2009. The Star Schema Benchmark and Augmented Fact Table Indexing. In TPCTC (Lecture Notes in Computer Science), Vol. 5895. Springer, 237--252."},{"key":"e_1_2_1_23_1","unstructured":"Oracle 21c. 2023. Automating Management of In-Memory Objects. https:\/\/docs.oracle.com\/en\/database\/oracle\/oracle-database\/21\/inmem\/configuring-memory-management.html"},{"key":"e_1_2_1_24_1","first-page":"1080","article-title":"DB2 with BLU Acceleration: So Much More Than Just A Column Store","volume":"6","author":"Raman Vijayshankar","year":"2013","unstructured":"Vijayshankar Raman, Gopi Attaluri, Ronald Barber, Naresh Chainani, David Kalmuk, Vincent KulandaiSamy, Jens Leenstra, Sam Lightstone, Shaorong Liu, Guy M Lohman, et al. 2013. DB2 with BLU Acceleration: So Much More Than Just A Column Store. VLDB 6, 11 (2013), 1080--1091.","journal-title":"VLDB"},{"key":"e_1_2_1_25_1","volume-title":"Angelos Christos Anadiotis, and Anastasia Ailamaki","author":"Raza Aunn","year":"2020","unstructured":"Aunn Raza, Periklis Chrysogelos, Angelos Christos Anadiotis, and Anastasia Ailamaki. 2020. Adaptive HTAP Through Elastic Resource Scheduling. In SIGMOD. 2043--2054."},{"key":"e_1_2_1_26_1","volume-title":"Thomas Peh, and Christof Bornh\u00f6vd.","author":"Sikka Vishal","year":"2012","unstructured":"Vishal Sikka, Franz F\u00e4rber, Wolfgang Lehner, Sang Kyun Cha, Thomas Peh, and Christof Bornh\u00f6vd. 2012. Efficient Transaction Processing in SAP HANA Database: The End of A Column Store Myth. In SIGMOD. 731--742."},{"key":"e_1_2_1_27_1","unstructured":"Snowflake Unistore. 2022. Getting Started with Transactional and Analytical data in Snowflake."},{"key":"e_1_2_1_28_1","unstructured":"Tecent. 2021. WeBank. https:\/\/segmentfault.com\/a\/1190000040792825\/en"},{"key":"e_1_2_1_29_1","unstructured":"Tecent. 2023. WeBank. https:\/\/www.webank.com\/en\/product\/000001"},{"key":"e_1_2_1_30_1","unstructured":"Tecent. 2023. WeBank. https:\/\/www.webank.com\/en\/characteristic\/tech\/bigdata"},{"key":"e_1_2_1_31_1","unstructured":"Transaction Processing Performance Council. 2021. TPC-C."},{"key":"e_1_2_1_32_1","unstructured":"Transaction Processing Performance Council. 2021. TPC-H."},{"key":"e_1_2_1_33_1","unstructured":"Wikipedia. 2023. David DeWitt. https:\/\/en.wikipedia.org\/wiki\/David_DeWitt"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.14778\/3415478.3415553"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.14778\/3554821.3554830"},{"key":"e_1_2_1_36_1","volume-title":"32nd International Conference on Scientific and Statistical Database Management (SSDBM). 1--12","author":"Zhang Chao","year":"2020","unstructured":"Chao Zhang and Jiaheng Lu. 2020. Selectivity estimation for relation-tree joins. In 32nd International Conference on Scientific and Statistical Database Management (SSDBM). 1--12."},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10619-019-07279-6"},{"key":"e_1_2_1_38_1","volume-title":"TPCTC","volume":"11135","author":"Zhang Chao","year":"2018","unstructured":"Chao Zhang, Jiaheng Lu, Pengfei Xu, and Yuxing Chen. 2018. UniBench: A Benchmark for Multi-model Database Management Systems. In TPCTC, Vol. 11135. Springer, 7--23."}],"container-title":["Proceedings of the VLDB Endowment"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.14778\/3641204.3641206","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,5,2]],"date-time":"2024-05-02T18:09:31Z","timestamp":1714673371000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.14778\/3641204.3641206"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,1]]},"references-count":38,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2024,1]]}},"alternative-id":["10.14778\/3641204.3641206"],"URL":"https:\/\/doi.org\/10.14778\/3641204.3641206","relation":{},"ISSN":["2150-8097"],"issn-type":[{"value":"2150-8097","type":"print"}],"subject":[],"published":{"date-parts":[[2024,1]]},"assertion":[{"value":"2024-05-02","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}