{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,1]],"date-time":"2025-11-01T16:47:13Z","timestamp":1762015633955,"version":"3.41.0"},"reference-count":65,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2019,6,26]],"date-time":"2019-06-26T00:00:00Z","timestamp":1561507200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61572373, 61472290, 60903035"],"award-info":[{"award-number":["61572373, 61472290, 60903035"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"National High Technology Research and Development Program of China","award":["2017YFC08038, 2013AA12A301"],"award-info":[{"award-number":["2017YFC08038, 2013AA12A301"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Storage"],"published-print":{"date-parts":[[2019,8,31]]},"abstract":"<jats:p>The relatively high cost of record deserialization is increasingly becoming the bottleneck of column-based storage systems in tree-structured applications [58]. Due to record transformation in the storage layer, unnecessary processing costs derived from fields and rows irrelevant to queries may be very heavy in nested schemas, significantly wasting the computational resources in large-scale analytical workloads. This leads to the question of how to reduce both the deserialization and IO costs of queries with highly selective filters following arbitrary paths in a nested schema.<\/jats:p>\n          <jats:p>We present CORES (Column-Oriented Regeneration Embedding Scheme) to push highly selective filters down into column-based storage engines, where each filter consists of several filtering conditions on a field. By applying highly selective filters in the storage layer, we demonstrate that both the deserialization and IO costs could be significantly reduced. We show how to introduce fine-grained composition on filtering results. We generalize this technique by two pair-wise operations, rollup and drilldown, such that a series of conjunctive filters can effectively deliver their payloads in nested schema. The proposed methods are implemented on an open-source platform. For practical purposes, we highlight how to build a column storage engine and how to drive a query efficiently based on a cost model. We apply this design to the nested relational model especially when hierarchical entities are frequently required by ad hoc queries. The experiments, including a real workload and the modified TPCH benchmark, demonstrate that CORES improves the performance by 0.7\u00d7--26.9\u00d7 compared to state-of-the-art platforms in scan-intensive workloads.<\/jats:p>","DOI":"10.1145\/3321704","type":"journal-article","created":{"date-parts":[[2019,6,26]],"date-time":"2019-06-26T12:36:24Z","timestamp":1561552584000},"page":"1-46","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["CORES"],"prefix":"10.1145","volume":"15","author":[{"given":"Weidong","family":"Wen","sequence":"first","affiliation":[{"name":"School of Computer, Wuhan University, Wuhan, Hubei, PR China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yang","family":"Li","sequence":"additional","affiliation":[{"name":"School of Computer, Wuhan University, Wuhan, Hubei, PR China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wenhai","family":"Li","sequence":"additional","affiliation":[{"name":"School of Computer, Wuhan University, Wuhan, Hubei, PR China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lingfeng","family":"Deng","sequence":"additional","affiliation":[{"name":"School of Computer, Wuhan University, Wuhan, Hubei, PR China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yanxiang","family":"He","sequence":"additional","affiliation":[{"name":"School of Computer, Wuhan University, Wuhan, Hubei, PR China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2019,6,26]]},"reference":[{"volume-title":"Retrieved","year":"2017","key":"e_1_2_1_1_1"},{"volume-title":"Retrieved","year":"2017","key":"e_1_2_1_2_1"},{"volume-title":"Retrieved","year":"2017","key":"e_1_2_1_3_1"},{"volume-title":"Retrieved","year":"2017","key":"e_1_2_1_4_1"},{"volume-title":"Retrieved","year":"2018","key":"e_1_2_1_5_1"},{"volume-title":"Retrieved","year":"2018","key":"e_1_2_1_6_1"},{"volume-title":"Retrieved","year":"2017","key":"e_1_2_1_7_1"},{"volume-title":"Retrieved","year":"2018","author":"Li Yang","key":"e_1_2_1_8_1"},{"volume-title":"Retrieved","year":"2018","author":"NCBI.","key":"e_1_2_1_9_1"},{"volume-title":"Retrieved","year":"2017","author":"TPC.","key":"e_1_2_1_10_1"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.14778\/2732977.2732987"},{"volume-title":"Hill","year":"2002","author":"Ailamaki Anastassia","key":"e_1_2_1_12_1"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.14778\/2733085.2733096"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.14778\/2732951.2732958"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.14778\/2536222.2536233"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.5555\/645910.673450"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2503210.2503278"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/304181.304214"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/1534912.1534915"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/1142473.1142527"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2011.5767921"},{"volume-title":"Proceedings of the International Workshop on the Web and Databases. 1--16","author":"Chasseur C.","key":"e_1_2_1_22_1"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3177918"},{"volume-title":"Proceedings of the IEEE International Conference on Data Engineering. 30--35","author":"Douglas","key":"e_1_2_1_24_1"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1561\/1900000004"},{"volume-title":"Proceedings of the USENIX Symposium on Operating Systems Design and Implementation. 10","year":"2004","author":"Dean Jeffrey","key":"e_1_2_1_26_1"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/69.273029"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.14778\/2732977.2733002"},{"volume-title":"Proceedings of the USENIX Conference on File and Storage Technologies.","year":"2017","author":"Gracia-Tinedo Ra\u00fal","key":"e_1_2_1_29_1"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2011.73"},{"volume-title":"Proceedings of the IEEE International Conference on Big Data.","author":"Jia Jianfeng","key":"e_1_2_1_31_1"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.14778\/2536274.2536333"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2015.7113373"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.14778\/2367502.2367518"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/2633691"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2938503.2938515"},{"volume-title":"Proceedings of the USENIX Conference on File and Storage Technologies. 285--299","author":"Liu Hang","key":"e_1_2_1_37_1"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/2588555.2595628"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2013.6544836"},{"key":"e_1_2_1_40_1","unstructured":"Sagar S. Mane and M. Emmanuel. 2015. Review and comparative study of bitmap indexing techniques. Data Mining Knowl. Eng. 7 1 (2015).  Sagar S. Mane and M. Emmanuel. 2015. Review and comparative study of bitmap indexing techniques. Data Mining Knowl. Eng. 7 1 (2015)."},{"key":"e_1_2_1_41_1","first-page":"114","article-title":"Dremel: Interactive analysis of web-scale datasets","volume":"3","author":"Melnik Sergey","year":"2010","journal-title":"Commun. ACM"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/308386.308402"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/38713.38737"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/49346.49347"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.5555\/645604.662607"},{"volume-title":"Proceedings of the International Conference on Very Large Data Bases. 137--146","year":"1987","author":"Scholl Marc H.","key":"e_1_2_1_46_1"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.14778\/3007263.3007311"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.14778\/2536222.2536232"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1109\/MSST.2010.5496972"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/3092696"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.5555\/646290.687051"},{"volume-title":"Proceedings of the International Conference on Very Large Data Bases. 553--564","year":"2005","author":"Stonebraker Mike","key":"e_1_2_1_52_1"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.14778\/2733004.2733044"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/3177917"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/2588555.2612183"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2012.26"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/2627692.2627706"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/3035918.3035956"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.5555\/1364813.1364815"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/2665067"},{"volume-title":"Accelerating big data analytics on HPC clusters using two-level storage. Parallel Comput. 61","year":"2016","author":"Xuan Pengfei","key":"e_1_2_1_61_1"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1109\/69.755617"},{"volume-title":"Proceedings of the USENIX Symposium on Operating Systems Design and Implementation. 1--14","year":"2009","author":"Yu Yuan","key":"e_1_2_1_63_1"},{"volume-title":"Proceedings of the USENIX Symposium on Operating Systems Design and Implementation. 2.","year":"2012","author":"Zaharia Matei","key":"e_1_2_1_64_1"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2015.2499199"}],"container-title":["ACM Transactions on Storage"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3321704","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3321704","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:54:39Z","timestamp":1750204479000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3321704"}},"subtitle":["Towards Scan-Optimized Columnar Storage for Nested Records"],"short-title":[],"issued":{"date-parts":[[2019,6,26]]},"references-count":65,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2019,8,31]]}},"alternative-id":["10.1145\/3321704"],"URL":"https:\/\/doi.org\/10.1145\/3321704","relation":{},"ISSN":["1553-3077","1553-3093"],"issn-type":[{"type":"print","value":"1553-3077"},{"type":"electronic","value":"1553-3093"}],"subject":[],"published":{"date-parts":[[2019,6,26]]},"assertion":[{"value":"2018-04-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-03-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-06-26","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}