{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,8]],"date-time":"2026-05-08T22:37:07Z","timestamp":1778279827914,"version":"3.51.4"},"reference-count":46,"publisher":"Association for Computing Machinery (ACM)","issue":"4","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. VLDB Endow."],"published-print":{"date-parts":[[2016,11]]},"abstract":"<jats:p>As data volumes continue to grow, modern database systems increasingly rely on data skipping mechanisms to improve performance by avoiding access to irrelevant data. Recent work [39] proposed a fine-grained partitioning scheme that was shown to improve the opportunities for data skipping in row-oriented systems. Modern analytics and big data systems increasingly adopt columnar storage schemes, and in such systems, a row-based approach misses important opportunities for further improving data skipping. The flexibility of column-oriented organizations, however, comes with the additional cost of tuple reconstruction. In this paper, we develop Generalized Skipping-Oriented Partitioning (GSOP), a novel hybrid data skipping framework that takes into account these row-based and column-based tradeoffs. In contrast to previous column-oriented physical design work, GSOP considers the tradeoffs between horizontal data skipping and vertical partitioning jointly. Our experiments using two public benchmarks and a real-world workload show that GSOP can significantly reduce the amount of data scanned and improve end-to-end query response times over the state-of-the- art techniques.<\/jats:p>","DOI":"10.14778\/3025111.3025123","type":"journal-article","created":{"date-parts":[[2017,1,24]],"date-time":"2017-01-24T15:29:41Z","timestamp":1485271781000},"page":"421-432","source":"Crossref","is-referenced-by-count":40,"title":["Skipping-oriented partitioning for columnar layouts"],"prefix":"10.14778","volume":"10","author":[{"given":"Liwen","family":"Sun","sequence":"first","affiliation":[{"name":"University of California Berkeley"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michael J.","family":"Franklin","sequence":"additional","affiliation":[{"name":"University of California Berkeley"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jiannan","family":"Wang","sequence":"additional","affiliation":[{"name":"Simon Fraser University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Eugene","family":"Wu","sequence":"additional","affiliation":[{"name":"Columbia University"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2016,11]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"Apache Drill. https:\/\/drill.apache.org.  Apache Drill. https:\/\/drill.apache.org."},{"key":"e_1_2_1_2_1","unstructured":"Apache Parquet. http:\/\/parquet.apache.org.  Apache Parquet. http:\/\/parquet.apache.org."},{"key":"e_1_2_1_3_1","unstructured":"Big Data Benchmark. amplab.cs.berkeley.edu\/benchmark.  Big Data Benchmark. amplab.cs.berkeley.edu\/benchmark."},{"key":"e_1_2_1_4_1","unstructured":"CasJobs. http:\/\/skyserver.sdss.org\/casjobs\/.  CasJobs. http:\/\/skyserver.sdss.org\/casjobs\/."},{"key":"e_1_2_1_5_1","unstructured":"Sloan Digital Sky Surveys. http:\/\/www.sdss.org.  Sloan Digital Sky Surveys. http:\/\/www.sdss.org."},{"key":"e_1_2_1_6_1","unstructured":"TPC-H. http:\/\/www.tpc.org\/tpch.  TPC-H. http:\/\/www.tpc.org\/tpch."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00778-002-0074-9"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2723372.2742795"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.14778\/2350229.2350259"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2038916.2038937"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.14778\/2367502.2367518"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2007.367892"},{"key":"e_1_2_1_13_1","first-page":"487","volume-title":"VLDB","author":"Agrawal R.","year":"1994","unstructured":"R. Agrawal and R. Srikant . Fast algorithms for mining association rules in large databases . In VLDB , pages 487 -- 499 , 1994 . R. Agrawal and R. Srikant. Fast algorithms for mining association rules in large databases. In VLDB, pages 487--499, 1994."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2588555.2610502"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.5555\/1315451.1315534"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2882903.2903741"},{"key":"e_1_2_1_17_1","first-page":"225","volume-title":"CIDR","author":"Boncz P. A.","year":"2005","unstructured":"P. A. Boncz , M. Zukowski , and N. Nes . MonetDB\/X100: Hyper-pipelining query execution . In CIDR , pages 225 -- 237 , 2005 . P. A. Boncz, M. Zukowski, and N. Nes. MonetDB\/X100: Hyper-pipelining query execution. In CIDR, pages 225--237, 2005."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.14778\/1920841.1920853"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/1142473.1142548"},{"key":"e_1_2_1_20_1","volume-title":"The design and implementation of modern column-oriented database systems. Foundations and Trends in Databases, 5(3)","author":"Abadi D.","year":"2013","unstructured":"D. Abadi The design and implementation of modern column-oriented database systems. Foundations and Trends in Databases, 5(3) , 2013 . D. Abadi et al. The design and implementation of modern column-oriented database systems. Foundations and Trends in Databases, 5(3), 2013."},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.14778\/1454159.1454174"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.14778\/1988776.1988778"},{"key":"e_1_2_1_23_1","first-page":"68","volume-title":"CIDR","author":"Idreos S.","year":"2007","unstructured":"S. Idreos , M. L. Kersten , and S. Manegold . Database cracking . In CIDR , pages 68 -- 78 , 2007 . S. Idreos, M. L. Kersten, and S. Manegold. Database cracking. In CIDR, pages 68--78, 2007."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/1559845.1559878"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.14778\/2536336.2536338"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/2723372.2742797"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.14778\/1921071.1921077"},{"key":"e_1_2_1_28_1","first-page":"553","volume-title":"VLDB","author":"Stonebraker M.","year":"2005","unstructured":"M. Stonebraker : A column-oriented DBMS . In VLDB , pages 553 -- 564 , 2005 . M. Stonebraker et al. C-store: A column-oriented DBMS. In VLDB, pages 553--564, 2005."},{"key":"e_1_2_1_29_1","first-page":"2","volume-title":"NSDI","author":"Zaharia M.","year":"2012","unstructured":"M. Zaharia Resilient distributed datasets: a fault-tolerant abstraction for in-memory cluster computing . In NSDI , pages 2 -- 2 , 2012 . M. Zaharia et al. Resilient distributed datasets: a fault-tolerant abstraction for in-memory cluster computing. In NSDI, pages 2--2, 2012."},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/1457150.1457160"},{"key":"e_1_2_1_31_1","first-page":"476","volume-title":"VLDB","author":"Moerkotte G.","year":"1998","unstructured":"G. Moerkotte . Small materialized aggregates: A light weight index for data warehousing . In VLDB , pages 476 -- 487 , 1998 . G. Moerkotte. Small materialized aggregates: A light weight index for data warehousing. In VLDB, pages 476--487, 1998."},{"key":"e_1_2_1_32_1","first-page":"417","volume-title":"VLDB","author":"Hankins R.","year":"2003","unstructured":"R. Hankins : An adaptive, cache-conscious storage technique . In VLDB , pages 417 -- 428 . VLDB Endowment , 2003 . R. Hankins et al. Data morphing: An adaptive, cache-conscious storage technique. In VLDB, pages 417--428. VLDB Endowment, 2003."},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/564691.564757"},{"key":"e_1_2_1_34_1","first-page":"496","volume-title":"VLDB","author":"Agarwal S.","year":"2000","unstructured":"S. Agarwal Automated selection of materialized views and indexes in SQL databases . In VLDB , pages 496 -- 505 , 2000 . S. Agarwal et al. Automated selection of materialized views and indexes in SQL databases. In VLDB, pages 496--505, 2000."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/1007568.1007609"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.14778\/1920841.1920886"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.5555\/998688.1007145"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.14778\/2732228.2732229"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2588555.2610515"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.14778\/2536222.2536233"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2011.5767933"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.14778\/2556549.2556559"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/2588555.2595630"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/2588555.2595628"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/2213836.2213839"},{"key":"e_1_2_1_46_1","first-page":"22","volume-title":"IDEAS","author":"Zhou J.","year":"2003","unstructured":"J. Zhou and K. Ross . A multi-resolution block storage model for database design . In IDEAS , pages 22 -- 31 , July 2003 . J. Zhou and K. Ross. A multi-resolution block storage model for database design. In IDEAS, pages 22--31, July 2003."}],"container-title":["Proceedings of the VLDB Endowment"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.14778\/3025111.3025123","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,28]],"date-time":"2022-12-28T10:20:18Z","timestamp":1672222818000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.14778\/3025111.3025123"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,11]]},"references-count":46,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2016,11]]}},"alternative-id":["10.14778\/3025111.3025123"],"URL":"https:\/\/doi.org\/10.14778\/3025111.3025123","relation":{},"ISSN":["2150-8097"],"issn-type":[{"value":"2150-8097","type":"print"}],"subject":[],"published":{"date-parts":[[2016,11]]}}}