{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,17]],"date-time":"2026-06-17T16:21:24Z","timestamp":1781713284843,"version":"3.54.5"},"reference-count":23,"publisher":"Association for Computing Machinery (ACM)","issue":"1-2","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. VLDB Endow."],"published-print":{"date-parts":[[2010,9]]},"abstract":"<jats:p>Dremel is a scalable, interactive ad-hoc query system for analysis of read-only nested data. By combining multi-level execution trees and columnar data layout, it is capable of running aggregation queries over trillion-row tables in seconds. The system scales to thousands of CPUs and petabytes of data, and has thousands of users at Google. In this paper, we describe the architecture and implementation of Dremel, and explain how it complements MapReduce-based computing. We present a novel columnar storage representation for nested records and discuss experiments on few-thousand node instances of the system.<\/jats:p>","DOI":"10.14778\/1920841.1920886","type":"journal-article","created":{"date-parts":[[2014,6,24]],"date-time":"2014-06-24T12:17:57Z","timestamp":1403612277000},"page":"330-339","source":"Crossref","is-referenced-by-count":484,"title":["Dremel"],"prefix":"10.14778","volume":"3","author":[{"given":"Sergey","family":"Melnik","sequence":"first","affiliation":[{"name":"Google, Inc."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andrey","family":"Gubarev","sequence":"additional","affiliation":[{"name":"Google, Inc."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jing Jing","family":"Long","sequence":"additional","affiliation":[{"name":"Google, Inc."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Geoffrey","family":"Romer","sequence":"additional","affiliation":[{"name":"Google, Inc."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shiva","family":"Shivakumar","sequence":"additional","affiliation":[{"name":"Google, Inc."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Matt","family":"Tolton","sequence":"additional","affiliation":[{"name":"Google, Inc."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Theo","family":"Vassilakis","sequence":"additional","affiliation":[{"name":"Google, Inc."}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2010,9]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Column-Oriented Database Systems. VLDB, 2(2)","author":"Abadi D. J.","year":"2009","unstructured":"D. J. Abadi , P. A. Boncz , and S. Harizopoulos . Column-Oriented Database Systems. VLDB, 2(2) , 2009 . D. J. Abadi, P. A. Boncz, and S. Harizopoulos. Column-Oriented Database Systems. VLDB, 2(2), 2009."},{"key":"e_1_2_1_2_1","volume-title":"Foundations of Databases","author":"Abiteboul S.","year":"1995","unstructured":"S. Abiteboul , R. Hull , and V. Vianu . Foundations of Databases . Addison Wesley , 1995 . S. Abiteboul, R. Hull, and V. Vianu. Foundations of Databases. Addison Wesley, 1995."},{"key":"e_1_2_1_3_1","volume-title":"HadoopDB: An Architectural Hybrid of MapReduce and DBMS Technologies for Analytical Workloads. VLDB, 2(1)","author":"Abouzeid A.","year":"2009","unstructured":"A. Abouzeid , K. Bajda-Pawlikowski , D. J. Abadi , A. Rasin , and A. Silberschatz . HadoopDB: An Architectural Hybrid of MapReduce and DBMS Technologies for Analytical Workloads. VLDB, 2(1) , 2009 . A. Abouzeid, K. Bajda-Pawlikowski, D. J. Abadi, A. Rasin, and A. Silberschatz. HadoopDB: An Architectural Hybrid of MapReduce and DBMS Technologies for Analytical Workloads. VLDB, 2(1), 2009."},{"key":"e_1_2_1_4_1","first-page":"1","volume-title":"RANDOM","author":"Bar-Yossef Z.","year":"2002","unstructured":"Z. Bar-Yossef , T. S. Jayram , R. Kumar , D. Sivakumar , and L. Trevisan . Counting Distinct Elements in a Data Stream . In RANDOM , pages 1 -- 10 , 2002 . Z. Bar-Yossef, T. S. Jayram, R. Kumar, D. Sivakumar, and L. Trevisan. Counting Distinct Elements in a Data Stream. In RANDOM, pages 1--10, 2002."},{"key":"e_1_2_1_5_1","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-031-01722-3","volume-title":"The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines. Morgan &amp","author":"Barroso L. A.","year":"2009","unstructured":"L. A. Barroso and U. H\u00f6lzle . The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines. Morgan &amp ; Claypool Publishers , 2009 . L. A. Barroso and U. H\u00f6lzle. The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines. Morgan &amp; Claypool Publishers, 2009."},{"key":"e_1_2_1_6_1","volume-title":"SCOPE: Easy and Efficient Parallel Processing of Massive Data Sets. VLDB, 1(2)","author":"Chaiken R.","year":"2008","unstructured":"R. Chaiken , B. Jenkins , P.-A. Larson , B. Ramsey , D. Shakib , S. Weaver , and J. Zhou . SCOPE: Easy and Efficient Parallel Processing of Massive Data Sets. VLDB, 1(2) , 2008 . R. Chaiken, B. Jenkins, P.-A. Larson, B. Ramsey, D. Shakib, S. Weaver, and J. Zhou. SCOPE: Easy and Efficient Parallel Processing of Massive Data Sets. VLDB, 1(2), 2008."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/1806596.1806638"},{"key":"e_1_2_1_8_1","volume-title":"OSDI","author":"Chang F.","year":"2006","unstructured":"F. Chang , J. Dean , S. Ghemawat , W. C. Hsieh , D. A. Wallach , M. Burrows , T. Chandra , A. Fikes , and R. Gruber . Bigtable: A Distributed Storage System for Structured Data . In OSDI , 2006 . F. Chang, J. Dean, S. Ghemawat, W. C. Hsieh, D. A. Wallach, M. Burrows, T. Chandra, A. Fikes, and R. Gruber. Bigtable: A Distributed Storage System for Structured Data. In OSDI, 2006."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/66926.66952"},{"key":"e_1_2_1_10_1","volume-title":"Nov.","author":"Czajkowski G.","year":"2008","unstructured":"G. Czajkowski . Sorting 1PB with MapReduce. Official Google Blog , Nov. 2008 . At http:\/\/googleblog.blogspot.com\/2008\/11\/sorting-1pb-with-mapreduce.html. G. Czajkowski. Sorting 1PB with MapReduce. Official Google Blog, Nov. 2008. At http:\/\/googleblog.blogspot.com\/2008\/11\/sorting-1pb-with-mapreduce.html."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/1498759.1498761"},{"key":"e_1_2_1_12_1","volume-title":"OSDI","author":"Dean J.","year":"2004","unstructured":"J. Dean and S. Ghemawat . MapReduce: Simplified Data Processing on Large Clusters . In OSDI , 2004 . J. Dean and S. Ghemawat. MapReduce: Simplified Data Processing on Large Clusters. In OSDI, 2004."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/1629175.1629198"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/945445.945450"},{"key":"e_1_2_1_15_1","unstructured":"Hadoop Apache Project. http:\/\/hadoop.apache.org.  Hadoop Apache Project. http:\/\/hadoop.apache.org."},{"key":"e_1_2_1_16_1","volume-title":"http:\/\/wiki.apache.org\/hadoop\/Hive","year":"2009","unstructured":"Hive. http:\/\/wiki.apache.org\/hadoop\/Hive , 2009 . Hive. http:\/\/wiki.apache.org\/hadoop\/Hive, 2009."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/342009.335405"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/1376616.1376726"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/1007568.1007686"},{"key":"e_1_2_1_20_1","volume-title":"Interpreting the Data: Parallel Analysis with Sawzall. Scientific Programming, 13(4)","author":"Pike R.","year":"2005","unstructured":"R. Pike , S. Dorward , R. Griesemer , and S. Quinlan . Interpreting the Data: Parallel Analysis with Sawzall. Scientific Programming, 13(4) , 2005 . R. Pike, S. Dorward, R. Griesemer, and S. Quinlan. Interpreting the Data: Parallel Analysis with Sawzall. Scientific Programming, 13(4), 2005."},{"key":"e_1_2_1_21_1","unstructured":"Protocol Buffers: Developer Guide. Available at http:\/\/code.google.com\/apis\/protocolbuffers\/docs\/overview.html.  Protocol Buffers: Developer Guide. Available at http:\/\/code.google.com\/apis\/protocolbuffers\/docs\/overview.html."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/1629175.1629197"},{"key":"e_1_2_1_23_1","volume-title":"OSDI","author":"Yu Y.","year":"2008","unstructured":"Y. Yu , M. Isard , D. Fetterly , M. Budiu , \u00da. Erlingsson, P. K. Gunda , and J. Currey . DryadLINQ: A System for General-Purpose Distributed Data-Parallel Computing Using a High-Level Language . In OSDI , 2008 . Y. Yu, M. Isard, D. Fetterly, M. Budiu, \u00da. Erlingsson, P. K. Gunda, and J. Currey. DryadLINQ: A System for General-Purpose Distributed Data-Parallel Computing Using a High-Level Language. In OSDI, 2008."}],"container-title":["Proceedings of the VLDB Endowment"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.14778\/1920841.1920886","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,28]],"date-time":"2022-12-28T11:53:28Z","timestamp":1672228408000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.14778\/1920841.1920886"}},"subtitle":["interactive analysis of web-scale datasets"],"short-title":[],"issued":{"date-parts":[[2010,9]]},"references-count":23,"journal-issue":{"issue":"1-2","published-print":{"date-parts":[[2010,9]]}},"alternative-id":["10.14778\/1920841.1920886"],"URL":"https:\/\/doi.org\/10.14778\/1920841.1920886","relation":{},"ISSN":["2150-8097"],"issn-type":[{"value":"2150-8097","type":"print"}],"subject":[],"published":{"date-parts":[[2010,9]]}}}