{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,11]],"date-time":"2025-12-11T20:38:14Z","timestamp":1765485494730,"version":"3.41.0"},"reference-count":34,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2010,10,12]],"date-time":"2010-10-12T00:00:00Z","timestamp":1286841600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Database Syst."],"published-print":{"date-parts":[[2010,11]]},"abstract":"<jats:p>Automatic recycling of intermediate results to improve both query response time and throughput is a grand challenge for state-of-the-art databases. Tuples are loaded and streamed through a tuple-at-a-time processing pipeline, avoiding materialization of intermediates as much as possible. This limits the opportunities for reuse of overlapping computations to DBA-defined materialized views and function\/result cache tuning. In contrast, the operator-at-a-time execution paradigm produces fully materialized results in each step of the query plan. To avoid resource contention, these intermediates are evicted as soon as possible.<\/jats:p>\n          <jats:p>In this article we study an architecture that harvests the byproducts of the operator-at-a-time paradigm in a column-store system using a lightweight mechanism, the recycler. The key challenge then becomes the selection of the policies to admit intermediates to the resource pool, to determine their retention period, and devise the eviction strategy when facing resource limitations. The proposed recycling architecture has been implemented in an open-source system. An experimental analysis against the TPC-H ad-hoc decision support benchmark and a complex, real-world application (SkyServer) demonstrates its effectiveness in terms of self-organizing behavior and its significant performance gains. The results indicate the potentials of recycling intermediates and charts a route for further development of database kernels.<\/jats:p>","DOI":"10.1145\/1862919.1862921","type":"journal-article","created":{"date-parts":[[2010,12,20]],"date-time":"2010-12-20T15:55:04Z","timestamp":1292860504000},"page":"1-43","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":26,"title":["An architecture for recycling intermediates in a column-store"],"prefix":"10.1145","volume":"35","author":[{"given":"Milena G.","family":"Ivanova","sequence":"first","affiliation":[{"name":"Centrum Wiskunde &amp; Informatica, The Netherlands"}]},{"given":"Martin L.","family":"Kersten","sequence":"additional","affiliation":[{"name":"Centrum Wiskunde &amp; Informatica, The Netherlands"}]},{"given":"Niels J.","family":"Nes","sequence":"additional","affiliation":[{"name":"Centrum Wiskunde &amp; Informatica, The Netherlands"}]},{"given":"Romulo A.P.","family":"Gon\u00e7alves","sequence":"additional","affiliation":[{"name":"Centrum Wiskunde &amp; Informatica, The Netherlands"}]}],"member":"320","published-online":{"date-parts":[[2010,10,12]]},"reference":[{"volume-title":"Proceedings of the International Conference on Very Large Databases (VLDB). 496--505","author":"Agrawal S.","key":"e_1_2_1_1_1","unstructured":"Agrawal , S. , Chaudhuri , S. , and Narasayya , V. R . 2000. Automated selection of materialized views and indexes in SQL databases . In Proceedings of the International Conference on Very Large Databases (VLDB). 496--505 . Agrawal, S., Chaudhuri, S., and Narasayya, V. R. 2000. Automated selection of materialized views and indexes in SQL databases. In Proceedings of the International Conference on Very Large Databases (VLDB). 496--505."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/16894.16861"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/1409360.1409380"},{"key":"e_1_2_1_4_1","first-page":"11","article-title":"Adaptive database caching with DBCache","volume":"27","author":"Bornh\u00f6vd C.","year":"2004","unstructured":"Bornh\u00f6vd , C. , Altinel , M. , Mohan , C. , Pirahesh , H. , and Reinwald , B. 2004 . Adaptive database caching with DBCache . IEEE Data Eng. Bull. 27 , 2, 11 -- 18 . Bornh\u00f6vd, C., Altinel, M., Mohan, C., Pirahesh, H., and Reinwald, B. 2004. Adaptive database caching with DBCache. IEEE Data Eng. Bull. 27, 2, 11--18.","journal-title":"IEEE Data Eng. Bull."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/1292609.1292618"},{"volume-title":"Proceedings of the International Conference on Extending Database Technology (EDBT). 323--336","author":"Chen C.-M.","key":"e_1_2_1_6_1","unstructured":"Chen , C.-M. and Roussopoulos , N . 1994. The implementation and performance evaluation of the ADMS query optimizer: Integrating query result caching and matching . In Proceedings of the International Conference on Extending Database Technology (EDBT). 323--336 . Chen, C.-M. and Roussopoulos, N. 1994. The implementation and performance evaluation of the ADMS query optimizer: Integrating query result caching and matching. In Proceedings of the International Conference on Extending Database Technology (EDBT). 323--336."},{"volume-title":"Proceedings of Asia-Pacific Web Conference (APWeb). 583--594","author":"Choi C.-H.","key":"e_1_2_1_7_1","unstructured":"Choi , C.-H. , Yu , J. X. , and Lu , H . 2003. Dynamic materialized view management based on predicates . In Proceedings of Asia-Pacific Web Conference (APWeb). 583--594 . Choi, C.-H., Yu, J. X., and Lu, H. 2003. Dynamic materialized view management based on predicates. In Proceedings of Asia-Pacific Web Conference (APWeb). 583--594."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00778-007-0071-0"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/375663.375706"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/69.273032"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/223784.223849"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/1353343.1353366"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/1559845.1559879"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/SSDBM.2007.19"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/503099.503100"},{"volume-title":"Proceedings of the International Conference on Data Engineering (ICDE). 177--189","author":"Larson P.","key":"e_1_2_1_16_1","unstructured":"Larson , P. -\u00c5., Goldstein , J. , and Zhou , J . 2004. MTCache: Transparent mid-tier database caching in SQL server . In Proceedings of the International Conference on Data Engineering (ICDE). 177--189 . Larson, P.-\u00c5., Goldstein, J., and Zhou, J. 2004. MTCache: Transparent mid-tier database caching in SQL server. In Proceedings of the International Conference on Data Engineering (ICDE). 177--189."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2007.367921"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/1458082.1458107"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.5555\/98124"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/375663.375703"},{"key":"e_1_2_1_21_1","unstructured":"MonetDB 2010. http:\/\/monetdb.cwi.nl\/.  MonetDB 2010. http:\/\/monetdb.cwi.nl\/."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2008.4497452"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/276304.276309"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/233269.233361"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/342009.335419"},{"volume-title":"Proceedings of the International Conference on Very Large Data Bases (VLDB). 51--62","author":"Scheuermann P.","key":"e_1_2_1_26_1","unstructured":"Scheuermann , P. , Shim , J. , and Vingralek , R . 1996. WATCHMAN : A data warehouse intelligent cache manager . In Proceedings of the International Conference on Very Large Data Bases (VLDB). 51--62 . Scheuermann, P., Shim, J., and Vingralek, R. 1996. WATCHMAN : A data warehouse intelligent cache manager. In Proceedings of the International Conference on Very Large Data Bases (VLDB). 51--62."},{"key":"e_1_2_1_27_1","unstructured":"SkyServer 2008. Sloan Digital Sky Survey \/SkyServer http:\/\/cas.sdss.org\/.  SkyServer 2008. Sloan Digital Sky Survey \/SkyServer http:\/\/cas.sdss.org\/."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/564691.564758"},{"volume-title":"Proceedings of the International Conference on Data Engineering (ICDE). 633--640","author":"Tan K.-L.","key":"e_1_2_1_29_1","unstructured":"Tan , K.-L. , Goh , S.-T. , and Ooi , B. C . 2001. Cache-on-demand: Recycling with certainty . In Proceedings of the International Conference on Data Engineering (ICDE). 633--640 . Tan, K.-L., Goh, S.-T., and Ooi, B. C. 2001. Cache-on-demand: Recycling with certainty. In Proceedings of the International Conference on Data Engineering (ICDE). 633--640."},{"issue":"6","key":"e_1_2_1_30_1","first-page":"2","article-title":"TPC Benchmark H","volume":"2","author":"Transaction Processing Performance Council","year":"2008","unstructured":"Transaction Processing Performance Council . 2008 . TPC Benchmark H , Revision 2 . 6 . 2 . Transaction Processing Performance Council. 2008. TPC Benchmark H, Revision 2.6.2.","journal-title":"Revision"},{"key":"e_1_2_1_31_1","unstructured":"VectorWise 2010. http:\/\/www.vectorwise.com\/.  VectorWise 2010. http:\/\/www.vectorwise.com\/."},{"volume-title":"Proceedings of the International Conference on Data Engineering (ICDE). 526--535","author":"Zhou J.","key":"e_1_2_1_32_1","unstructured":"Zhou , J. , Larson , P. -\u00c5., Goldstein , J. , and Ding , L . 2007a. Dynamic Materialized Views . In Proceedings of the International Conference on Data Engineering (ICDE). 526--535 . Zhou, J., Larson, P.-\u00c5., Goldstein, J., and Ding, L. 2007a. Dynamic Materialized Views. In Proceedings of the International Conference on Data Engineering (ICDE). 526--535."},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/1247480.1247540"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2006.150"}],"container-title":["ACM Transactions on Database Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1862919.1862921","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1862919.1862921","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T21:14:51Z","timestamp":1750281291000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1862919.1862921"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2010,10,12]]},"references-count":34,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2010,11]]}},"alternative-id":["10.1145\/1862919.1862921"],"URL":"https:\/\/doi.org\/10.1145\/1862919.1862921","relation":{},"ISSN":["0362-5915","1557-4644"],"issn-type":[{"type":"print","value":"0362-5915"},{"type":"electronic","value":"1557-4644"}],"subject":[],"published":{"date-parts":[[2010,10,12]]},"assertion":[{"value":"2009-10-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2010-07-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2010-10-12","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}