{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,8]],"date-time":"2026-05-08T20:42:00Z","timestamp":1778272920086,"version":"3.51.4"},"reference-count":33,"publisher":"Association for Computing Machinery (ACM)","issue":"2","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. VLDB Endow."],"published-print":{"date-parts":[[2009,8]]},"abstract":"<jats:p>In database systems, the cost of data storage and retrieval are important components of the total cost and response time of the system. A popular mechanism to reduce the storage footprint is by compressing the data residing in tables and indexes. Compressing indexes efficiently, while maintaining response time requirements, is known to be challenging. This is especially true when designing for a workload spectrum covering both data warehousing and transaction processing environments. DB2 Linux, UNIX, Windows (LUW) recently introduced index compression for use in both environments. This uses techniques that are able to compress index data efficiently while incurring virtually no performance penalty for query processing. On the contrary, for certain operations, the performance is actually better. In this paper, we detail the design of index compression in DB2 LUW and discuss the challenges that were encountered in meeting the design goals. We also demonstrate its effectiveness by showing performance results on typical customer scenarios.<\/jats:p>","DOI":"10.14778\/1687553.1687573","type":"journal-article","created":{"date-parts":[[2014,6,24]],"date-time":"2014-06-24T12:17:57Z","timestamp":1403612277000},"page":"1462-1473","source":"Crossref","is-referenced-by-count":21,"title":["Efficient index compression in DB2 LUW"],"prefix":"10.14778","volume":"2","author":[{"given":"Bishwaranjan","family":"Bhattacharjee","sequence":"first","affiliation":[{"name":"IBM T.J. Watson Research Center, Hawthorne, NY"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lipyeow","family":"Lim","sequence":"additional","affiliation":[{"name":"IBM T.J. Watson Research Center, Hawthorne, NY"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Timothy","family":"Malkemus","sequence":"additional","affiliation":[{"name":"IBM T.J. Watson Research Center, Hawthorne, NY"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"George","family":"Mihaila","sequence":"additional","affiliation":[{"name":"IBM T.J. Watson Research Center, Hawthorne, NY"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kenneth","family":"Ross","sequence":"additional","affiliation":[{"name":"IBM T.J. Watson Research Center, Hawthorne, NY"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sherman","family":"Lau","sequence":"additional","affiliation":[{"name":"IBM Toronto Labs, Markham, Ontario, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Cathy","family":"McArthur","sequence":"additional","affiliation":[{"name":"IBM Toronto Labs, Markham, Ontario, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zoltan","family":"Toth","sequence":"additional","affiliation":[{"name":"IBM Toronto Labs, Markham, Ontario, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Reza","family":"Sherkat","sequence":"additional","affiliation":[{"name":"University of Alberta, Edmonton, Alberta, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2009,8]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"http:\/\/www.tpc.org\/tpch\/default.asp  http:\/\/www.tpc.org\/tpch\/default.asp"},{"key":"e_1_2_1_2_1","unstructured":"http:\/\/www.tpc.org\/results\/individual_results\/IBM\/IBM_570_10000GB_20071015_ES.pdf  http:\/\/www.tpc.org\/results\/individual_results\/IBM\/IBM_570_10000GB_20071015_ES.pdf"},{"key":"e_1_2_1_3_1","volume-title":"Proceedings of VLDB 2003","author":"Poess M.","unstructured":"Poess , M. , Potapov , D. ,\" Data Compression in Oracle\" , Proceedings of VLDB 2003 Poess, M., Potapov, D.,\"Data Compression in Oracle\", Proceedings of VLDB 2003"},{"key":"e_1_2_1_4_1","volume-title":"Proceedings of the ICDE 2007","author":"Lang C.","unstructured":"Lang , C. , Bhattacharjee , B. , Malkemus , T. , Padmanabhan , S. , Wang , K. ,\" Increasing Buffer Locality for Multiple Relational Table Scans through Grouping and Throttling\" , Proceedings of the ICDE 2007 Lang, C., Bhattacharjee, B., Malkemus, T., Padmanabhan, S., Wang, K.,\"Increasing Buffer Locality for Multiple Relational Table Scans through Grouping and Throttling\", Proceedings of the ICDE 2007"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/SSDM.1999.787641"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/872757.872835"},{"key":"e_1_2_1_7_1","volume-title":"Proceedings of VLDB 2007","author":"Bhattacharjee B.","unstructured":"Bhattacharjee , B. , Malkemus , T. , Lau , S. , Mckeough , S. , Kirton , J. , Boeschoten , R. , Kennedy , J. , \" Efficient Bulk Deletes for Multi Dimensionally Clustered Tables in DB2\" , Proceedings of VLDB 2007 Bhattacharjee, B., Malkemus, T., Lau, S., Mckeough, S., Kirton, J., Boeschoten, R., Kennedy, J., \"Efficient Bulk Deletes for Multi Dimensionally Clustered Tables in DB2\", Proceedings of VLDB 2007"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/76894.76896"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/45072.45074"},{"key":"e_1_2_1_10_1","volume-title":"Comp. Sci","author":"Storer J. A","year":"1988","unstructured":"Storer , J. A , \" Data Compression : Methods and Theory \", Comp. Sci . Press , 1988 Storer, J. A, \"Data Compression: Methods and Theory\", Comp. Sci. Press, 1988"},{"key":"e_1_2_1_11_1","volume-title":"Proceedings of VLDB 1994","author":"Iyer B.","unstructured":"Iyer , B. , Wilhite , D. , \" Data Compression Support in Databases\" , Proceedings of VLDB 1994 Iyer, B., Wilhite, D., \"Data Compression Support in Databases\", Proceedings of VLDB 1994"},{"key":"e_1_2_1_12_1","volume-title":"Proceedings of VLDB 2006","author":"Raman V.","unstructured":"Raman , V. , Swart , G. , \" How to Wring a Table Dry : Entropy Compression of Relations and Querying of Compressed Relations \", Proceedings of VLDB 2006 Raman, V., Swart, G., \"How to Wring a Table Dry: Entropy Compression of Relations and Querying of Compressed Relations\", Proceedings of VLDB 2006"},{"key":"e_1_2_1_13_1","volume-title":"Proc. Of ACM\/IEEE Computer Science Symp. On Applied Computing","author":"Graefe G.","year":"1991","unstructured":"Graefe , G. , Shapiro , L. ,\" Data Compression and Database Performance\" , Proc. Of ACM\/IEEE Computer Science Symp. On Applied Computing , 1991 . Graefe, G., Shapiro, L.,\"Data Compression and Database Performance\", Proc. Of ACM\/IEEE Computer Science Symp. On Applied Computing, 1991."},{"key":"e_1_2_1_14_1","volume-title":"Information Systems","author":"Goyal P.","year":"1983","unstructured":"Goyal , P. , \" Coding methods for text string search on compressed databases \", Information Systems , 1983 Goyal, P., \"Coding methods for text string search on compressed databases\", Information Systems, 1983"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/1142473.1142548"},{"key":"e_1_2_1_16_1","volume-title":"Proceedings of ICDE 1998","author":"Goldstein J.","unstructured":"Goldstein , J. , Ramakrishnan , R. , Shaft , U. , \" Compressing Relations and Indexes\" , Proceedings of ICDE 1998 Goldstein, J., Ramakrishnan, R., Shaft, U., \"Compressing Relations and Indexes\", Proceedings of ICDE 1998"},{"key":"e_1_2_1_17_1","volume-title":"Proceedings of the 30th VLDB Conference 2004","author":"MacNicol R.","unstructured":"MacNicol , R. , French , B. ,\" Sybase IQ Multiplex -- Designed For Analytics\" , Proceedings of the 30th VLDB Conference 2004 MacNicol, R., French, B.,\"Sybase IQ Multiplex -- Designed For Analytics\", Proceedings of the 30th VLDB Conference 2004"},{"key":"e_1_2_1_18_1","volume-title":"Proceedings of the VLDB 1999","author":"Johnson T.","unstructured":"Johnson , T. , \" Performance measurements of compressed bitmap indices \", Proceedings of the VLDB 1999 Johnson, T., \"Performance measurements of compressed bitmap indices\", Proceedings of the VLDB 1999"},{"key":"e_1_2_1_19_1","volume-title":"Technical Report LBNL-47807","author":"Wu K.","year":"2001","unstructured":"Wu , K. , Otoo , E. , Shoshani , A. , \" Compressed bitmap indices for efficient query processing\" , Technical Report LBNL-47807 , 2001 Wu, K., Otoo, E., Shoshani, A., \"Compressed bitmap indices for efficient query processing\", Technical Report LBNL-47807, 2001"},{"key":"e_1_2_1_20_1","unstructured":"http:\/\/www.ibm.com\/software\/data\/db2\/9  http:\/\/www.ibm.com\/software\/data\/db2\/9"},{"key":"e_1_2_1_21_1","unstructured":"http:\/\/www.oracle.com  http:\/\/www.oracle.com"},{"key":"e_1_2_1_22_1","unstructured":"http:\/\/www.microsoft.com\/sql\/default.mspx  http:\/\/www.microsoft.com\/sql\/default.mspx"},{"key":"e_1_2_1_23_1","unstructured":"Berger J. Bruni P. \"Index Compression for DB2 9 for z\/OS\" IBM Redpaper 2007  Berger J. Bruni P. \"Index Compression for DB2 9 for z\/OS\" IBM Redpaper 2007"},{"key":"e_1_2_1_24_1","unstructured":"http:\/\/www.teradata.com  http:\/\/www.teradata.com"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2006.150"},{"key":"e_1_2_1_26_1","volume-title":"Witten, I. H, Moffat, A., Bell, T. C., \"Managing gigabytes","year":"1999","unstructured":"Witten, I. H, Moffat, A., Bell, T. C., \"Managing gigabytes ( 2 nd ed.): compressing and indexing documents and images\", Morgan Kaufmann Publishers Inc ., San Francisco, CA, USA, 1999 Witten, I. H, Moffat, A., Bell, T. C., \"Managing gigabytes (2nd ed.): compressing and indexing documents and images\", Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 1999","edition":"2"},{"key":"e_1_2_1_27_1","doi-asserted-by":"crossref","unstructured":"Huffman D. \"A method for construction of minimum redundancy codes\" Volume 40 pages 1098--1101 1952  Huffman D. \"A method for construction of minimum redundancy codes\" Volume 40 pages 1098--1101 1952","DOI":"10.1109\/JRPROC.1952.273898"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1022949613039"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/320521.320530"},{"key":"e_1_2_1_30_1","unstructured":"Bell T. C. Cleary Witten I. H. \"Text Compression\" Prentice Hall 1990.   Bell T. C. Cleary Witten I. H. \"Text Compression\" Prentice Hall 1990."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1007\/s007780050031"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/1064546.1180611"},{"key":"e_1_2_1_33_1","volume-title":"Proceedings of VLDB 2000","author":"Srinivasan J.","unstructured":"Srinivasan , J. , Chong , E. I. , Krishnan , R. , Das , S. , Jagannath , M. , Tran A. , Banerjee , J. , Freiwald C. , Yalamanchi , A. , DeFazio , S. , \" Oracle 8i Index-Organized Table and its Application to New Domains \", Proceedings of VLDB 2000 Srinivasan, J., Chong, E. I., Krishnan, R., Das, S., Jagannath, M., Tran A., Banerjee, J., Freiwald C., Yalamanchi, A., DeFazio, S., \"Oracle8i Index-Organized Table and its Application to New Domains\", Proceedings of VLDB 2000"}],"container-title":["Proceedings of the VLDB Endowment"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.14778\/1687553.1687573","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,28]],"date-time":"2022-12-28T10:58:29Z","timestamp":1672225109000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.14778\/1687553.1687573"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2009,8]]},"references-count":33,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2009,8]]}},"alternative-id":["10.14778\/1687553.1687573"],"URL":"https:\/\/doi.org\/10.14778\/1687553.1687573","relation":{},"ISSN":["2150-8097"],"issn-type":[{"value":"2150-8097","type":"print"}],"subject":[],"published":{"date-parts":[[2009,8]]}}}