{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,21]],"date-time":"2026-02-21T18:09:04Z","timestamp":1771697344414,"version":"3.50.1"},"reference-count":34,"publisher":"Association for Computing Machinery (ACM)","issue":"11","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. VLDB Endow."],"published-print":{"date-parts":[[2012,7]]},"abstract":"<jats:p>Yellow elephants are slow. A major reason is that they consume their inputs entirely before responding to an elephant rider's orders. Some clever riders have trained their yellow elephants to only consume parts of the inputs before responding. However, the teaching time to make an elephant do that is high. So high that the teaching lessons often do not pay off. We take a different approach. We make elephants aggressive; only this will make them very fast.<\/jats:p>\n          <jats:p>We propose HAIL (Hadoop Aggressive Indexing Library), an enhancement of HDFS and Hadoop MapReduce that dramatically improves runtimes of several classes of MapReduce jobs. HAIL changes the upload pipeline of HDFS in order to create different clustered indexes on each data block replica. An interesting feature of HAIL is that we typically create a win-win situation: we improve both data upload to HDFS and the runtime of the actual Hadoop MapReduce job. In terms of data upload, HAIL improves over HDFS by up to 60% with the default replication factor of three. In terms of query execution, we demonstrate that HAIL runs up to 68x faster than Hadoop. In our experiments, we use six clusters including physical and EC2 clusters of up to 100 nodes. A series of scalability experiments also demonstrates the superiority of HAIL.<\/jats:p>","DOI":"10.14778\/2350229.2350272","type":"journal-article","created":{"date-parts":[[2014,6,24]],"date-time":"2014-06-24T12:17:57Z","timestamp":1403612277000},"page":"1591-1602","source":"Crossref","is-referenced-by-count":62,"title":["Only aggressive elephants are fast elephants"],"prefix":"10.14778","volume":"5","author":[{"given":"Jens","family":"Dittrich","sequence":"first","affiliation":[{"name":"Information Systems Group, Saarland University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jorge-Arnulfo","family":"Quian\u00e9-Ruiz","sequence":"additional","affiliation":[{"name":"Information Systems Group, Saarland University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Stefan","family":"Richter","sequence":"additional","affiliation":[{"name":"Information Systems Group, Saarland University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Stefan","family":"Schuh","sequence":"additional","affiliation":[{"name":"Information Systems Group, Saarland University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alekh","family":"Jindal","sequence":"additional","affiliation":[{"name":"Information Systems Group, Saarland University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"J\u00f6rg","family":"Schad","sequence":"additional","affiliation":[{"name":"Information Systems Group, Saarland University"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2012,7]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1016\/B978-012088469-8.50097-8"},{"key":"e_1_2_1_2_1","first-page":"169","volume-title":"VLDB","author":"Ailamaki A.","year":"2001"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/1807167.1807273"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00778-009-0154-1"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/1859127.1859141"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2004.75"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.14778\/3402707.3402711"},{"key":"e_1_2_1_8_1","doi-asserted-by":"crossref","unstructured":"S. Chen. Cheetah: A High Performance Custom Data Warehouse on Top of MapReduce. PVLDB 3(1--2):1459--1468 2010.   S. Chen. Cheetah: A High Performance Custom Data Warehouse on Top of MapReduce. PVLDB 3(1--2):1459--1468 2010.","DOI":"10.14778\/1920841.1921020"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.14778\/1978665.1978668"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/1629175.1629198"},{"key":"e_1_2_1_11_1","first-page":"5","article-title":"Efficient Parallel Data Processing","author":"Dittrich J.","year":"2012","journal-title":"MapReduce Workflows. PVLDB"},{"issue":"1","key":"e_1_2_1_12_1","first-page":"518","article-title":"Hadoop++: Making a Yellow Elephant Run Like a Cheetah (Without It Even Noticing)","volume":"3","author":"Dittrich J.","year":"2010","journal-title":"PVLDB"},{"issue":"9","key":"e_1_2_1_13_1","first-page":"575","article-title":"CoHadoop","volume":"4","author":"Eltabakh M. Y.","year":"2011","journal-title":"Flexible Data Placement and Its Exploitation in Hadoop. PVLDB"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.14778\/1988776.1988778"},{"key":"e_1_2_1_15_1","unstructured":"http:\/\/engineering.twitter.com\/2010\/04\/hadoop-at-twitter.html.  http:\/\/engineering.twitter.com\/2010\/04\/hadoop-at-twitter.html."},{"key":"e_1_2_1_16_1","unstructured":"Hadoop Users http:\/\/wiki.apache.org\/hadoop\/PoweredBy.  Hadoop Users http:\/\/wiki.apache.org\/hadoop\/PoweredBy."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.14778\/3402707.3402746"},{"key":"e_1_2_1_18_1","first-page":"57","volume-title":"CIDR","author":"Idreos S.","year":"2011"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.14778\/1978665.1978670"},{"issue":"1","key":"e_1_2_1_20_1","first-page":"472","article-title":"The Performance of MapReduce","volume":"3","author":"Jiang D.","year":"2010","journal-title":"An In-depth Study. PVLDB"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2038916.2038937"},{"issue":"1","key":"e_1_2_1_22_1","first-page":"129","volume":"3","author":"Lang W.","year":"2010","journal-title":"Energy Management for MapReduce Clusters. PVLDB"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/1996092.1996105"},{"key":"e_1_2_1_24_1","volume-title":"USENIX","author":"Logothetis D.","year":"2011"},{"issue":"1","key":"e_1_2_1_25_1","first-page":"494","article-title":"MRShare","volume":"3","author":"Nykiel T.","year":"2010","journal-title":"Sharing Across Multiple Queries in MapReduce. PVLDB"},{"key":"e_1_2_1_26_1","volume-title":"SOCC","author":"Olston C.","year":"2011"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/1559845.1559865"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2011.5767877"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/335191.335449"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.14778\/1920841.1920902"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/383059.383071"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/1807167.1807278"},{"key":"e_1_2_1_33_1","unstructured":"T. White. Hadoop: The Definitive Guide. O'Reilly 2011.   T. White. Hadoop: The Definitive Guide . O'Reilly 2011."},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/1755913.1755940"}],"container-title":["Proceedings of the VLDB Endowment"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.14778\/2350229.2350272","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,28]],"date-time":"2022-12-28T11:30:43Z","timestamp":1672227043000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.14778\/2350229.2350272"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2012,7]]},"references-count":34,"journal-issue":{"issue":"11","published-print":{"date-parts":[[2012,7]]}},"alternative-id":["10.14778\/2350229.2350272"],"URL":"https:\/\/doi.org\/10.14778\/2350229.2350272","relation":{},"ISSN":["2150-8097"],"issn-type":[{"value":"2150-8097","type":"print"}],"subject":[],"published":{"date-parts":[[2012,7]]}}}