{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,9,29]],"date-time":"2025-09-29T08:22:37Z","timestamp":1759134157035},"reference-count":20,"publisher":"Association for Computing Machinery (ACM)","issue":"12","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. VLDB Endow."],"published-print":{"date-parts":[[2012,8]]},"abstract":"<jats:p>We demonstrate SkewTune, a system that automatically mitigates skew in user-defined MapReduce programs and is a drop-in replacement for Hadoop. The demonstration has two parts. First, we demonstrate how SkewTune mitigates skew in real MapReduce applications at runtime by running a real application in a public cloud. Second, through an interactive graphical interface, we demonstrate the details of the skew mitigation process using both real and synthetic workloads that represent various skew configurations.<\/jats:p>","DOI":"10.14778\/2367502.2367541","type":"journal-article","created":{"date-parts":[[2014,6,24]],"date-time":"2014-06-24T12:17:57Z","timestamp":1403612277000},"page":"1934-1937","source":"Crossref","is-referenced-by-count":22,"title":["SkewTune in action"],"prefix":"10.14778","volume":"5","author":[{"given":"YongChul","family":"Kwon","sequence":"first","affiliation":[{"name":"University of Washington"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Magdalena","family":"Balazinska","sequence":"additional","affiliation":[{"name":"University of Washington"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bill","family":"Howe","sequence":"additional","affiliation":[{"name":"University of Washington"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jerome","family":"Rolia","sequence":"additional","affiliation":[{"name":"HP Labs"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2012,8]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"Apache Hadoop Project. Powered by Hadoop. http:\/\/wiki.apache.org\/hadoop\/PoweredBy\/ 2011. Apache Hadoop Project. Powered by Hadoop. http:\/\/wiki.apache.org\/hadoop\/PoweredBy\/ 2011."},{"key":"e_1_2_1_2_1","first-page":"107","volume-title":"Proc. of the 7th WWW Conf.","author":"Brin S.","year":"1998","unstructured":"S. Brin and L. Page . The anatomy of a large-scale hypertextual web search engine . In Proc. of the 7th WWW Conf. , pages 107 -- 117 , 1998 . S. Brin and L. Page. The anatomy of a large-scale hypertextual web search engine. In Proc. of the 7th WWW Conf., pages 107--117, 1998."},{"issue":"1","key":"e_1_2_1_3_1","doi-asserted-by":"crossref","first-page":"285","DOI":"10.14778\/1920841.1920881","article-title":"HaLoop: Efficient iterative data processing on large clusters","volume":"3","author":"Bu Y.","year":"2010","unstructured":"Y. Bu , B. Howe , M. Balazinska , and M. D. Ernst . HaLoop: Efficient iterative data processing on large clusters . Proc. VLDB Endow. , 3 ( 1 ): 285 -- 296 , 2010 . Y. Bu, B. Howe, M. Balazinska, and M. D. Ernst. HaLoop: Efficient iterative data processing on large clusters. Proc. VLDB Endow., 3(1):285--296, 2010.","journal-title":"Proc. VLDB Endow."},{"key":"e_1_2_1_4_1","first-page":"21","volume-title":"Proc. of the 7th NSDI Symp.","author":"Condie T.","year":"2010","unstructured":"T. Condie , N. Conway , P. Alvaro , J. M. Hellerstein , K. Elmeleegy , and R. Sears . MapReduce online . In Proc. of the 7th NSDI Symp. , pages 21 -- 21 , 2010 . T. Condie, N. Conway, P. Alvaro, J. M. Hellerstein, K. Elmeleegy, and R. Sears. MapReduce online. In Proc. of the 7th NSDI Symp., pages 21--21, 2010."},{"key":"e_1_2_1_5_1","first-page":"10","volume-title":"Proc. of the 6th OSDI Symp.","author":"Dean J.","year":"2004","unstructured":"J. Dean and S. Ghemawat . MapReduce: simplified data processing on large clusters . In Proc. of the 6th OSDI Symp. , pages 10 -- 10 , 2004 . J. Dean and S. Ghemawat. MapReduce: simplified data processing on large clusters. In Proc. of the 6th OSDI Symp., pages 10--10, 2004."},{"issue":"1","key":"e_1_2_1_6_1","doi-asserted-by":"crossref","first-page":"28","DOI":"10.14778\/1453856.1453865","article-title":"Clustera: an integrated computation and data management system","volume":"1","author":"DeWitt D. J.","year":"2008","unstructured":"D. J. DeWitt , E. Paulson , E. Robinson , J. Naughton , J. Royalty , S. Shankar , and A. Krioukov . Clustera: an integrated computation and data management system . Proc. VLDB Endow. , 1 ( 1 ): 28 -- 41 , 2008 . D. J. DeWitt, E. Paulson, E. Robinson, J. Naughton, J. Royalty, S. Shankar, and A. Krioukov. Clustera: an integrated computation and data management system. Proc. VLDB Endow., 1(1):28--41, 2008.","journal-title":"Proc. VLDB Endow."},{"key":"e_1_2_1_7_1","first-page":"574","volume-title":"The First International Conference on Cloud Computing and Services Science","author":"Gufler B.","year":"2011","unstructured":"B. Gufler , N. Augsten , A. Reiser , and A. Kemper . Handling data skew in MapReduce . In The First International Conference on Cloud Computing and Services Science , pages 574 -- 583 , 2011 . B. Gufler, N. Augsten, A. Reiser, and A. Kemper. Handling data skew in MapReduce. In The First International Conference on Cloud Computing and Services Science, pages 574--583, 2011."},{"key":"e_1_2_1_8_1","first-page":"522","volume-title":"Proc. of the 28th ICDE Conf.","author":"Gufler B.","year":"2012","unstructured":"B. Gufler , N. Augsten , A. Reiser , and A. Kemper . Load balancing in mapreduce based on scalable cardinality estimates . In Proc. of the 28th ICDE Conf. , pages 522 -- 533 , 2012 . 10.1109\/ICDE.2012.58 B. Gufler, N. Augsten, A. Reiser, and A. Kemper. Load balancing in mapreduce based on scalable cardinality estimates. In Proc. of the 28th ICDE Conf., pages 522--533, 2012. 10.1109\/ICDE.2012.58"},{"key":"e_1_2_1_9_1","unstructured":"Hadoop. http:\/\/hadoop.apache.org\/. Hadoop. http:\/\/hadoop.apache.org\/."},{"key":"e_1_2_1_10_1","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1109\/CloudCom.2010.25","volume-title":"Cloud Computing Technology and Science (CloudCom), 2010 IEEE Second International Conference on","author":"Ibrahim S.","year":"2010","unstructured":"S. Ibrahim , H. Jin , L. Lu , S. Wu , B. He , and L. Qi . LEEN: Locality\/fairness-aware key partitioning for mapreduce in the cloud . In Cloud Computing Technology and Science (CloudCom), 2010 IEEE Second International Conference on , pages 17 -- 24 , 2010 . 10.1109\/CloudCom.2010.25 S. Ibrahim, H. Jin, L. Lu, S. Wu, B. He, and L. Qi. LEEN: Locality\/fairness-aware key partitioning for mapreduce in the cloud. In Cloud Computing Technology and Science (CloudCom), 2010 IEEE Second International Conference on, pages 17--24, 2010. 10.1109\/CloudCom.2010.25"},{"key":"e_1_2_1_11_1","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1145\/1272996.1273005","volume-title":"Proc. of the 7th EuroSys Conf.","author":"Isard M.","year":"2007","unstructured":"M. Isard , M. Budiu , Y. Yu , A. Birrell , and D. Fetterly . Dryad: Distributed data-parallel programs from sequential building blocks . In Proc. of the 7th EuroSys Conf. , pages 59 -- 72 , 2007 . 10.1145\/1272996.1273005 M. Isard, M. Budiu, Y. Yu, A. Birrell, and D. Fetterly. Dryad: Distributed data-parallel programs from sequential building blocks. In Proc. of the 7th EuroSys Conf., pages 59--72, 2007. 10.1145\/1272996.1273005"},{"key":"e_1_2_1_12_1","first-page":"75","volume-title":"Proc. of the First SOCC Conf.","author":"Kwon Y.","year":"2010","unstructured":"Y. Kwon , M. Balazinska , B. Howe , and J. Rolia . Skew-resistant parallel processing of feature-extracting scientific user-defined functions . In Proc. of the First SOCC Conf. , pages 75 -- 86 , 2010 . 10.1145\/1807128.1807140 Y. Kwon, M. Balazinska, B. Howe, and J. Rolia. Skew-resistant parallel processing of feature-extracting scientific user-defined functions. In Proc. of the First SOCC Conf., pages 75--86, 2010. 10.1145\/1807128.1807140"},{"key":"e_1_2_1_13_1","first-page":"25","volume-title":"Proc. of the SIGMOD Conf.","author":"Kwon Y.","year":"2012","unstructured":"Y. Kwon , M. Balazinska , B. Howe , and J. Rolia . SkewTune: Mitigating skew in MapReduce applications . In Proc. of the SIGMOD Conf. , pages 25 -- 36 , 2012 . 10.1145\/2213836.2213840 Y. Kwon, M. Balazinska, B. Howe, and J. Rolia. SkewTune: Mitigating skew in MapReduce applications. In Proc. of the SIGMOD Conf., pages 25--36, 2012. 10.1145\/2213836.2213840"},{"key":"e_1_2_1_15_1","doi-asserted-by":"crossref","first-page":"132","DOI":"10.1007\/978-3-642-13818-8_11","volume-title":"Proc. of the 22nd Scientific and Statistical Database Management Conference (SSDBM)","author":"Kwon Y.","year":"2010","unstructured":"Y. Kwon , D. Nunley , J. P. Gardner , M. Balazinska , B. Howe , and S. Loebman . Scalable clustering algorithm for N-body simulations in a shared-nothing cluster . In Proc. of the 22nd Scientific and Statistical Database Management Conference (SSDBM) , pages 132 -- 150 , 2010 . Y. Kwon, D. Nunley, J. P. Gardner, M. Balazinska, B. Howe, and S. Loebman. Scalable clustering algorithm for N-body simulations in a shared-nothing cluster. In Proc. of the 22nd Scientific and Statistical Database Management Conference (SSDBM), pages 132--150, 2010."},{"key":"e_1_2_1_16_1","first-page":"57","volume-title":"7th Workshop on Large-Scale Distributed Systems for Information Retrieval (LSDS-IR)","author":"Lin J.","year":"2009","unstructured":"J. Lin . The curse of zipf and limits to parallelization: A look at the stragglers problem in MapReduce . In 7th Workshop on Large-Scale Distributed Systems for Information Retrieval (LSDS-IR) , pages 57 -- 62 , 2009 . J. Lin. The curse of zipf and limits to parallelization: A look at the stragglers problem in MapReduce. In 7th Workshop on Large-Scale Distributed Systems for Information Retrieval (LSDS-IR), pages 57--62, 2009."},{"key":"e_1_2_1_17_1","first-page":"681","volume-title":"Proc. of the 26th ICDE Conf.","author":"Morton K.","year":"2010","unstructured":"K. Morton , A. Friesen , M. Balazinska , and D. Grossman . Estimating the progress of MapReduce pipelines . In Proc. of the 26th ICDE Conf. , pages 681 -- 684 , Mar. 2010 . K. Morton, A. Friesen, M. Balazinska, and D. Grossman. Estimating the progress of MapReduce pipelines. In Proc. of the 26th ICDE Conf., pages 681--684, Mar. 2010."},{"key":"e_1_2_1_18_1","unstructured":"O. O'Malley. Apache Hadoop wins terabyte sort benchmark. http:\/\/developer.yahoo.com\/blogs\/hadoop\/posts\/2008\/07\/apache_hadoop_wins_terabyte_sort_benchmark\/. O. O'Malley. Apache Hadoop wins terabyte sort benchmark. http:\/\/developer.yahoo.com\/blogs\/hadoop\/posts\/2008\/07\/apache_hadoop_wins_terabyte_sort_benchmark\/."},{"key":"e_1_2_1_19_1","unstructured":"The Mahout Team. Apache Mahout project. http:\/\/mahout.apache.org\/. The Mahout Team. Apache Mahout project. http:\/\/mahout.apache.org\/."},{"key":"e_1_2_1_20_1","first-page":"420","volume-title":"Proc. of the 15th EDBT Conf.","author":"Vernica R.","year":"2012","unstructured":"R. Vernica , A. Balmin , K. S. Beyer , and V. Ercegovac . Adaptive MapReduce using situation-aware mappers . In Proc. of the 15th EDBT Conf. , pages 420 -- 431 , 2012 . 10.1145\/2247596.2247646 R. Vernica, A. Balmin, K. S. Beyer, and V. Ercegovac. Adaptive MapReduce using situation-aware mappers. In Proc. of the 15th EDBT Conf., pages 420--431, 2012. 10.1145\/2247596.2247646"},{"key":"e_1_2_1_21_1","first-page":"29","volume-title":"Proc. of the 8th OSDI Symp.","author":"Zaharia M.","year":"2008","unstructured":"M. Zaharia , A. Konwinski , A. D. Joseph , R. Katz , and I. Stoica . Improving MapReduce performance in heterogeneous environments . In Proc. of the 8th OSDI Symp. , pages 29 -- 42 , 2008 . M. Zaharia, A. Konwinski, A. D. Joseph, R. Katz, and I. Stoica. Improving MapReduce performance in heterogeneous environments. In Proc. of the 8th OSDI Symp., pages 29--42, 2008."}],"container-title":["Proceedings of the VLDB Endowment"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.14778\/2367502.2367541","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,7,14]],"date-time":"2023-07-14T14:43:25Z","timestamp":1689345805000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.14778\/2367502.2367541"}},"subtitle":["mitigating skew in MapReduce applications"],"short-title":[],"issued":{"date-parts":[[2012,8]]},"references-count":20,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2012,8]]}},"alternative-id":["10.14778\/2367502.2367541"],"URL":"https:\/\/doi.org\/10.14778\/2367502.2367541","relation":{},"ISSN":["2150-8097"],"issn-type":[{"value":"2150-8097","type":"print"}],"subject":[],"published":{"date-parts":[[2012,8]]}}}