{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,10]],"date-time":"2026-01-10T18:59:42Z","timestamp":1768071582767,"version":"3.49.0"},"reference-count":41,"publisher":"Association for Computing Machinery (ACM)","issue":"1-2","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. VLDB Endow."],"published-print":{"date-parts":[[2010,9]]},"abstract":"<jats:p>The area of cluster-level energy management has attracted significant research attention over the past few years. One class of techniques to reduce the energy consumption of clusters is to selectively power down nodes during periods of low utilization to increase energy efficiency. One can think of a number of ways of selectively powering down nodes, each with varying impact on the workload response time and overall energy consumption. Since the MapReduce framework is becoming \"ubiquitous\", the focus of this paper is on developing a framework for systematically considering various MapReduce node power down strategies, and their impact on the overall energy consumption and workload response time.<\/jats:p>\n          <jats:p>We closely examine two extreme techniques that can be accommodated in this framework. The first is based on a recently proposed technique called \"Covering Set\" (CS) that keeps only a small fraction of the nodes powered up during periods of low utilization. At the other extreme is a technique that we propose in this paper, called the All-In Strategy (AIS). AIS uses all the nodes in the cluster to run a workload and then powers down the entire cluster. Using both actual evaluation and analytical modeling we bring out the differences between these two extreme techniques and show that AIS is often the right energy saving strategy.<\/jats:p>","DOI":"10.14778\/1920841.1920862","type":"journal-article","created":{"date-parts":[[2014,6,24]],"date-time":"2014-06-24T12:17:57Z","timestamp":1403612277000},"page":"129-139","source":"Crossref","is-referenced-by-count":137,"title":["Energy management for MapReduce clusters"],"prefix":"10.14778","volume":"3","author":[{"given":"Willis","family":"Lang","sequence":"first","affiliation":[{"name":"University of Wisconsin-Madison"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jignesh M.","family":"Patel","sequence":"additional","affiliation":[{"name":"University of Wisconsin-Madison"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2010,9]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"http:\/\/www.infoq.com\/articles\/hadoop-interview.  http:\/\/www.infoq.com\/articles\/hadoop-interview."},{"key":"e_1_2_1_2_1","unstructured":"SPEC Power. http:\/\/www.spec.org\/power_ssj2008.  SPEC Power. http:\/\/www.spec.org\/power_ssj2008."},{"key":"e_1_2_1_3_1","unstructured":"VMware Infrastructure Architecture Overview White Paper. http:\/\/www.vmware.com\/pdf\/vi_architecture_wp.pdf.  VMware Infrastructure Architecture Overview White Paper. http:\/\/www.vmware.com\/pdf\/vi_architecture_wp.pdf."},{"key":"e_1_2_1_4_1","volume-title":"To Congress on Server and Data Center Energy Efficiency. In U.S. EPA Technical Report","year":"2007"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2007.443"},{"key":"e_1_2_1_6_1","volume-title":"the","author":"Belady C."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2004.217"},{"key":"e_1_2_1_8_1","volume-title":"The Hadoop Distributed File System: Architecture and Design. In hadoop.apache.org","author":"Borthakur D.","year":"2007"},{"key":"e_1_2_1_9_1","volume-title":"Data Center Energy Efficiency and Productivity","author":"Brill K. G.","year":"2007"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/782814.782829"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/502034.502045"},{"key":"e_1_2_1_13_1","volume-title":"NSDI","author":"Clark C.","year":"2005"},{"key":"e_1_2_1_14_1","volume-title":"OSDI","author":"Dean J.","year":"2004"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/945445.945450"},{"key":"e_1_2_1_16_1","volume-title":"Where Does Power Go In DCs and How To Get It Back? http:\/\/mvdirona.com\/jrh\/TalksAndPapers\/JamesRH_DCPowerSavingsFooCamp08.ppt","author":"Hamilton J.","year":"2008"},{"key":"e_1_2_1_17_1","volume-title":"Low Power Servers for Internet-Scale Services. In CIDR","author":"Hamilton J.","year":"2009"},{"key":"e_1_2_1_18_1","volume-title":"CIDR","author":"Harizopoulos S.","year":"2009"},{"key":"e_1_2_1_19_1","volume-title":"CIDR","author":"Lang W.","year":"2009"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/1815948.1815956"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/1869389.1869396"},{"key":"e_1_2_1_22_1","volume-title":"HotPower","author":"Leverich J.","year":"2009"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISCA.2008.37"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/1508244.1508269"},{"key":"e_1_2_1_25_1","volume-title":"Workshop on Cell Systems and Applications","author":"Noll A.","year":"2008"},{"key":"e_1_2_1_26_1","unstructured":"Numonyx Memory Solutions. www.numonyx.com\/Documents\/WhitePapers\/PCM_Basics_WP.pdf.  Numonyx Memory Solutions. www.numonyx.com\/Documents\/WhitePapers\/PCM_Basics_WP.pdf."},{"key":"e_1_2_1_27_1","unstructured":"C. D. Patel and A. J. Shah. Cost Model for Planning Development and Operation of a Datacenter. http:\/\/www.hpl.hp.com\/techreports\/2005\/HPL-2005-107R1.pdf.  C. D. Patel and A. J. Shah. Cost Model for Planning Development and Operation of a Datacenter. http:\/\/www.hpl.hp.com\/techreports\/2005\/HPL-2005-107R1.pdf."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/1559845.1559865"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/1006209.1006220"},{"key":"e_1_2_1_30_1","volume-title":"Load Balancing and Unbalancing for Power and Performance in Cluster-Based Systems. In Workshop on Compilers and Operating Systems for Low Power","author":"Pinheiro E.","year":"2001"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/1140277.1140281"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.5555\/1153924.1154555"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISCA.2006.20"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/1247480.1247522"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2007.436"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISCA.2008.11"},{"key":"e_1_2_1_37_1","volume-title":"Ven. Getting Maximum Mileage Out of Tickless. In Linux Symposium","author":"Siddha S.","year":"2007"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.5555\/1064323.1064336"},{"key":"e_1_2_1_39_1","volume-title":"HotPower","author":"Tolia N.","year":"2008"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/1807167.1807194"},{"key":"e_1_2_1_41_1","volume-title":"USENIX","author":"Vasudevan V.","year":"2009"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/1289720.1289721"}],"container-title":["Proceedings of the VLDB Endowment"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.14778\/1920841.1920862","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,28]],"date-time":"2022-12-28T11:47:48Z","timestamp":1672228068000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.14778\/1920841.1920862"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2010,9]]},"references-count":41,"journal-issue":{"issue":"1-2","published-print":{"date-parts":[[2010,9]]}},"alternative-id":["10.14778\/1920841.1920862"],"URL":"https:\/\/doi.org\/10.14778\/1920841.1920862","relation":{},"ISSN":["2150-8097"],"issn-type":[{"value":"2150-8097","type":"print"}],"subject":[],"published":{"date-parts":[[2010,9]]}}}