{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,9,17]],"date-time":"2025-09-17T16:36:11Z","timestamp":1758126971813,"version":"3.41.0"},"reference-count":43,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2014,8,1]],"date-time":"2014-08-01T00:00:00Z","timestamp":1406851200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001868","name":"National Science Council Taiwan","doi-asserted-by":"publisher","award":["NSC101-2221-E-008-137-MY3"],"award-info":[{"award-number":["NSC101-2221-E-008-137-MY3"]}],"id":[{"id":"10.13039\/501100001868","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Des. Autom. Electron. Syst."],"published-print":{"date-parts":[[2014,8]]},"abstract":"<jats:p>\n            Dynamic power management has become an imperative design factor to attain the energy efficiency in modern systems. Among various power management schemes, learning-based policies that are adaptive to different environments and applications have demonstrated superior performance to other approaches. However, they suffer the scalability problem for multiprocessors due to the increasing number of cores in a system. In this article, we propose a scalable and effective online policy called MultiLevel Reinforcement Learning (MLRL). By exploiting the hierarchical paradigm, the time complexity of MLRL is\n            <jats:italic>O<\/jats:italic>\n            (\n            <jats:italic>n<\/jats:italic>\n            lg\n            <jats:italic>n<\/jats:italic>\n            ) for\n            <jats:italic>n<\/jats:italic>\n            cores and the convergence rate is greatly raised by compressing redundant searching space. Some advanced techniques, such as the function approximation and the action selection scheme, are included to enhance the generality and stability of the proposed policy. By simulating on the SPLASH-2 benchmarks, MLRL runs 53% faster and outperforms the state-of-the-art work with 13.6% energy saving and 2.7% latency penalty on average. The generality and the scalability of MLRL are also validated through extensive simulations.\n          <\/jats:p>","DOI":"10.1145\/2629486","type":"journal-article","created":{"date-parts":[[2014,8,26]],"date-time":"2014-08-26T12:08:55Z","timestamp":1409054935000},"page":"1-23","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":9,"title":["Scalable Power Management Using Multilevel Reinforcement Learning for Multiprocessors"],"prefix":"10.1145","volume":"19","author":[{"given":"Gung-Yu","family":"Pan","sequence":"first","affiliation":[{"name":"National Chiao Tung University, Hsinchu City, Taiwan"}]},{"given":"Jing-Yang","family":"Jou","sequence":"additional","affiliation":[{"name":"National Central University and National Chiao Tung University, Taoyuan County, Taiwan"}]},{"given":"Bo-Cheng","family":"Lai","sequence":"additional","affiliation":[{"name":"National Chiao Tung University, Hsinchu City, Taiwan"}]}],"member":"320","published-online":{"date-parts":[[2014,8,29]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"ACPI. 2011. ACPI - Advanced configuration and power interface specification. http:\/\/www.acpi.info\/.  ACPI. 2011. ACPI - Advanced configuration and power interface specification. http:\/\/www.acpi.info\/."},{"key":"e_1_2_1_2_1","unstructured":"AMD. 2013. AMD powernow! technology. http:\/\/www.amd.com\/us\/products\/technologies\/amd-powernow- technology\/Pages\/amd-powernow-technology.aspx.  AMD. 2013. AMD powernow! technology. http:\/\/www.amd.com\/us\/products\/technologies\/amd-powernow- technology\/Pages\/amd-powernow-technology.aspx."},{"key":"e_1_2_1_3_1","unstructured":"ARM. 2005. ARM intelligent energy controller technical overview. http:\/\/www.arm.com\/.  ARM. 2005. ARM intelligent energy controller technical overview. http:\/\/www.arm.com\/."},{"key":"e_1_2_1_4_1","unstructured":"ARM. 2012. Cortex-a9 mpcore technical reference manual. http:\/\/infocenter.arm.com\/help\/topic\/com.arm.doc. ddi0407i\/DDI0407I_cortex_a9_mpcore_r4p1_trm.pdf.  ARM. 2012. Cortex-a9 mpcore technical reference manual. http:\/\/infocenter.arm.com\/help\/topic\/com.arm.doc. ddi0407i\/DDI0407I_cortex_a9_mpcore_r4p1_trm.pdf."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1137\/05063787X"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1022140919877"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/92.845896"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/EUC.2010.35"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCAD.2009.2015740"},{"volume-title":"Idleness is not sloth. Tech. rep. Hewlett-Packard Laboratories","author":"Golding Richard","key":"e_1_2_1_10_1","unstructured":"Richard Golding , Peter Bosch , Carl Staelin , Tim Sullivan , and John Wilkes . 1996. Idleness is not sloth. Tech. rep. Hewlett-Packard Laboratories , Palo Alto, CA . Richard Golding, Peter Bosch, Carl Staelin, Tim Sullivan, and John Wilkes. 1996. Idleness is not sloth. Tech. rep. Hewlett-Packard Laboratories, Palo Alto, CA."},{"volume-title":"From a few cores to many: A tera-scale computing research overview. Tech. rep","author":"Held Jim","key":"e_1_2_1_11_1","unstructured":"Jim Held , Jerry Bautista , and Sean Koehi . 2006. From a few cores to many: A tera-scale computing research overview. Tech. rep ., Intel Corporation . Jim Held, Jerry Bautista, and Sean Koehi. 2006. From a few cores to many: A tera-scale computing research overview. Tech. rep., Intel Corporation."},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNN.2004.836241"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/335043.335046"},{"key":"e_1_2_1_14_1","unstructured":"Intel. 2013. Enhanced intel speedstep technology. http:\/\/www3.intel.com\/cd\/channel\/reseller\/asmo-na\/eng\/203838.htm.  Intel. 2013. Enhanced intel speedstep technology. http:\/\/www3.intel.com\/cd\/channel\/reseller\/asmo-na\/eng\/203838.htm."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/MICRO.2006.8"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.5555\/603095.603147"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVLSI.2008.2009014"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCAD.2010.2059270"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF01189993"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/92.748202"},{"key":"e_1_2_1_21_1","volume-title":"Proceedings of the 14th IEEE International Symposium on High Performance Computer Architecture. 123--134","author":"Kim Wonyoung","year":"2008","unstructured":"Wonyoung Kim , Meeta S. Gupta , Gu-Yeon Wei , and David Brooks . 2008 . System level analysis of fast, per-core dvfs using on-chip switching regulators . In Proceedings of the 14th IEEE International Symposium on High Performance Computer Architecture. 123--134 . Wonyoung Kim, Meeta S. Gupta, Gu-Yeon Wei, and David Brooks. 2008. System level analysis of fast, per-core dvfs using on-chip switching regulators. In Proceedings of the 14th IEEE International Symposium on High Performance Computer Architecture. 123--134."},{"key":"e_1_2_1_22_1","volume-title":"Proceedings of the Embedded World Conference.","author":"Knoth Matthias","year":"2009","unstructured":"Matthias Knoth . 2009 . Power management in an embedded multiprocessor cluster . In Proceedings of the Embedded World Conference. Matthias Knoth. 2009. Power management in an embedded multiprocessor cluster. In Proceedings of the Embedded World Conference."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.5555\/1620113.1620131"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/1669112.1669172"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.5555\/2014698.2014866"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/2382570.2382572"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/SASP.2011.5941085"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/225871.225877"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1991.3.2.213"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.5555\/1266366.1266533"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/1555754.1555793"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.5555\/1874620.1874992"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/1283780.1283791"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/2442087.2442095"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/2390191.2390194"},{"key":"e_1_2_1_36_1","volume-title":"Barto","author":"Sutton Richard S.","year":"1998","unstructured":"Richard S. Sutton and Andrew G . Barto . 1998 . Reinforcement Learning : An Introduction. The MIT Press . Richard S. Sutton and Andrew G. Barto. 1998. Reinforcement Learning: An Introduction. The MIT Press."},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/1687399.1687486"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.5555\/2051037.2051070"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/SBAC-PAD.2007.17"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/1854273.1854283"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/223982.223990"},{"key":"e_1_2_1_43_1","volume-title":"Using radial basis function networks for function approximation and classification. ISRN Appl. Math","author":"Wu Yue","year":"2012","unstructured":"Yue Wu , Hui Wang , Biaobiao Zhang , and Ke-Lin Du. 2012. Using radial basis function networks for function approximation and classification. ISRN Appl. Math . 2012 . Yue Wu, Hui Wang, Biaobiao Zhang, and Ke-Lin Du. 2012. Using radial basis function networks for function approximation and classification. ISRN Appl. Math. 2012."},{"key":"e_1_2_1_44_1","volume-title":"Proceedings of the Asia and South Pacific Design Automation Conference.","author":"Ye Rong","year":"2012","unstructured":"Rong Ye and Qiang Xu . 2012 . Learning-based power management for multi-core processors via idle period manipulation . In Proceedings of the Asia and South Pacific Design Automation Conference. Rong Ye and Qiang Xu. 2012. Learning-based power management for multi-core processors via idle period manipulation. In Proceedings of the Asia and South Pacific Design Automation Conference."}],"container-title":["ACM Transactions on Design Automation of Electronic Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2629486","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2629486","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T07:01:17Z","timestamp":1750230077000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2629486"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,8]]},"references-count":43,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2014,8]]}},"alternative-id":["10.1145\/2629486"],"URL":"https:\/\/doi.org\/10.1145\/2629486","relation":{},"ISSN":["1084-4309","1557-7309"],"issn-type":[{"type":"print","value":"1084-4309"},{"type":"electronic","value":"1557-7309"}],"subject":[],"published":{"date-parts":[[2014,8]]},"assertion":[{"value":"2013-07-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2014-04-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2014-08-29","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}