{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T06:43:49Z","timestamp":1740120229921,"version":"3.37.3"},"reference-count":33,"publisher":"World Scientific Pub Co Pte Ltd","issue":"13","funder":[{"DOI":"10.13039\/501100001809","name":"the National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["61303029"],"award-info":[{"award-number":["61303029"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"National Social Science Foundation of China","award":["15BGL048"],"award-info":[{"award-number":["15BGL048"]}]},{"name":"Hubei Province Science and Technology Support Project","award":["2015BAA072"],"award-info":[{"award-number":["2015BAA072"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Int. J. Patt. Recogn. Artif. Intell."],"published-print":{"date-parts":[[2019,12,15]]},"abstract":"<jats:p> In recent years, how to use renewable energy to reduce the energy cost of internet data center (IDC) has been an urgent problem to be solved. More and more solutions are beginning to consider machine learning, but many of the existing methods need to take advantage of some future information, which is difficult to obtain in the actual operation process. In this paper, we focus on reducing the energy cost of IDC by controlling the energy flow of renewable energy without any future information. we propose an efficient energy dynamic control algorithm based on the theory of reinforcement learning, which approximates the optimal solution by learning the feedback of historical control decisions. For the purpose of avoiding overestimation, improving the convergence ability of the algorithm, we use the double [Formula: see text]-method to further optimize. The extensive experimental results show that our algorithm can on average save the energy cost by 18.3% and reduce the rate of grid intervention by 26.2% compared with other algorithms, and thus has good application prospects. <\/jats:p>","DOI":"10.1142\/s0218001419510091","type":"journal-article","created":{"date-parts":[[2019,3,3]],"date-time":"2019-03-03T23:19:16Z","timestamp":1551655156000},"page":"1951009","source":"Crossref","is-referenced-by-count":0,"title":["An Energy Dynamic Control Algorithm Based on Reinforcement Learning for Data Centers"],"prefix":"10.1142","volume":"33","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0887-7427","authenticated-orcid":false,"given":"Yao","family":"Xiang","sequence":"first","affiliation":[{"name":"School of Computer Science and Technology, Wuhan University of Technology, Wuhan 430070, P. R. China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jingling","family":"Yuan","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Wuhan University of Technology, Wuhan 430070, P. R. China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ruiqi","family":"Luo","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Wuhan University of Technology, Wuhan 430070, P. R. China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xian","family":"Zhong","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Wuhan University of Technology, Wuhan 430070, P. R. China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tao","family":"Li","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, University of Florida, Florida 32611, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"219","published-online":{"date-parts":[[2019,12,17]]},"reference":[{"key":"S0218001419510091BIB001","doi-asserted-by":"publisher","DOI":"10.5547\/01956574.38.SI1.dace"},{"key":"S0218001419510091BIB002","doi-asserted-by":"publisher","DOI":"10.1287\/msom.2016.0595"},{"key":"S0218001419510091BIB004","doi-asserted-by":"publisher","DOI":"10.1109\/CSNT.2013.124"},{"issue":"1","key":"S0218001419510091BIB005","first-page":"65","volume":"6","author":"Bellman R. E.","year":"1957","journal-title":"J. Math. Fluid Mech."},{"key":"S0218001419510091BIB006","doi-asserted-by":"publisher","DOI":"10.1109\/CEC.2015.7257102"},{"key":"S0218001419510091BIB007","doi-asserted-by":"publisher","DOI":"10.1109\/TSUSC.2017.2711925"},{"key":"S0218001419510091BIB008","doi-asserted-by":"publisher","DOI":"10.1049\/iet-cta.2015.1081"},{"key":"S0218001419510091BIB009","doi-asserted-by":"publisher","DOI":"10.1007\/s00607-014-0405-x"},{"key":"S0218001419510091BIB010","doi-asserted-by":"publisher","DOI":"10.1007\/s00607-014-0407-8"},{"key":"S0218001419510091BIB011","doi-asserted-by":"publisher","DOI":"10.1109\/PDCAT.2016.037"},{"key":"S0218001419510091BIB015","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-62238-5_8"},{"key":"S0218001419510091BIB016","doi-asserted-by":"publisher","DOI":"10.1002\/cpe.4125"},{"key":"S0218001419510091BIB017","doi-asserted-by":"publisher","DOI":"10.1109\/LCOMM.2014.2369459"},{"key":"S0218001419510091BIB018","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcss.2015.07.001"},{"key":"S0218001419510091BIB019","doi-asserted-by":"publisher","DOI":"10.1007\/s11704-015-5018-9"},{"key":"S0218001419510091BIB020","doi-asserted-by":"publisher","DOI":"10.1109\/IC2E.2016.33"},{"key":"S0218001419510091BIB021","doi-asserted-by":"publisher","DOI":"10.1145\/2940679.2940684"},{"key":"S0218001419510091BIB022","doi-asserted-by":"publisher","DOI":"10.1016\/j.jpdc.2017.10.009"},{"key":"S0218001419510091BIB023","doi-asserted-by":"publisher","DOI":"10.1016\/j.eneco.2016.12.019"},{"key":"S0218001419510091BIB024","doi-asserted-by":"publisher","DOI":"10.1016\/j.sysconle.2018.01.003"},{"key":"S0218001419510091BIB025","doi-asserted-by":"publisher","DOI":"10.1145\/2934328.2934346"},{"key":"S0218001419510091BIB026","doi-asserted-by":"publisher","DOI":"10.1109\/IPDPSW.2017.25"},{"key":"S0218001419510091BIB027","doi-asserted-by":"publisher","DOI":"10.1109\/CSNDSP.2018.8471785"},{"key":"S0218001419510091BIB028","doi-asserted-by":"publisher","DOI":"10.1109\/ISGT-Asia.2016.7796524"},{"key":"S0218001419510091BIB029","doi-asserted-by":"publisher","DOI":"10.1109\/TNN.1998.712192"},{"key":"S0218001419510091BIB030","doi-asserted-by":"publisher","DOI":"10.1016\/j.jnca.2017.01.036"},{"key":"S0218001419510091BIB031","doi-asserted-by":"publisher","DOI":"10.1109\/LCOMM.2016.2631466"},{"key":"S0218001419510091BIB032","doi-asserted-by":"publisher","DOI":"10.1109\/CISS.2016.7460532"},{"key":"S0218001419510091BIB033","doi-asserted-by":"publisher","DOI":"10.1016\/j.simpat.2015.01.005"},{"key":"S0218001419510091BIB034","doi-asserted-by":"publisher","DOI":"10.1109\/MCC.2018.1081060"},{"key":"S0218001419510091BIB036","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2017\/483"},{"key":"S0218001419510091BIB037","doi-asserted-by":"publisher","DOI":"10.1109\/TPDS.2016.2607715"},{"key":"S0218001419510091BIB038","doi-asserted-by":"publisher","DOI":"10.1109\/IWQoS.2017.7969118"}],"container-title":["International Journal of Pattern Recognition and Artificial Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S0218001419510091","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,12,18]],"date-time":"2019-12-18T03:00:41Z","timestamp":1576638041000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/abs\/10.1142\/S0218001419510091"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,12,15]]},"references-count":33,"journal-issue":{"issue":"13","published-print":{"date-parts":[[2019,12,15]]}},"alternative-id":["10.1142\/S0218001419510091"],"URL":"https:\/\/doi.org\/10.1142\/s0218001419510091","relation":{},"ISSN":["0218-0014","1793-6381"],"issn-type":[{"type":"print","value":"0218-0014"},{"type":"electronic","value":"1793-6381"}],"subject":[],"published":{"date-parts":[[2019,12,15]]}}}