{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,4]],"date-time":"2026-07-04T11:28:32Z","timestamp":1783164512790,"version":"3.54.6"},"reference-count":30,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,9,9]],"date-time":"2021-09-09T00:00:00Z","timestamp":1631145600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,9,9]],"date-time":"2021-09-09T00:00:00Z","timestamp":1631145600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"the Science and Technology Project of SGCC","award":["5400-201955369A-0-0-00"],"award-info":[{"award-number":["5400-201955369A-0-0-00"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Cloud Comp"],"published-print":{"date-parts":[[2021,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>In current power grids, a massive amount of power equipment raises various emerging requirements, e.g., data perception, information transmission, and real-time control. The existing cloud computing paradigm is stubborn to address issues and challenges such as rapid response and local autonomy. Microgrids contain diverse and adjustable power components, making the power system complex and difficult to optimize. The existing traditional adjusting methods are manual and centralized, which requires many human resources with expert experience. The adjustment method based on edge intelligence can effectively leverage ubiquitous computing capacities to provide distributed intelligent solutions with lots of research issues to be reckoned with. To address this challenge, we consider a power control framework combining edge computing and reinforcement learning, which makes full use of edge nodes to sense network state and control power equipment to achieve the goal of fast response and local autonomy. Additionally, we focus on the non-convergence problem of power flow calculation, and combine deep reinforcement learning and multi-agent methods to realize intelligent decisions, with designing the model such as state, action, and reward. Our method improves the efficiency and scalability compared with baseline methods. The simulation results demonstrate the effectiveness of our method with intelligent adjusting and stable operation under various conditions.<\/jats:p>","DOI":"10.1186\/s13677-021-00259-1","type":"journal-article","created":{"date-parts":[[2021,9,9]],"date-time":"2021-09-09T08:02:48Z","timestamp":1631174568000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":34,"title":["Power flow adjustment for smart microgrid based on edge computing and multi-agent deep reinforcement learning"],"prefix":"10.1186","volume":"10","author":[{"given":"Tianjiao","family":"Pu","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xinying","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yifan","family":"Cao","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhicheng","family":"Liu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2224-2292","authenticated-orcid":false,"given":"Chao","family":"Qiu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ji","family":"Qiao","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shuhua","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2021,9,9]]},"reference":[{"issue":"99","key":"259_CR1","doi-asserted-by":"publisher","first-page":"869","DOI":"10.1109\/COMST.2020.2970550","volume":"22","author":"X Wang","year":"2020","unstructured":"Wang X, Han Y, Leung V, Niyato D, Chen X (2020) Convergence of edge computing and deep learning: A comprehensive survey. IEEE Commun Surv Tutor 22(99):869\u2013904.","journal-title":"IEEE Commun Surv Tutor"},{"issue":"6","key":"259_CR2","doi-asserted-by":"publisher","first-page":"6510","DOI":"10.1109\/TPWRS.2018.2829021","volume":"33","author":"L Thurner","year":"2018","unstructured":"Thurner L, Scheidler A, Sch\u00e4fer F, Menke J, Dollichon J, Meier F, Meinecke S, Braun M (2018) pandapower\u2014an open-source python tool for convenient modeling, analysis, and optimization of electric power systems. IEEE Trans Power Syst 33(6):6510\u20136521. https:\/\/doi.org\/10.1109\/TPWRS.2018.2829021.","journal-title":"IEEE Trans Power Syst"},{"issue":"1","key":"259_CR3","first-page":"213","volume":"6","author":"Z Zhang","year":"2020","unstructured":"Zhang Z, Zhang D, Qiu RC (2020) Deep reinforcement learning for power system applications: An overview. CSEE J Power Energy Syst 6(1):213\u2013225.","journal-title":"CSEE J Power Energy Syst"},{"issue":"10","key":"259_CR4","doi-asserted-by":"publisher","first-page":"6926","DOI":"10.1109\/TWC.2017.2734646","volume":"16","author":"X Li","year":"2017","unstructured":"Li X, Wang X, Li K, Han Z, Leung VCM (2017) Collaborative multi-tier caching in heterogeneous networks: Modeling, analysis, and design. IEEE Trans Wirel Commun 16(10):6926\u20136939. https:\/\/doi.org\/10.1109\/TWC.2017.2734646.","journal-title":"IEEE Trans Wirel Commun"},{"issue":"4","key":"259_CR5","doi-asserted-by":"publisher","first-page":"54","DOI":"10.1109\/MCOM.2017.1600863","volume":"55","author":"TX Tran","year":"2017","unstructured":"Tran TX, Hajisami A, Pandey P, Pompili D (2017) Collaborative mobile edge computing in 5g networks: New paradigms, scenarios, and challenges. IEEE Commun Mag 55(4):54\u201361. https:\/\/doi.org\/10.1109\/MCOM.2017.1600863.","journal-title":"IEEE Commun Mag"},{"issue":"5","key":"259_CR6","doi-asserted-by":"publisher","first-page":"156","DOI":"10.1109\/MNET.2019.1800286","volume":"33","author":"X Wang","year":"2019","unstructured":"Wang X, Han Y, Wang C, Zhao Q, Chen M (2019) In-edge ai: Intelligentizing mobile edge computing, caching and communication by federated learning. IEEE Network 33(5):156\u2013165.","journal-title":"IEEE Network"},{"key":"259_CR7","doi-asserted-by":"publisher","unstructured":"Trajano AFR, de Sousa AAM, Rodrigues EB, de Souza JN, de Castro Callado A, Coutinho EF (2019) Leveraging mobile edge computing on smart grids using LTE cellular networks In: 2019 IEEE Symposium on Computers and Communications (ISCC), 1\u20137. https:\/\/doi.org\/10.1109\/ISCC47284.2019.8969784.","DOI":"10.1109\/ISCC47284.2019.8969784"},{"key":"259_CR8","doi-asserted-by":"publisher","unstructured":"Barik RK, Gudey SK, Reddy GG, Pant M, Dubey H, Mankodiya K, Kumar V (2017) FogGrid: Leveraging fog computing for enhanced smart grid network In: 2017 14th IEEE India Council International Conference (INDICON), 1\u20136. https:\/\/doi.org\/10.1109\/INDICON.2017.8487997.","DOI":"10.1109\/INDICON.2017.8487997"},{"key":"259_CR9","doi-asserted-by":"publisher","unstructured":"Huang Y, Lu Y, Wang F, Fan X, Liu J, Leung VCM (2018) An edge computing framework for real-time monitoring in smart grid In: 2018 IEEE International Conference on Industrial Internet (ICII), 99\u2013108. https:\/\/doi.org\/10.1109\/ICII.2018.00019.","DOI":"10.1109\/ICII.2018.00019"},{"key":"259_CR10","doi-asserted-by":"publisher","unstructured":"El-Awadi R, Fern\u00e1ndez-Vilas A, D\u00edaz Redondo RP (2019) Fog computing solution for distributed anomaly detection in smart grids In: 2019 International Conference on Wireless and Mobile Computing, Networking and Communications (WiMob), 348\u2013353. https:\/\/doi.org\/10.1109\/WiMOB.2019.8923222.","DOI":"10.1109\/WiMOB.2019.8923222"},{"key":"259_CR11","doi-asserted-by":"publisher","first-page":"74089","DOI":"10.1109\/ACCESS.2019.2920488","volume":"7","author":"S Chen","year":"2019","unstructured":"Chen S, Wen H, Wu J, Lei W, Hou W, Liu W, Xu A, Jiang Y (2019) Internet of things based smart grids supported by intelligent edge computing. IEEE Access 7:74089\u201374102. https:\/\/doi.org\/10.1109\/ACCESS.2019.2920488.","journal-title":"IEEE Access"},{"key":"259_CR12","doi-asserted-by":"publisher","unstructured":"Albataineh H, Nijim M, Bollampall D (2020) The design of a novel smart home control system using smart grid based on edge and cloud computing In: 2020 IEEE 8th International Conference on Smart Energy Grid Engineering (SEGE), 88\u201391. https:\/\/doi.org\/10.1109\/SEGE49949.2020.9181961.","DOI":"10.1109\/SEGE49949.2020.9181961"},{"key":"259_CR13","doi-asserted-by":"crossref","unstructured":"Han Y, Guo D, Cai W, Wang X, Leung V (2020) Virtual machine placement optimization in mobile cloud gaming through QoE-oriented resource competition. IEEE Trans Cloud Comput. Early Access.","DOI":"10.1109\/TCC.2020.3002023"},{"issue":"9","key":"259_CR14","doi-asserted-by":"publisher","first-page":"220","DOI":"10.23919\/JCC.2020.09.017","volume":"17","author":"X Liu","year":"2020","unstructured":"Liu X, Yu J, Feng Z, Gao Y (2020) Multi-agent reinforcement learning for resource allocation in IoT networks with edge computing. China Commun 17(9):220\u2013236. https:\/\/doi.org\/10.23919\/JCC.2020.09.017.","journal-title":"China Commun"},{"issue":"10","key":"259_CR15","doi-asserted-by":"publisher","first-page":"9441","DOI":"10.1109\/JIOT.2020.2986803","volume":"7","author":"X Wang","year":"2020","unstructured":"Wang X, Wang C, Li X, Leung VCM, Taleb T (2020) Federated deep reinforcement learning for internet of things with decentralized cooperative edge caching. IEEE Internet Things J 7(10):9441\u20139455. https:\/\/doi.org\/10.1109\/JIOT.2020.2986803.","journal-title":"IEEE Internet Things J"},{"key":"259_CR16","doi-asserted-by":"publisher","first-page":"121377","DOI":"10.1016\/j.energy.2021.121377","volume":"235","author":"T Yang","year":"2021","unstructured":"Yang T, Zhao L, Li W, Zomaya AY (2021) Dynamic energy dispatch strategy for integrated energy system based on improved deep reinforcement learning. Energy 235:121377.","journal-title":"Energy"},{"key":"259_CR17","doi-asserted-by":"publisher","unstructured":"Fang X, Wang J, Yin C, Han Y, Zhao Q (2020) Multiagent reinforcement learning with learning automata for microgrid energy management and decision optimization In: 2020 Chinese Control And Decision Conference (CCDC), 779\u2013784. https:\/\/doi.org\/10.1109\/CCDC49329.2020.9164742.","DOI":"10.1109\/CCDC49329.2020.9164742"},{"issue":"12","key":"259_CR18","doi-asserted-by":"publisher","first-page":"2291","DOI":"10.3390\/en12122291","volume":"12","author":"Y Ji","year":"2019","unstructured":"Ji Y, Wang J, Xu J, Fang X, Zhang H (2019) Real-time energy management of a microgrid using deep reinforcement learning. Energies 12(12):2291.","journal-title":"Energies"},{"key":"259_CR19","doi-asserted-by":"publisher","unstructured":"Etemad S, Mozayani N (2015) Using reinforcement learning to make smart energy storage sources in microgrid In: 2015 30th International Power System Conference (PSC), 345\u2013350. https:\/\/doi.org\/10.1109\/IPSC.2015.7827771.","DOI":"10.1109\/IPSC.2015.7827771"},{"issue":"6","key":"259_CR20","doi-asserted-by":"publisher","first-page":"2192","DOI":"10.1109\/TNNLS.2018.2801880","volume":"29","author":"W Liu","year":"2018","unstructured":"Liu W, Zhuang P, Liang H, Peng J, Huang Z (2018) Distributed economic dispatch in microgrids based on cooperative reinforcement learning. IEEE Trans Neural Netw Learn Syst 29(6):2192\u20132203. https:\/\/doi.org\/10.1109\/TNNLS.2018.2801880.","journal-title":"IEEE Trans Neural Netw Learn Syst"},{"issue":"11","key":"259_CR21","doi-asserted-by":"publisher","first-page":"1846","DOI":"10.3390\/en10111846","volume":"10","author":"M Brida","year":"2017","unstructured":"Brida M, Frederik R, Fred S, Geert D (2017) Battery energy management in a microgrid using batch reinforcement learning. Energies 10(11):1846.","journal-title":"Energies"},{"key":"259_CR22","doi-asserted-by":"publisher","unstructured":"Dabbaghjamanesh M, Zhang J (2020) Deep learning-based real-time switching of reconfigurable microgrids In: 2020 IEEE Power Energy Society Innovative Smart Grid Technologies Conference (ISGT), 1\u20135. https:\/\/doi.org\/10.1109\/ISGT45199.2020.9087729.","DOI":"10.1109\/ISGT45199.2020.9087729"},{"issue":"002","key":"259_CR23","first-page":"46","volume":"014","author":"D Ma","year":"2020","unstructured":"Ma D, Shen C, Chen Y, Li D (2020) Feasibility study on the convergence criterion of power flow calculation based on deep learning. South Power Syst Technol (Chinese) 014(002):46\u201354.","journal-title":"South Power Syst Technol (Chinese)"},{"issue":"8","key":"259_CR24","first-page":"2396","volume":"40","author":"T Wang","year":"2020","unstructured":"Wang T, Tang Y, Guo Q, Huang Y, Chen X, Huang H (2020) Automatic adjustment method of power flow calculation convergence for large-scale power grid based on knowledge experience and deep reinforcement learning. Proc Chin Soc Electr Eng (Chinese) 40(8):2396\u20132405.","journal-title":"Proc Chin Soc Electr Eng (Chinese)"},{"key":"259_CR25","doi-asserted-by":"publisher","unstructured":"Zhu X, Liu C, Su C, Liu JLearning-based probabilistic power flow calculation considering the correlation among multiple wind farms. IEEE Access 8(99):136782\u2013136793. https:\/\/doi.org\/10.1109\/ACCESS.2020.3011511.","DOI":"10.1109\/ACCESS.2020.3011511"},{"issue":"3","key":"259_CR26","doi-asserted-by":"publisher","first-page":"2235","DOI":"10.1109\/TSG.2019.2950115","volume":"11","author":"Y Yang","year":"2020","unstructured":"Yang Y, Yang Z, Yu J, Zhang B, Zhang Y, Yu H (2020) Fast calculation of probabilistic power flow: A model-based deep learning approach. IEEE Trans Smart Grid 11(3):2235\u20132244. https:\/\/doi.org\/10.1109\/TSG.2019.2950115.","journal-title":"IEEE Trans Smart Grid"},{"issue":"12","key":"259_CR27","first-page":"103","volume":"40","author":"T Su","year":"2020","unstructured":"Su T, Liu Y, Shen X, Liu T, Qiu G, Liu J (2020) Deep learning-driven evolutionary algorithm for preventive control of power system transient stability. Proc Chin Soc Electr Eng (Chinese) 40(12):103\u2013114.","journal-title":"Proc Chin Soc Electr Eng (Chinese)"},{"issue":"2","key":"259_CR28","doi-asserted-by":"publisher","first-page":"1171","DOI":"10.1109\/TSG.2019.2933191","volume":"11","author":"Q Huang","year":"2020","unstructured":"Huang Q, Huang R, Hao W, Tan J, Fan R, Huang Z (2020) Adaptive power system emergency control using deep reinforcement learning. IEEE Trans Smart Grid 11(2):1171\u20131182.","journal-title":"IEEE Trans Smart Grid"},{"issue":"6","key":"259_CR29","doi-asserted-by":"publisher","first-page":"114","DOI":"10.35940\/ijitee.F8828.0410621","volume":"10","author":"M Sinan","year":"2021","unstructured":"Sinan M, Sivakumar WM, Anguraja R (2021) Power system voltage stability analysis with renewable power integration. Int J Innov Technol Exploring Eng 10(6):114\u2013117.","journal-title":"Int J Innov Technol Exploring Eng"},{"key":"259_CR30","doi-asserted-by":"crossref","unstructured":"Leveringhaus T, Hofmann L (2011) Optimized voltage and reactive power adjustment in power grids using the least-squares-method: Optimization of highly utilized power grids with stochastic renewable energy-sources In: 2011 International Conference on Power and Energy Systems, 1\u20136.","DOI":"10.1109\/ICPES.2011.6156648"}],"container-title":["Journal of Cloud Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13677-021-00259-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s13677-021-00259-1\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13677-021-00259-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,9,9]],"date-time":"2021-09-09T08:15:48Z","timestamp":1631175348000},"score":1,"resource":{"primary":{"URL":"https:\/\/journalofcloudcomputing.springeropen.com\/articles\/10.1186\/s13677-021-00259-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,9,9]]},"references-count":30,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,12]]}},"alternative-id":["259"],"URL":"https:\/\/doi.org\/10.1186\/s13677-021-00259-1","relation":{},"ISSN":["2192-113X"],"issn-type":[{"value":"2192-113X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,9,9]]},"assertion":[{"value":"22 February 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 July 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 September 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"48"}}