{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T08:50:35Z","timestamp":1776070235880,"version":"3.50.1"},"reference-count":29,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2024,8,28]],"date-time":"2024-08-28T00:00:00Z","timestamp":1724803200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Future Internet"],"abstract":"<jats:p>Massive computational resources are required by a booming number of artificial intelligence (AI) services in the communication network of the smart grid. To alleviate the computational pressure on data centers, edge computing first network (ECFN) can serve as an effective solution to realize distributed model training based on data parallelism for AI services in smart grid. Due to AI services with diversified types, an edge data center has a changing workload in different time periods. Selfish edge data centers from different edge suppliers are reluctant to share their computing resources without a rule for fair competition. AI services-oriented dynamic computational resource scheduling of edge data centers affects both the economic profit of AI service providers and computational resource utilization. This letter mainly discusses the partition and distribution of AI data based on distributed model training and dynamic computational resource scheduling problems among multiple edge data centers for AI services. To this end, a mixed integer linear programming (MILP) model and a Deep Reinforcement Learning (DRL)-based algorithm are proposed. Simulation results show that the proposed DRL-based algorithm outperforms the benchmark in terms of profit of AI service provider, backlog of distributed model training tasks, running time and multi-objective optimization.<\/jats:p>","DOI":"10.3390\/fi16090312","type":"journal-article","created":{"date-parts":[[2024,8,28]],"date-time":"2024-08-28T11:54:10Z","timestamp":1724846050000},"page":"312","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["AI Services-Oriented Dynamic Computing Resource Scheduling Algorithm Based on Distributed Data Parallelism in Edge Computing Network of Smart Grid"],"prefix":"10.3390","volume":"16","author":[{"given":"Jing","family":"Zou","sequence":"first","affiliation":[{"name":"State Grid Economic and Technological Research Institute Ltd., Beijing 221005, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Peizhe","family":"Xin","sequence":"additional","affiliation":[{"name":"State Grid Economic and Technological Research Institute Ltd., Beijing 221005, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chang","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Information and Communication Engineering, Beijing University of Posts and Telecommunications, Beijing 100876, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5994-9419","authenticated-orcid":false,"given":"Heli","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Information and Communication Engineering, Beijing University of Posts and Telecommunications, Beijing 100876, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lei","family":"Wei","sequence":"additional","affiliation":[{"name":"Information and Telecommunication Branch, State Grid Jiangsu Electric Power Ltd., Nanjing 211103, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ying","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Information and Communication Engineering, Beijing University of Posts and Telecommunications, Beijing 100876, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2024,8,28]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Tang, W., Lu, W., Tan, Q., Ma, J., and Liu, Z. (2022, January 20\u201321). Research on the status and development trend of the data center from the perspective of energy and power. Proceedings of the IEEE International Conference on Advances in Electrical Engineering and Computer Applications (AEECA), Dalian, China.","DOI":"10.1109\/AEECA55500.2022.9918979"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1896","DOI":"10.1109\/TSG.2015.2452293","article-title":"Cloud-Based Information Infrastructure for Next-Generation Power Grid: Conception, Architecture, and Applications","volume":"7","author":"Luo","year":"2016","journal-title":"IEEE Trans. Smart Grid"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"101504","DOI":"10.1016\/j.asej.2021.05.018","article-title":"Prosumer in smart grids based on intelligent edge computing: A review on Artificial Intelligence Scheduling Techniques","volume":"13","author":"Slama","year":"2022","journal-title":"Ain Shams Eng. J."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3339474","article-title":"Federated machine learning: Concept and applications","volume":"10","author":"Yang","year":"2019","journal-title":"ACM Trans. Intell. Syst. Technol."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"100006","DOI":"10.1016\/j.adapen.2020.100006","article-title":"Smart grid encounters edge computing: Opportunities and applications","volume":"1","author":"Feng","year":"2021","journal-title":"Adv. Appl. Energy"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Gao, H., Xia, W., Yan, F., and Shen, L. (July, January 25). Optimal Cloud Resource Scheduling in Smart Grid: A Hierarchical Game Approach. Proceedings of the 2020 IEEE 91st Vehicular Technology Conference (VTC2020-Spring), Online.","DOI":"10.1109\/VTC2020-Spring48590.2020.9128752"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Yao, J., Li, Z., Li, Y., Bai, J., Wang, J., and Lin, P. (2019, January 24\u201328). Cost-Efficient Tasks Scheduling for Smart Grid Communication Network with Edge Computing System. Proceedings of the 15th International Wireless Communications & Mobile Computing Conference (IWCMC), Tangier, Morocco.","DOI":"10.1109\/IWCMC.2019.8766607"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Li, Z., Liu, Y., Xin, R., Gao, L., Ding, X., and Hu, Y. (2019, January 9\u201310). A Dynamic Game Model for Resource Allocation in Fog Computing for Ubiquitous Smart Grid. Proceedings of the 2019 28th Wireless and Optical Communications Conference (WOCC), Beijing, China.","DOI":"10.1109\/WOCC.2019.8770573"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"3079","DOI":"10.1109\/JIOT.2021.3111838","article-title":"Adaptive and Priority-Based Resource Allocation for Efficient Resources Utilization in Mobile-Edge Computing","volume":"10","author":"Sharif","year":"2023","journal-title":"IEEE Internet Things J."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Jiang, J., Xin, P., Wang, Y., Liu, L., Chai, Y., Zhang, Y., and Liu, S. (2021, January 17\u201319). Computing Resource Allocation in Mobile Edge Networks Based on Game Theory. Proceedings of the 2021 IEEE 4th International Conference on Electronics and Communication Engineering (ICECE), Xi\u2032an, China.","DOI":"10.1109\/ICECE54449.2021.9674451"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Wang, G., Xu, F., and Zhao, C. (2020, January 7\u201311). Multi-Access Edge Computing Based Vehicular Network: Joint Task Scheduling and Resource Allocation Strategy. Proceedings of the 2020 IEEE International Conference on Communications Workshops (ICC Workshops), Dublin, Ireland.","DOI":"10.1109\/ICCWorkshops49005.2020.9145277"},{"key":"ref_12","first-page":"808","article-title":"Resource Scheduling Algorithms for Burst Network Flow in Edge Computing","volume":"Volume 808","author":"Liu","year":"2022","journal-title":"Lecture Notes in Electrical Engineering, Proceedings of the 11th International Conference on Computer Engineering and Networks, Hechi, China, 21\u201325 October 2021"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"3144","DOI":"10.1109\/TVT.2021.3139026","article-title":"Combined Communication and Computing Resource Scheduling in Sliced 5G Multi-Access Edge Computing Systems","volume":"71","author":"Seah","year":"2021","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_14","unstructured":"Jun, N. (2022, January 12\u201313). Research on cloud computing resource scheduling strategy based on genetic ant colony fusion algorithm. Proceedings of the Conference on Computer Science and Communication Technology, Tianjin, China."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1109\/MWC.121.2100041","article-title":"Robust Edge Computing in UAV Systems via Scalable Computing and Cooperative Computing","volume":"28","author":"Liu","year":"2021","journal-title":"IEEE Wirel. Commun."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"927","DOI":"10.1109\/TSC.2022.3164149","article-title":"An Online Orchestration Mechanism for General-Purpose Edge Computing","volume":"16","author":"Shao","year":"2023","journal-title":"IEEE Trans. Serv. Comput."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"77637","DOI":"10.1109\/ACCESS.2021.3082259","article-title":"Deep Reinforcement Learning-Based Service-Oriented Resource Allocation in Smart Grids","volume":"9","author":"Xi","year":"2021","journal-title":"IEEE Access"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1109\/TETCI.2022.3145694","article-title":"Reinforcement Learning-Based Optimization for Mobile Edge Computing Scheduling Game","volume":"7","author":"Wang","year":"2023","journal-title":"IEEE Trans. Emerg. Top. Comput. Intell."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Vijayasekaran, G., and Duraipandian, M. (2024, January 24\u201326). Deep Q-learning based Resource Scheduling in IoT Edge Computing. Proceedings of the 2024 International Conference on Inventive Computation Technologies (ICICT), Lalitpur, Nepal.","DOI":"10.1109\/ICICT60155.2024.10544834"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"7293","DOI":"10.1109\/TWC.2020.3010522","article-title":"Machine intelligence at the edge with learning centric power allocation","volume":"19","author":"Wang","year":"2020","journal-title":"IEEE Trans. Wireless Commun."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"6541","DOI":"10.1109\/ACCESS.2022.3221740","article-title":"Deep Reinforcement Learning Based Edge Computing Network Aided Resource Allocation Algorithm for Smart Grid","volume":"11","author":"Chi","year":"2022","journal-title":"IEEE Access"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"74089","DOI":"10.1109\/ACCESS.2019.2920488","article-title":"Internet of Things Based Smart Grids Supported by Intelligent Edge Computing","volume":"7","author":"Chen","year":"2019","journal-title":"IEEE Access"},{"key":"ref_23","unstructured":"Lin, Y., Han, S., Mao, H., Wang, Y., and Dally, W.J. (May, January 30). Deep gradient compression: Reducing the communication bandwidth for distributed training. Proceedings of the Sixth International Conference on Learning Representations, Vancouver, BC, Canada."},{"key":"ref_24","unstructured":"Tran, N.H., Bao, W., Zomaya, A., Nguyen, M.N.H., and Hong, C.S. (May, January 29). Federated learning over wireless networks: Optimization model design and analysis. Proceedings of the IEEE Conference on Computer Communications, Paris, France."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Xu, J., Liu, X., and Zhu, X. (2020, January 11\u201314). Deep Reinforcement Learning Based Computing Offloading and Resource Allocation Algorithm for Mobile Edge Networks. Proceedings of the 2020 IEEE 6th International Conference on Computer and Communications (ICCC), Chengdu, China.","DOI":"10.1109\/ICCC51575.2020.9345089"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Liu, M., Li, Y., Zhao, Y., Yang, H., and Zhang, J. (2020, January 8\u201312). Adaptive DNN model partition and deployment in edge computing-enabled metro optical interconnection network. Proceedings of the Optical Fiber Communication (OFC) Conference, San Diego, CA, USA.","DOI":"10.1364\/OFC.2020.Th2A.28"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1241","DOI":"10.1109\/LCOMM.2020.3041453","article-title":"Distributed Model Training Based on Data Parallelism in Edge Computing-Enabled Elastic Optical Networks","volume":"25","author":"Li","year":"2020","journal-title":"IEEE Commun. Lett."},{"key":"ref_28","unstructured":"Wang, H., Agarwal, S., and Papailiopoulos, D. (2021). Pufferfish: Communication-efficient Models at No Extra Cost. arXiv."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Mansour, A.B., Carenini, G., Duplessis, A., and Naccache, D. (2022, January 12\u201314). Federated Learning Aggregation: New Robust Algorithms with Guarantees. Proceedings of the 2022 21st IEEE International Conference on Machine Learning and Applications (ICMLA), Nassau, Bahamas.","DOI":"10.1109\/ICMLA55696.2022.00120"}],"container-title":["Future Internet"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-5903\/16\/9\/312\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T15:44:30Z","timestamp":1760111070000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-5903\/16\/9\/312"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,8,28]]},"references-count":29,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2024,9]]}},"alternative-id":["fi16090312"],"URL":"https:\/\/doi.org\/10.3390\/fi16090312","relation":{},"ISSN":["1999-5903"],"issn-type":[{"value":"1999-5903","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,8,28]]}}}