{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,20]],"date-time":"2026-01-20T01:04:06Z","timestamp":1768871046088,"version":"3.49.0"},"reference-count":52,"publisher":"Oxford University Press (OUP)","issue":"1","license":[{"start":{"date-parts":[[2025,8,25]],"date-time":"2025-08-25T00:00:00Z","timestamp":1756080000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/pages\/standard-publication-reuse-rights"}],"funder":[{"name":"Shandong Provincial Natural Science Foundation of China","award":["ZR2023MF090"],"award-info":[{"award-number":["ZR2023MF090"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62236003"],"award-info":[{"award-number":["62236003"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Key Research and Development Program of Shandong Province of China","award":["2024CXGC010109"],"award-info":[{"award-number":["2024CXGC010109"]}]},{"name":"Introduction and Cultivation Program for Young Innovative Talents of Universities in Shandong Province of China","award":["2021QCYY003"],"award-info":[{"award-number":["2021QCYY003"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2026,1,13]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>To address the problem of high network energy consumption and imbalanced load distribution in data transmission, this paper proposes a novel deep reinforcement learning algorithm to jointly optimize energy consumption and link load distribution. We design a three-layer back-propagation neural network. It iteratively adjusts weights based on past states and actions, and minimizes the loss to improve action prediction accuracy. It guides the agent to make reasonable routing decisions within complex network environments. Based on this, we leverage Q-learning to seek paths for transmission demands. By dynamically aggregating and balancing traffic, energy efficiency and load balance can be achieved. We design reward functions from the viewpoint of link and node, respectively, for different optimization objectives. In order to obtain high efficiency and good robustness, we improve roulette-based Chebyshev scalarization function to solve the weight selection problem among multi-objectives. We update the Pareto set via multiple state transitions to approximate optimal solution. We use the Euclidean distance to measure optimizing effect of both objectives. Simulation results illustrate that our algorithm can effectively reduce network energy consumption and balance load distribution.<\/jats:p>","DOI":"10.1093\/comjnl\/bxaf100","type":"journal-article","created":{"date-parts":[[2025,8,2]],"date-time":"2025-08-02T11:43:26Z","timestamp":1754135006000},"page":"74-89","source":"Crossref","is-referenced-by-count":0,"title":["Jointly optimize energy consumption and load distribution in data transmission"],"prefix":"10.1093","volume":"69","author":[{"given":"Xiaole","family":"Li","sequence":"first","affiliation":[{"name":"School of Information Science and Engineering, Linyi University , Linyi, Shandong 276000 ,","place":["China"]}]},{"given":"Cuiping","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Information Science and Engineering, Linyi University , Linyi, Shandong 276000 ,","place":["China"]}]},{"given":"Yinghui","family":"Jiang","sequence":"additional","affiliation":[{"name":"School of Information Science and Engineering, Linyi University , Linyi, Shandong 276000 ,","place":["China"]}]},{"given":"Xing","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Information Science and Engineering, Linyi University , Linyi, Shandong 276000 ,","place":["China"]}]},{"given":"Jiuru","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Information Science and Engineering, Linyi University , Linyi, Shandong 276000 ,","place":["China"]}]},{"given":"Shanwen","family":"Yi","sequence":"additional","affiliation":[{"name":"School of Information Science and Engineering, Linyi University , Linyi, Shandong 276000 ,","place":["China"]},{"name":"School of Computer Science and Technology , Shandong University, Jinan, Shandong 250101,","place":["China"]}]}],"member":"286","published-online":{"date-parts":[[2025,8,25]]},"reference":[{"key":"2026011907114355300_ref1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.comnet.2024.110807","article-title":"GCP: a multi-strategy improved wireless sensor network model for environmental monitoring","volume":"254","author":"Wang","year":"2024","journal-title":"Comput Netw"},{"key":"2026011907114355300_ref2","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3390\/healthcare7040138","article-title":"Dynamic linkages among economic development, energy consumption, environment and health sustainable in eu and non-eu countries","volume":"7","author":"Feng","year":"2019","journal-title":"Healthcare"},{"key":"2026011907114355300_ref3","doi-asserted-by":"publisher","first-page":"965","DOI":"10.1007\/s10586-018-02886-x","article-title":"Event driven power consumption optimization control model of GPU clusters","volume":"22","author":"Wang","year":"2019","journal-title":"Clust Comput"},{"key":"2026011907114355300_ref4","first-page":"1","article-title":"Research trends and performance of IIoT communication network-architectural layers of petrochemical industry 4.0 for coping with circular economy","volume":"2021","author":"Zhao","year":"2021","journal-title":"Wireless Commun Mobile Comput"},{"key":"2026011907114355300_ref5","doi-asserted-by":"publisher","first-page":"37689","DOI":"10.1109\/ACCESS.2022.3161511","article-title":"Machine learning-based load balancing algorithms in future heterogeneous networks: a survey","volume":"10","author":"Gures","year":"2022","journal-title":"IEEE Access"},{"key":"2026011907114355300_ref6","doi-asserted-by":"publisher","first-page":"2662","DOI":"10.1109\/JSAC.2022.3191337","article-title":"Mitigating routing update overhead for traffic engineering by combining destination-based routing with reinforcement learning","volume":"40","author":"Ye","year":"2022","journal-title":"IEEE J Sel Areas Commun"},{"key":"2026011907114355300_ref7","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1109\/TNSM.2022.3197329","article-title":"Q-learning-based energy-efficient network planning in IP-over-EON","volume":"20","author":"Biswas","year":"2022","journal-title":"IEEE Trans Netw Serv Manage"},{"key":"2026011907114355300_ref8","doi-asserted-by":"crossref","first-page":"1410","DOI":"10.1109\/TGCN.2021.3082617","article-title":"Green multi-stage upgrade for bundled-link SDNs with budget and delay constraints","volume":"5","author":"Hiryanto","year":"2021","journal-title":"IEEE Trans Green Commun Networking"},{"key":"2026011907114355300_ref9","first-page":"1","article-title":"Joint link scheduling and rate adaptation for energy-efficient internet of vessels","volume-title":"Proceedings of 2021 IEEE International Conference on Communications (ICC), Toronto, ON, Canada, 14\u201323 June","author":"Wang"},{"key":"2026011907114355300_ref10","first-page":"1","article-title":"Energy-aware disaster backup among cloud datacenters using multi objective reinforcement learning in software defined network","volume":"1","author":"Yi","year":"2022","journal-title":"Concurrency Comput Pract Exper"},{"key":"2026011907114355300_ref11","doi-asserted-by":"publisher","first-page":"201","DOI":"10.1093\/comjnl\/bxae105","article-title":"Data transmission optimization based on multi-objective deep reinforcement learning","volume":"68","author":"Wang","year":"2025","journal-title":"Comput J"},{"key":"2026011907114355300_ref12","doi-asserted-by":"publisher","first-page":"17","DOI":"10.1109\/TCC.2017.2737628","article-title":"A resource usage intensity aware load balancing method for virtual machine migration in cloud datacenters","volume":"8","author":"Shen","year":"2020","journal-title":"IEEE Trans Cloud Comput"},{"key":"2026011907114355300_ref13","doi-asserted-by":"publisher","first-page":"46646","DOI":"10.1109\/ACCESS.2019.2909356","article-title":"Traffic load balancing using software defined networking (SDN) controller as virtualized network function","volume":"7","author":"Ejaz","year":"2019","journal-title":"IEEE Access"},{"key":"2026011907114355300_ref14","doi-asserted-by":"publisher","first-page":"129","DOI":"10.1109\/LNET.2024.3357089","article-title":"FractionalLB: controller load balancing using fractional switch migration in software-defined networks","volume":"6","author":"Prajapati","year":"2024","journal-title":"IEEE Networking Lett"},{"key":"2026011907114355300_ref15","doi-asserted-by":"publisher","first-page":"1505","DOI":"10.1109\/TSC.2022.3174475","article-title":"Load balancing algorithms in fog computing","volume":"16","author":"Kashani","year":"2023","journal-title":"IEEE Trans Serv Comput"},{"key":"2026011907114355300_ref16","doi-asserted-by":"publisher","first-page":"155136","DOI":"10.1109\/ACCESS.2020.3017615","article-title":"A load balancing routing strategy for LEO satellite network","volume":"8","author":"Liu","year":"2020","journal-title":"IEEE Access"},{"key":"2026011907114355300_ref17","first-page":"685","article-title":"Satellite QoS routing algorithm based on energy aware and load balancing","volume-title":"Proceedings of 2020 International Conference on Wireless Communications and Signal Processing (WCSP), Nanjing, China, 21\u201323 October","author":"Hao"},{"key":"2026011907114355300_ref18","doi-asserted-by":"publisher","first-page":"7101","DOI":"10.1109\/JIOT.2021.3051561","article-title":"Joint topology construction and hybrid routing strategy on load balancing for Bluetooth low energy networks","volume":"8","author":"Yu","year":"2021","journal-title":"IEEE Internet Things J"},{"key":"2026011907114355300_ref19","doi-asserted-by":"crossref","first-page":"3659","DOI":"10.1109\/TNSE.2022.3188670","article-title":"A load-balanced and energy-efficient navigation scheme for UAV-mounted mobile edge computing","volume":"9","author":"Wang","year":"2021","journal-title":"IEEE Trans Netw Sci Eng"},{"key":"2026011907114355300_ref20","doi-asserted-by":"publisher","first-page":"37903","DOI":"10.1109\/ACCESS.2024.3375530","article-title":"Optimizing the energy efficiency using quantum based load balancing in open radio access networks","volume":"12","author":"Al-Karawi","year":"2024","journal-title":"IEEE Access"},{"key":"2026011907114355300_ref21","first-page":"104","article-title":"A novel energy-aware scheduling and load-balancing technique based on fog computing","volume-title":"Proceedings of 2019 9th International Conference on Computer and Knowledge Engineering (ICCKE), Mashhad, Iran, 24\u201325 October","author":"Alzeyadi"},{"key":"2026011907114355300_ref22","doi-asserted-by":"crossref","first-page":"526","DOI":"10.1109\/JSYST.2020.3010971","article-title":"PLOFR: an online flow route framework for power saving and load balance in SDN","volume":"15","author":"Zhao","year":"2020","journal-title":"IEEE Syst J"},{"key":"2026011907114355300_ref23","doi-asserted-by":"publisher","first-page":"90587","DOI":"10.1109\/ACCESS.2021.3091499","article-title":"Energy efficient throughput aware traffic load balancing in green cellular networks","volume":"9","author":"Jahid","year":"2021","journal-title":"IEEE Access"},{"key":"2026011907114355300_ref24","doi-asserted-by":"crossref","first-page":"2432","DOI":"10.1109\/JIOT.2021.3095237","article-title":"Software-defined internet of multimedia things: Energy-efficient and load-balanced resource management","volume":"9","author":"Montazerolghaem","year":"2021","journal-title":"IEEE Internet Things J"},{"key":"2026011907114355300_ref25","doi-asserted-by":"publisher","first-page":"14334","DOI":"10.1109\/ACCESS.2024.3357122","article-title":"An energy-aware task offloading and load balancing for latency-sensitive IoT applications in the fog-cloud continuum","volume":"12","author":"Mahapatra","year":"2024","journal-title":"IEEE Access"},{"key":"2026011907114355300_ref26","first-page":"590","article-title":"Multi-objective disaster backup in inter-datacenter using reinforcement learning","volume-title":"Proceedings of Wireless Algorithms, Systems, and Applications: 15th International Conference, Qingdao, China, 13\u201315 September","author":"Yan"},{"key":"2026011907114355300_ref27","doi-asserted-by":"publisher","first-page":"927","DOI":"10.1109\/TCC.2021.3121481","article-title":"Latency and energy-aware load balancing in cloud data centers: a bargaining game based approach","volume":"11","author":"Kishor","year":"2023","journal-title":"IEEE Trans Cloud Comput"},{"key":"2026011907114355300_ref28","doi-asserted-by":"publisher","first-page":"158082","DOI":"10.1109\/ACCESS.2020.3020158","article-title":"Energy-efficient and load-balanced clustering routing protocol for wireless sensor networks using a chaotic genetic algorithm","volume":"8","author":"Wang","year":"2020","journal-title":"IEEE Access"},{"key":"2026011907114355300_ref29","doi-asserted-by":"publisher","first-page":"21179","DOI":"10.1007\/s11227-024-06213-7","article-title":"Data transmission optimization in edge computing using multi-objective reinforcement learning","volume":"80","author":"Li","year":"2025","journal-title":"J Supercomput"},{"key":"2026011907114355300_ref30","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s10586-024-04906-5","article-title":"Multi-objective multicast optimization with deep reinforcement learning","volume":"28","author":"Li","year":"2025","journal-title":"Clust Comput"},{"key":"2026011907114355300_ref31","doi-asserted-by":"publisher","first-page":"5064","DOI":"10.1109\/TNNLS.2022.3207346","article-title":"Deep reinforcement learning: a survey","volume":"35","author":"Wang","year":"2024","journal-title":"IEEE Trans Neural Networks Learn Syst"},{"key":"2026011907114355300_ref32","first-page":"521","article-title":"Minimizing energy consumption with a cloneant-based routing algorithm for communication network","volume-title":"Proceedings of 2015 IEEE 17th International Conference on High Performance Computing and Communications, 2015 IEEE 7th International Symposium on Cyberspace Safety and Security, and 2015 IEEE 12th International Conference on Embedded Software and Systems, New York, USA, 24-26 August","author":"Gao"},{"key":"2026011907114355300_ref33","doi-asserted-by":"publisher","first-page":"455","DOI":"10.1007\/s11227-019-03033-y","article-title":"An energy-aware scheduling algorithm for budget-constrained scientific workflows based on multi-objective reinforcement learning","volume":"76","author":"Qin","year":"2020","journal-title":"J Supercomput"},{"key":"2026011907114355300_ref34","doi-asserted-by":"publisher","first-page":"2323","DOI":"10.1007\/s11590-020-01554-7","article-title":"A new mixed integer programming approach for optimization over the efficient set of a multiobjective linear programming problem","volume":"14","author":"Lu","year":"2020","journal-title":"Optim Lett"},{"key":"2026011907114355300_ref35","doi-asserted-by":"publisher","first-page":"8","DOI":"10.1109\/65.768484","article-title":"Internet QoS: A big picture","volume":"13","author":"Xiao","year":"1999","journal-title":"IEEE Network"},{"key":"2026011907114355300_ref36","first-page":"176","article-title":"Energy saving and load balancing for SDN based on multi-objective particle swarm optimization","volume-title":"Proceedings of International Conference on Algorithms and Architectures for Parallel Processing, Zhangjiajie, China, 18-20 November","author":"Zhu"},{"key":"2026011907114355300_ref37","doi-asserted-by":"publisher","first-page":"7498","DOI":"10.1007\/s10489-021-02640-8","article-title":"An efficient data evacuation strategy using multi-objective reinforcement learning","volume":"52","author":"Li","year":"2022","journal-title":"Appl Intell"},{"key":"2026011907114355300_ref38","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s11704-020-9273-z","article-title":"A multi-objective reinforcement learning algorithm for deadline constrained scientific workflow scheduling in clouds","volume":"15","author":"Qin","year":"2021","journal-title":"Front Comp Sci"},{"key":"2026011907114355300_ref39","doi-asserted-by":"publisher","first-page":"895","DOI":"10.1007\/s10462-021-09996-w","article-title":"Multi-agent deep reinforcement learning: a survey","volume":"55","author":"Gronauer","year":"2022","journal-title":"Artif Intell Rev"},{"key":"2026011907114355300_ref40","first-page":"3483","article-title":"Multi-objective reinforcement learning using sets of pareto dominating policies","volume":"15","author":"Moffaert","year":"2014","journal-title":"J Mach Learn Res"},{"key":"2026011907114355300_ref41","doi-asserted-by":"crossref","DOI":"10.1109\/ADPRL.2013.6615007","article-title":"Scalarized multi-objective reinforcement learning: Novel design techniques","volume-title":"Proceedings of 2013 IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL), Singapore, Singapore, 16\u201319 April","author":"Moffaert"},{"key":"2026011907114355300_ref42","doi-asserted-by":"publisher","first-page":"2370","DOI":"10.1007\/s10489-020-01633-3","article-title":"Virtual machine placement based on multi-objective reinforcement learning","volume":"50","author":"Qin","year":"2020","journal-title":"Appl Intell"},{"key":"2026011907114355300_ref43","doi-asserted-by":"publisher","first-page":"24","DOI":"10.1016\/j.comcom.2005.01.017","article-title":"Connectivity of Waxman topology models","volume":"29","author":"Naldi","year":"2005","journal-title":"Comput Commun"},{"key":"2026011907114355300_ref44","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/JLT.2015.2425303","article-title":"On fast and coordinated data backup in geo-distributed optical inter-datacenter networks","volume":"33","author":"Yao","year":"2015","journal-title":"J Lightwave Technol"},{"key":"2026011907114355300_ref45","doi-asserted-by":"publisher","first-page":"1058","DOI":"10.1109\/TPDS.2017.2785385","article-title":"Evacuate before too late: Distributed backup in inter-DC networks with progressive disasters","volume":"29","author":"Xie","year":"2018","journal-title":"IEEE Trans Parallel Distrib Syst"},{"key":"2026011907114355300_ref46","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1002\/cpe.5851","article-title":"Progressive disaster evacuation in cloud datacenter network","volume":"32","author":"Li","year":"2020","journal-title":"Concurrency Comput Pract Exper"},{"key":"2026011907114355300_ref47","doi-asserted-by":"publisher","first-page":"256","DOI":"10.1109\/COMST.2021.3050297","article-title":"Decentralized SDN control plane for a distributed cloud-edge infrastructure: a survey","volume":"23","author":"Sarmiento","year":"2021","journal-title":"IEEE Commun Surv Tutor"},{"key":"2026011907114355300_ref48","doi-asserted-by":"publisher","first-page":"2646","DOI":"10.1109\/TNET.2021.3098766","article-title":"Maximizing last-minute backup in endangered time-varying inter-datacenter networks","volume":"29","author":"Das","year":"2021","journal-title":"IEEE\/ACM Trans Netw"},{"key":"2026011907114355300_ref49","doi-asserted-by":"publisher","first-page":"185","DOI":"10.1023\/A:1022689125041","article-title":"Asynchronous stochastic approximation and Q-learning","volume":"16","author":"Tsitsiklis","year":"1994","journal-title":"Mach Learn"},{"key":"2026011907114355300_ref50","doi-asserted-by":"publisher","first-page":"195","DOI":"10.14257\/ijfgcn.2015.8.5.20","article-title":"Adaptive network traffic prediction algorithm based on bp neural network","volume":"8","author":"Zhang","year":"2015","journal-title":"Int J Fut Gen Commun Netw"},{"key":"2026011907114355300_ref51","doi-asserted-by":"publisher","first-page":"2135","DOI":"10.1587\/transinf.2019EDP7030","article-title":"Progressive forwarding disaster backup among cloud datacenters","volume":"E102.D","author":"Li","year":"2019","journal-title":"IEICE Trans Inf Syst"},{"key":"2026011907114355300_ref52","doi-asserted-by":"publisher","first-page":"120967","DOI":"10.1016\/j.ins.2024.120967","article-title":"A common feature-driven prediction model for multivariate time series data","volume":"677","author":"Yu","year":"2024","journal-title":"Inform Sci"}],"container-title":["The Computer Journal"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/comjnl\/article-pdf\/69\/1\/74\/64119111\/bxaf100.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/comjnl\/article-pdf\/69\/1\/74\/64119111\/bxaf100.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,1,19]],"date-time":"2026-01-19T12:11:50Z","timestamp":1768824710000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/comjnl\/article\/69\/1\/74\/8240601"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,8,25]]},"references-count":52,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2025,8,25]]},"published-print":{"date-parts":[[2026,1,13]]}},"URL":"https:\/\/doi.org\/10.1093\/comjnl\/bxaf100","relation":{},"ISSN":["0010-4620","1460-2067"],"issn-type":[{"value":"0010-4620","type":"print"},{"value":"1460-2067","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2026,1]]},"published":{"date-parts":[[2025,8,25]]}}}