{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,18]],"date-time":"2026-03-18T08:03:40Z","timestamp":1773821020348,"version":"3.50.1"},"reference-count":23,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2025,4,3]],"date-time":"2025-04-03T00:00:00Z","timestamp":1743638400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Guangdong Province Key Field Special Project \u201cResearch on Key Technologies of Zero-Trust Business Data Security Monitoring for Industry-Specific Networks\u201d","award":["2021ZDZX1098"],"award-info":[{"award-number":["2021ZDZX1098"]}]},{"name":"Guangdong Province Key Field Special Project \u201cResearch on Key Technologies of Zero-Trust Business Data Security Monitoring for Industry-Specific Networks\u201d","award":["2021FNB3001"],"award-info":[{"award-number":["2021FNB3001"]}]},{"name":"Guangdong Province Key Field Special Project \u201cResearch on Key Technologies of Zero-Trust Business Data Security Monitoring for Industry-Specific Networks\u201d","award":["2022IT020"],"award-info":[{"award-number":["2022IT020"]}]},{"name":"Guangdong Province Key Field Special Project \u201cResearch on Key Technologies of Zero-Trust Business Data Security Monitoring for Industry-Specific Networks\u201d","award":["20231128083944001"],"award-info":[{"award-number":["20231128083944001"]}]},{"name":"China University Industry-University-Research Innovation Fund \u201cZero-Trust API Gateway System for Industry Private Networks\u201d","award":["2021ZDZX1098"],"award-info":[{"award-number":["2021ZDZX1098"]}]},{"name":"China University Industry-University-Research Innovation Fund \u201cZero-Trust API Gateway System for Industry Private Networks\u201d","award":["2021FNB3001"],"award-info":[{"award-number":["2021FNB3001"]}]},{"name":"China University Industry-University-Research Innovation Fund \u201cZero-Trust API Gateway System for Industry Private Networks\u201d","award":["2022IT020"],"award-info":[{"award-number":["2022IT020"]}]},{"name":"China University Industry-University-Research Innovation Fund \u201cZero-Trust API Gateway System for Industry Private Networks\u201d","award":["20231128083944001"],"award-info":[{"award-number":["20231128083944001"]}]},{"name":"Research on Key Technologies for Security Monitoring of Private Network Big Data under Elastic Cloud Platform","award":["2021ZDZX1098"],"award-info":[{"award-number":["2021ZDZX1098"]}]},{"name":"Research on Key Technologies for Security Monitoring of Private Network Big Data under Elastic Cloud Platform","award":["2021FNB3001"],"award-info":[{"award-number":["2021FNB3001"]}]},{"name":"Research on Key Technologies for Security Monitoring of Private Network Big Data under Elastic Cloud Platform","award":["2022IT020"],"award-info":[{"award-number":["2022IT020"]}]},{"name":"Research on Key Technologies for Security Monitoring of Private Network Big Data under Elastic Cloud Platform","award":["20231128083944001"],"award-info":[{"award-number":["20231128083944001"]}]},{"name":"Shenzhen Science and Technology Innovation Commission Stable Support Plan \u201cResearch and Application of Key Technologies for 5G Network Protection Based on Active Defense\u201d","award":["2021ZDZX1098"],"award-info":[{"award-number":["2021ZDZX1098"]}]},{"name":"Shenzhen Science and Technology Innovation Commission Stable Support Plan \u201cResearch and Application of Key Technologies for 5G Network Protection Based on Active Defense\u201d","award":["2021FNB3001"],"award-info":[{"award-number":["2021FNB3001"]}]},{"name":"Shenzhen Science and Technology Innovation Commission Stable Support Plan \u201cResearch and Application of Key Technologies for 5G Network Protection Based on Active Defense\u201d","award":["2022IT020"],"award-info":[{"award-number":["2022IT020"]}]},{"name":"Shenzhen Science and Technology Innovation Commission Stable Support Plan \u201cResearch and Application of Key Technologies for 5G Network Protection Based on Active Defense\u201d","award":["20231128083944001"],"award-info":[{"award-number":["20231128083944001"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Future Internet"],"abstract":"<jats:p>With the rapid growth of Internet applications and network traffic, existing routing algorithms are usually difficult to guarantee the quality of service (QoS) indicators such as delay, bandwidth, and packet loss rate as well as network energy consumption for various data flows with business characteristics. They have problems such as unbalanced traffic scheduling and unreasonable network resource allocation. Aiming at the above problems, this paper proposes a QoS-oriented energy-saving routing algorithm A3C-R in the software-defined network (SDN) environment. Based on the asynchronous update advantages of the asynchronous advantage Actor-Critic (A3C) algorithm and the advantages of independent interaction between multiple agents and the environment, the A3C-R algorithm can effectively improve the convergence of the routing algorithm. The process of the A3C-R algorithm first takes QoS indicators such as delay, bandwidth, and packet loss rate and the network energy consumption of the link as input. Then, it creates multiple agents to start asynchronous training, through the continuous updating of Actors and Critics in each agent and periodically synchronizes the model parameters to the global model. After the algorithm training converges, it can output the link weights of the network topology to facilitate the calculation of intelligent routing strategies that meet QoS requirements and lower network energy consumption. The experimental results indicate that the A3C-R algorithm, compared to the baseline algorithms ECMP, I-DQN, and DDPG-EEFS, reduces delay by approximately 9.4%, increases throughput by approximately 7.0%, decreases the packet loss rate by approximately 9.5%, and improves energy-saving percentage by approximately 10.8%.<\/jats:p>","DOI":"10.3390\/fi17040158","type":"journal-article","created":{"date-parts":[[2025,4,3]],"date-time":"2025-04-03T04:33:43Z","timestamp":1743654823000},"page":"158","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["A3C-R: A QoS-Oriented Energy-Saving Routing Algorithm for Software-Defined Networks"],"prefix":"10.3390","volume":"17","author":[{"given":"Sunan","family":"Wang","sequence":"first","affiliation":[{"name":"College of Electronics & Communication Engineering, Shenzhen Polytechnic University, Shenzhen 518005, China"}]},{"given":"Rong","family":"Song","sequence":"additional","affiliation":[{"name":"College of Electronics & Communication Engineering, Shenzhen Polytechnic University, Shenzhen 518005, China"}]},{"given":"Xiangyu","family":"Zheng","sequence":"additional","affiliation":[{"name":"College of Computer Engineering and Science, Shanghai University, Shanghai 200444, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7266-8830","authenticated-orcid":false,"given":"Wanwei","family":"Huang","sequence":"additional","affiliation":[{"name":"College of Software Engineering, Zhengzhou University of Light Industry, Zhengzhou 450007, China"}]},{"given":"Hongchang","family":"Liu","sequence":"additional","affiliation":[{"name":"College of Software Engineering, Zhengzhou University of Light Industry, Zhengzhou 450007, China"}]}],"member":"1968","published-online":{"date-parts":[[2025,4,3]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"4457645","DOI":"10.1155\/2022\/4457645","article-title":"DSOQR: Deep Reinforcement Learning for Online QoS Routing in SDN-Based Networks","volume":"2022","author":"Zhang","year":"2022","journal-title":"Secur. Commun. Netw."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1504\/IJAHUC.2020.108422","article-title":"QoS-aware flow scheduling for energy-efficient cloud data centre network","volume":"34","author":"Wang","year":"2020","journal-title":"Int. J. Ad Hoc Ubiquitous Comput."},{"key":"ref_3","first-page":"90","article-title":"Research on the development of time-sensitive networks and their security technologies","volume":"Volume 12161","author":"Lin","year":"2022","journal-title":"Proceedings of the 4th International Conference on Informatics Engineering & Information Science (ICIEIS2021)"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"2593","DOI":"10.1007\/s11277-020-07812-2","article-title":"A systematic review of quality of services (QoS) in software defined networking (SDN)","volume":"116","author":"Keshari","year":"2021","journal-title":"Wirel. Pers. Commun."},{"key":"ref_5","first-page":"884","article-title":"Software defined networking (SDN) challenges, issues and solution","volume":"7","author":"Rana","year":"2019","journal-title":"Int. J. Comput. Sci. Eng."},{"key":"ref_6","first-page":"569","article-title":"A Routing Strategy with Optimizing Linear Programming in Hybrid SDN","volume":"105","author":"Chenhui","year":"2022","journal-title":"IEICE Trans. Commun."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"6685722","DOI":"10.1155\/2021\/6685722","article-title":"Data Transmission Evaluation and Allocation Mechanism of the Optimal Routing Path: An Asynchronous Advantage Actor-Critic (A3C) Approach","volume":"2021","author":"Ding","year":"2021","journal-title":"Wirel. Commun. Mob. Comput."},{"key":"ref_8","unstructured":"Li, S.H. (2021). Research and Implementation of Routing Optimization Technology Based on Traffic Classification in SDN. [Master\u2019s Thesis, Beijing University of Posts and Telecommunications]."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Fei, H., Jia, D., Zhang, B., Li, C., Zhang, Y., Luo, T., and Zhou, J. (2024). A novel energy efficient QoS secure routing algorithm for WSNs. Sci. Rep., 14.","DOI":"10.1038\/s41598-024-77686-y"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"150","DOI":"10.1186\/s40537-024-01029-x","article-title":"DFRDRL: A dynamic fuzzy routing algorithm based on deep reinforcement learning with guaranteed latency and bandwidth for software-defined networks","volume":"11","author":"Wang","year":"2024","journal-title":"J. Big Data"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"104851","DOI":"10.1016\/j.jpdc.2024.104851","article-title":"DQS: A QoS-driven routing optimization approach in SDN using deep reinforcement learning","volume":"188","author":"Shen","year":"2024","journal-title":"J. Parallel Distrib. Comput."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"29001","DOI":"10.1109\/JIOT.2024.3406343","article-title":"UCRTD: An Unequally Clustered Routing Protocol Based on Multi Hop Threshold Distance for Wireless Sensor Networks","volume":"11","author":"Wang","year":"2024","journal-title":"IEEE Internet Things J."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"7227","DOI":"10.1007\/s11276-023-03584-2","article-title":"Clustering routing algorithm of wireless sensor network based on swarm intelligence","volume":"30","author":"Tang","year":"2024","journal-title":"Wirel. Netw."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Shu, X., Lin, A., and Wen, X. (2024). Energy-Saving Multi-Agent Deep Reinforcement Learning Algorithm for Drone Routing Problem. Sensors, 24.","DOI":"10.3390\/s24206698"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Niranjana, M.I., Daisy, J., RamNivas, D., Gayathree, K., Vignesh, M., and Parthipan, V. (2024, January 6\u20137). Grid Based Reliable Routing Algorithm with Energy Efficient in Wireless Sensor Networks Using Image Processing. Proceedings of the 2024 5th International Conference on Communication, Computing & Industry 6.0 (C2I6), Bengaluru, India.","DOI":"10.1109\/C2I663243.2024.10895519"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"100695","DOI":"10.1016\/j.iot.2023.100695","article-title":"A p4-assisted task offloading scheme for fog networks: An intelligent transportation system scenario","volume":"22","author":"Okay","year":"2023","journal-title":"Internet Things"},{"key":"ref_17","first-page":"89","article-title":"Evaluation of QoS in Distributed Systems: A Review","volume":"5","author":"Qadir","year":"2021","journal-title":"Int. J. Sci. Bus."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Wang, L., Zhang, F., Zheng, K., Vasilakos, A.V., Ren, S., and Liu, Z. (July, January 30). Energy-Efficient Flow Scheduling and Routing with Hard Deadlines in Data Center Networks. Proceedings of the 2014 IEEE 34th International Conference on Distributed Computing Systems, Madrid, Spain.","DOI":"10.1109\/ICDCS.2014.33"},{"key":"ref_19","unstructured":"Mnih, V., Badia, A.P., Mirza, M., Graves, A., Lillicrap, T., Harley, T., Silver, D., and Kavukcuoglu, K. (2016, January 19\u201324). Asynchronous methods for deep reinforcement learning. Proceedings of the International Conference on Machine Learning, New York, NY, USA."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Zheng, X., Huang, W., Wang, S., Zhang, J., and Zhang, H. (2022). Research on Energy-Saving Routing Technology Based on Deep Reinforcement Learning. Electronics, 11.","DOI":"10.3390\/electronics11132035"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Pradhan, A., and Bisoy, S.K. (2022, January 9\u201311). Intelligent Action Performed Load Balancing Decision Made in Cloud Datacenter Based on Improved DQN Algorithm. Proceedings of the 2022 International Conference on Emerging Smart Computing and Informatics (ESCI), Pune, India.","DOI":"10.1109\/ESCI53509.2022.9758369"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"6629852","DOI":"10.1155\/2021\/6629852","article-title":"DDPG-Based Energy-Efficient Flow Scheduling Algorithm in Software-Defined Data Centers","volume":"2021","author":"Yao","year":"2021","journal-title":"Wirel. Commun. Mob. Comput."},{"key":"ref_23","unstructured":"Qiu, H., Lv, C., and Zhou, D. (2022, January 21\u201322). Energy-saving routing algorithm for mobile blockchain Device-to-Device network in 5G edge computing environment. Proceedings of the AIIPCC 2022; The Third International Conference on Artificial Intelligence, Information Processing and Cloud Computing, Online."}],"container-title":["Future Internet"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-5903\/17\/4\/158\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T17:09:13Z","timestamp":1760029753000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-5903\/17\/4\/158"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,4,3]]},"references-count":23,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2025,4]]}},"alternative-id":["fi17040158"],"URL":"https:\/\/doi.org\/10.3390\/fi17040158","relation":{},"ISSN":["1999-5903"],"issn-type":[{"value":"1999-5903","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,4,3]]}}}