{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:05:55Z","timestamp":1760144755686,"version":"build-2065373602"},"reference-count":45,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2024,5,21]],"date-time":"2024-05-21T00:00:00Z","timestamp":1716249600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Hebei Province Innovation Capacity Enhancement Program Project","award":["22567624H","21422031288","CXZZSS2023120"],"award-info":[{"award-number":["22567624H","21422031288","CXZZSS2023120"]}]},{"name":"Handan Science and Technology Research and Development Program","award":["22567624H","21422031288","CXZZSS2023120"],"award-info":[{"award-number":["22567624H","21422031288","CXZZSS2023120"]}]},{"name":"Provincial Innovation Funding Project for Graduate Students of Hebei Province","award":["22567624H","21422031288","CXZZSS2023120"],"award-info":[{"award-number":["22567624H","21422031288","CXZZSS2023120"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Future Internet"],"abstract":"<jats:p>With the increasing popularity of the Internet of Things (IoT), the proliferation of computation-intensive and timing-dependent applications has brought serious load pressure on terrestrial networks. In order to solve the problem of computing resource conflict and long response delay caused by concurrent application service applications from multiple users, this paper proposes an improved edge computing timing-dependent, task-offloading scheme based on Multi-Agent Deep Deterministic Policy Gradient (MADDPG) that aims to shorten the offloading delay and improve the resource utilization rate by means of resource prediction and collaboration among multiple agents to shorten the offloading delay and improve the resource utilization. First, to coordinate the global computing resource, the gated recurrent unit is utilized, which predicts the next computing resource requirements of the timing-dependent tasks according to historical information. Second, the predicted information, the historical offloading decisions and the current state are used as inputs, and the training process of the reinforcement learning algorithm is improved to propose a task-offloading algorithm based on MADDPG. The simulation results show that the algorithm reduces the response latency by 6.7% and improves the resource utilization by 30.6% compared with the suboptimal benchmark algorithm, and it reduces nearly 500 training rounds during the learning process, which effectively improves the timeliness of the offloading strategy.<\/jats:p>","DOI":"10.3390\/fi16060181","type":"journal-article","created":{"date-parts":[[2024,5,21]],"date-time":"2024-05-21T05:40:47Z","timestamp":1716270047000},"page":"181","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["MADDPG-Based Offloading Strategy for Timing-Dependent Tasks in Edge Computing"],"prefix":"10.3390","volume":"16","author":[{"given":"Yuchen","family":"Wang","sequence":"first","affiliation":[{"name":"School of Information and Electrical Engineering, Hebei University of Engineering, Handan 056038, China"},{"name":"Hebei Key Laboratory of Security and Protection Information Sensing and Processing, Handan 056038, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zishan","family":"Huang","sequence":"additional","affiliation":[{"name":"School of Information and Electrical Engineering, Hebei University of Engineering, Handan 056038, China"},{"name":"Hebei Key Laboratory of Security and Protection Information Sensing and Processing, Handan 056038, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2917-1976","authenticated-orcid":false,"given":"Zhongcheng","family":"Wei","sequence":"additional","affiliation":[{"name":"School of Information and Electrical Engineering, Hebei University of Engineering, Handan 056038, China"},{"name":"Hebei Key Laboratory of Security and Protection Information Sensing and Processing, Handan 056038, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jijun","family":"Zhao","sequence":"additional","affiliation":[{"name":"School of Information and Electrical Engineering, Hebei University of Engineering, Handan 056038, China"},{"name":"Hebei Key Laboratory of Security and Protection Information Sensing and Processing, Handan 056038, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2024,5,21]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1935","DOI":"10.1007\/s11227-023-05548-x","article-title":"Efficient facial expression recognition framework based on edge computing","volume":"80","author":"Aikyn","year":"2024","journal-title":"J. Supercomput."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Gong, T., Zhu, L., Yu, F.R., and Tang, T. (2024). Train-to-Edge Cooperative Intelligence for Obstacle Intrusion Detection in Rail Transit. IEEE Trans. Veh. Technol., 1\u201313.","DOI":"10.1109\/TVT.2024.3355230"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"102824","DOI":"10.1016\/j.simpat.2023.102824","article-title":"Joint scheduling and offloading of computational tasks with time dependency under edge computing networks","volume":"129","author":"Wang","year":"2023","journal-title":"Simul. Model. Pract. Theory"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"591","DOI":"10.1109\/COMST.2022.3218527","article-title":"Distributed artificial intelligence empowered by end-edge-cloud computing: A survey","volume":"25","author":"Duan","year":"2022","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"2322","DOI":"10.1109\/COMST.2017.2745201","article-title":"A survey on mobile edge computing: The communication perspective","volume":"19","author":"Mao","year":"2017","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"3205","DOI":"10.1109\/TNSM.2023.3240415","article-title":"Cooperative task offloading for mobile edge computing based on multi-agent deep reinforcement learning","volume":"20","author":"Yang","year":"2023","journal-title":"IEEE Trans. Netw. Serv. Manag."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"16546","DOI":"10.1109\/JIOT.2022.3150976","article-title":"Joint task offloading and resource allocation for IoT edge computing with sequential task dependency","volume":"9","author":"An","year":"2022","journal-title":"IEEE Internet Things J."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"242","DOI":"10.1109\/TPDS.2020.3014896","article-title":"Fast adaptive task offloading in edge computing based on meta reinforcement learning","volume":"32","author":"Wang","year":"2020","journal-title":"IEEE Trans. Parallel Distrib. Syst."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Gao, S., Wang, Y., Feng, N., Wei, Z., and Zhao, J. (2023). Deep reinforcement learning-based video offloading and resource allocation in noma-enabled networks. Future Internet, 15.","DOI":"10.20944\/preprints202304.0891.v1"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"5555","DOI":"10.1109\/TITS.2023.3242997","article-title":"Joint secure offloading and resource allocation for vehicular edge computing network: A multi-agent deep reinforcement learning approach","volume":"24","author":"Ju","year":"2023","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"110352","DOI":"10.1016\/j.comnet.2024.110352","article-title":"MADRLOM: A Computation Offloading Mechanism for Software-Defined Cloud-Edge Computing Power Network","volume":"245","author":"Guo","year":"2024","journal-title":"Comput. Netw."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"13257","DOI":"10.1109\/JIOT.2023.3332401","article-title":"Device-Specific QoE Enhancement Through Joint Communication and Computation Resource Scheduling in Edge-Assisted IoT Systems","volume":"11","author":"Wang","year":"2024","journal-title":"IEEE Internet Things J."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"100868","DOI":"10.1016\/j.iot.2023.100868","article-title":"Dependent task offloading with deadline-aware scheduling in mobile edge networks","volume":"23","author":"Maray","year":"2023","journal-title":"Internet Things"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1016\/j.comcom.2023.06.021","article-title":"Collaborative cloud-edge-end task offloading with task dependency based on deep reinforcement learning","volume":"209","author":"Tang","year":"2023","journal-title":"Comput. Commun."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"9062","DOI":"10.1109\/JIOT.2022.3233667","article-title":"Dependency tasks offloading and communication resource allocation in collaborative UAVs networks: A meta-heuristic approach","volume":"10","author":"Nguyen","year":"2023","journal-title":"IEEE Internet Things J."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"2147","DOI":"10.1109\/TMC.2021.3119200","article-title":"Efficient dependent task offloading for multiple applications in MEC-cloud system","volume":"22","author":"Liu","year":"2021","journal-title":"IEEE Trans. Mob. Comput."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"538","DOI":"10.1109\/JSAC.2022.3233532","article-title":"Dependent task scheduling and offloading for minimizing deadline violation ratio in mobile edge computing networks","volume":"41","author":"Liu","year":"2023","journal-title":"IEEE J. Sel. Areas Commun."},{"key":"ref_18","first-page":"12737","article-title":"A hierarchical hybrid subtask scheduling algorithm in UAV-assisted MEC emergency network","volume":"9","author":"Li","year":"2021","journal-title":"IEEE Internet Things J."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"114462","DOI":"10.1016\/j.tcs.2024.114462","article-title":"Computational Task Offloading Algorithm Based on Deep Reinforcement Learning and Multi-Task Dependency","volume":"993","author":"Zhang","year":"2024","journal-title":"Theor. Comput. Sci."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"103702","DOI":"10.1016\/j.jnca.2023.103702","article-title":"Enhanced multi-objective gorilla troops optimizer for real-time multi-user dependent tasks offloading in edge-cloud computing","volume":"218","author":"Hosny","year":"2023","journal-title":"J. Netw. Comput. Appl."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1016\/j.future.2024.01.025","article-title":"Joint optimization of multi-dimensional resource allocation and task offloading for QoE enhancement in Cloud-Edge-End collaboration","volume":"155","author":"Zeng","year":"2024","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Sun, Y., Li, H., Wei, T., Zhang, Y., Wang, Z., Wu, W., and Fang, C. (2021, January 14\u201316). Dependency-aware flexible computation offloading and task scheduling for multi-access edge computing networks. Proceedings of the 2021 24th International Symposium on Wireless Personal Multimedia Communications (WPMC), Okayama, Japan.","DOI":"10.1109\/WPMC52694.2021.9700432"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1678","DOI":"10.1109\/JIOT.2019.2943373","article-title":"Multi-user offloading for edge computing networks: A dependency-aware and latency-optimal approach","volume":"7","author":"Shu","year":"2019","journal-title":"IEEE Internet Things J."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"16256","DOI":"10.1109\/JIOT.2021.3095677","article-title":"Multiagent deep reinforcement learning for task offloading and resource allocation in cybertwin-based networks","volume":"8","author":"Hou","year":"2021","journal-title":"IEEE Internet Things J."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"10497","DOI":"10.1109\/JIOT.2023.3240173","article-title":"Cooperative UAV resource allocation and task offloading in hierarchical aerial computing systems: A MAPPO based approach","volume":"10","author":"Kang","year":"2023","journal-title":"IEEE Internet Things J."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"4028","DOI":"10.1007\/s10489-021-02549-2","article-title":"Cost-efficient multi-service task offloading scheduling for mobile edge computing","volume":"52","author":"Song","year":"2022","journal-title":"Appl. Intell."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"101892","DOI":"10.1016\/j.pmcj.2024.101892","article-title":"TODO: Task offloading decision optimizer for the efficient provision of offloading schemes","volume":"99","author":"Chen","year":"2024","journal-title":"Pervasive Mob. Comput."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1007\/s10586-021-03518-7","article-title":"LiMPO: Lightweight mobility prediction and offloading framework using machine learning for mobile edge computing","volume":"26","author":"Zaman","year":"2023","journal-title":"Clust. Comput."},{"key":"ref_29","first-page":"2382","article-title":"A deep reinforcement learning-based distributed service off loading method for edge computing empowered internet of vehicles","volume":"44","author":"Xu","year":"2021","journal-title":"Chin. J. Comput."},{"key":"ref_30","first-page":"1","article-title":"BiLSTM-based Federated Learning Computation Offloading and Resource Allocation Algorithm in MEC","volume":"19","author":"Zhang","year":"2023","journal-title":"ACM Trans. Sens. Netw."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"76","DOI":"10.1186\/s13677-023-00450-6","article-title":"Task offloading optimization mechanism based on deep neural network in edge-cloud environment","volume":"12","author":"Meng","year":"2023","journal-title":"J. Cloud Comput."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"749","DOI":"10.1007\/s12083-022-01441-1","article-title":"A smart collaborative framework for dynamic multi-task offloading in IIoT-MEC networks","volume":"16","author":"Ai","year":"2023","journal-title":"Peer\u2014Peer Netw. Appl."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"13826","DOI":"10.1109\/JIOT.2023.3263188","article-title":"Offloading demand prediction-driven latency-aware resource reservation in edge networks","volume":"10","author":"Zhang","year":"2023","journal-title":"IEEE Internet Things J."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Yao, W. (2019, January 20\u201322). The application of artificial intelligence in the internet of things. Proceedings of the 2019 International Conference on Information Technology and Computer Application (ITCA), Guangzhou, China.","DOI":"10.1109\/ITCA49981.2019.00038"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"5404","DOI":"10.1109\/TWC.2020.2993071","article-title":"Offloading and resource allocation with general task graph in mobile edge computing: A deep reinforcement learning approach","volume":"19","author":"Yan","year":"2020","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"925","DOI":"10.1016\/j.future.2019.09.035","article-title":"Intelligent task prediction and computation offloading based on mobile-edge cloud computing","volume":"102","author":"Miao","year":"2020","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"232","DOI":"10.1016\/j.future.2023.10.004","article-title":"MCOTM: Mobility-aware computation offloading and task migration for edge computing in industrial IoT","volume":"151","author":"Qin","year":"2024","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"235","DOI":"10.2478\/jaiscr-2019-0006","article-title":"Ludwig S A. Performance evaluation of deep neural networks applied to speech recognition: RNN, LSTM and GRU","volume":"9","author":"Shewalkar","year":"2019","journal-title":"J. Artif. Intell. Soft Comput. Res."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"1420","DOI":"10.1109\/TR.2023.3234055","article-title":"An improved method to search all minimal paths in networks","volume":"72","author":"Zhou","year":"2023","journal-title":"IEEE Trans. Reliab."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"6622","DOI":"10.1109\/JIOT.2022.3197155","article-title":"UAV-aided computation offloading in mobile-edge computing networks: A Stackelberg game approach","volume":"10","author":"Zhou","year":"2022","journal-title":"IEEE Internet Things J."},{"key":"ref_41","unstructured":"Lowe, R., Wu, Y.I., Tamar, A., Harb, J., Pieter Abbeel, O., and Mordatch, I. (2017, January 4\u20139). Multi-agent actor-critic for mixed cooperative-competitive environments. Proceedings of the 31st Conference on Neural Information Processing Systems (NIPS 2017), Long Beach, CA, USA. Advances in neural information processing systems."},{"key":"ref_42","unstructured":"Li, S., Wu, Y., Cui, X., Dong, H., Fang, F., and Russell, S. (February, January 27). Robust multi-agent reinforcement learning via minimax deep deterministic policy gradient. Proceedings of the AAAI conference on Artificial Intelligence, Honolulu, HI, USA."},{"key":"ref_43","unstructured":"Ra, M.R., Sheth, A., Mummert, L., Pillai, P., Wetherall, D., and Govindan, R. (July, January 28). Odessa: Enabling interactive perception applications on mobile devices. Proceedings of the 9th International Conference on Mobile Systems, Applications, and Services, Bethesda MD, USA."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"2449","DOI":"10.1109\/TC.2021.3131040","article-title":"Dependent task offloading for edge computing based on deep reinforcement learning","volume":"71","author":"Wang","year":"2021","journal-title":"IEEE Trans. Comput."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"5505","DOI":"10.1109\/TII.2019.2948406","article-title":"Joint computation and communication design for UAV-assisted mobile edge computing in IoT","volume":"16","author":"Zhang","year":"2019","journal-title":"IEEE Trans. Ind. Inform."}],"container-title":["Future Internet"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-5903\/16\/6\/181\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T14:45:39Z","timestamp":1760107539000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-5903\/16\/6\/181"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,21]]},"references-count":45,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2024,6]]}},"alternative-id":["fi16060181"],"URL":"https:\/\/doi.org\/10.3390\/fi16060181","relation":{},"ISSN":["1999-5903"],"issn-type":[{"type":"electronic","value":"1999-5903"}],"subject":[],"published":{"date-parts":[[2024,5,21]]}}}