{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,14]],"date-time":"2026-05-14T23:46:47Z","timestamp":1778802407798,"version":"3.51.4"},"reference-count":41,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2022,1,18]],"date-time":"2022-01-18T00:00:00Z","timestamp":1642464000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100005315","name":"Natural Science Foundation of Ningbo","doi-asserted-by":"publisher","award":["2018A610154"],"award-info":[{"award-number":["2018A610154"]}],"id":[{"id":"10.13039\/501100005315","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Natural Science Foundation of  Ningbo","award":["202003N4087"],"award-info":[{"award-number":["202003N4087"]}]},{"name":"Zhejiang Provincial Natural Science Foundation of China","award":["LY18F020011"],"award-info":[{"award-number":["LY18F020011"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Future Internet"],"abstract":"<jats:p>In IoT (Internet of Things) edge computing, task offloading can lead to additional transmission delays and transmission energy consumption. To reduce the cost of resources required for task offloading and improve the utilization of server resources, in this paper, we model the task offloading problem as a joint decision making problem for cost minimization, which integrates the processing latency, processing energy consumption, and the task throw rate of latency-sensitive tasks. The Online Predictive Offloading (OPO) algorithm based on Deep Reinforcement Learning (DRL) and Long Short-Term Memory (LSTM) networks is proposed to solve the above task offloading decision problem. In the training phase of the model, this algorithm predicts the load of the edge server in real-time with the LSTM algorithm, which effectively improves the convergence accuracy and convergence speed of the DRL algorithm in the offloading process. In the testing phase, the LSTM network is used to predict the characteristics of the next task, and then the computational resources are allocated for the task in advance by the DRL decision model, thus further reducing the response delay of the task and enhancing the offloading performance of the system. The experimental evaluation shows that this algorithm can effectively reduce the average latency by 6.25%, the offloading cost by 25.6%, and the task throw rate by 31.7%.<\/jats:p>","DOI":"10.3390\/fi14020030","type":"journal-article","created":{"date-parts":[[2022,1,18]],"date-time":"2022-01-18T22:46:32Z","timestamp":1642545992000},"page":"30","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":64,"title":["Task Offloading Based on LSTM Prediction and Deep Reinforcement Learning for Efficient Edge Computing in IoT"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0819-093X","authenticated-orcid":false,"given":"Youpeng","family":"Tu","sequence":"first","affiliation":[{"name":"Faculty of Electrical Engineering and Computer Science, Ningbo University, Ningbo 315211, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3311-1837","authenticated-orcid":false,"given":"Haiming","family":"Chen","sequence":"additional","affiliation":[{"name":"Faculty of Electrical Engineering and Computer Science, Ningbo University, Ningbo 315211, China"},{"name":"Zhejiang Provincial Key Laboratory of Mobile Network Application Technology, Ningbo University, Ningbo 315211, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3895-1410","authenticated-orcid":false,"given":"Linjie","family":"Yan","sequence":"additional","affiliation":[{"name":"Faculty of Electrical Engineering and Computer Science, Ningbo University, Ningbo 315211, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1368-8839","authenticated-orcid":false,"given":"Xinyan","family":"Zhou","sequence":"additional","affiliation":[{"name":"Faculty of Electrical Engineering and Computer Science, Ningbo University, Ningbo 315211, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,1,18]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"100273","DOI":"10.1016\/j.iot.2020.100273","article-title":"Performance Evaluation Metrics for Cloud, Fog and Edge Computing: A Review, Taxonomy, Benchmarks and Standards for Future Research","volume":"12","author":"Aslanpour","year":"2020","journal-title":"Internet Things"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"637","DOI":"10.1109\/JIOT.2016.2579198","article-title":"Edge Computing: Vision and Challenges","volume":"3","author":"Shi","year":"2016","journal-title":"IEEE Internet Things J."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"450","DOI":"10.1109\/JIOT.2017.2750180","article-title":"Mobile Edge Computing: A Survey","volume":"5","author":"Abbas","year":"2018","journal-title":"IEEE Internet Things J."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1584","DOI":"10.1109\/JPROC.2019.2922285","article-title":"Computation Offloading Toward Edge Computing","volume":"107","author":"Lin","year":"2019","journal-title":"Proc. IEEE"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"717","DOI":"10.1016\/j.future.2019.12.039","article-title":"Offloading Decision Methods for Multiple Users with Structured Tasks in Edge Computing for Smart Cities","volume":"105","author":"Kuang","year":"2020","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1109\/TNSM.2019.2937342","article-title":"Workload and Capacity Optimization for Cloud-Edge Computing Systems with Vertical and Horizontal Offloading","volume":"17","author":"Thai","year":"2020","journal-title":"IEEE Trans. Netw. Serv. Manag."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"4791","DOI":"10.1109\/JIOT.2018.2869226","article-title":"Joint Optimization of Energy Consumption and Latency in Mobile Edge Computing for Internet of Things","volume":"6","author":"Cui","year":"2018","journal-title":"IEEE Internet Things J."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Gu, Q., Wang, G., Liu, J., Fan, R., Fan, D., and Zhong, Z. (2018, January 9\u201313). Optimal Offloading with Non-Orthogonal Multiple Access in Mobile Edge Computing. Proceedings of the 2018 IEEE Global Communications Conference (GLOBECOM), Abu Dhabi, United Arab Emirates.","DOI":"10.1109\/GLOCOM.2018.8647179"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Mukherjee, M., Kumar, V., Kumar, S., Matamy, R., Mavromoustakis, C.X., Zhang, Q., Shojafar, M., and Mastorakis, G. (2020, January 7\u201311). Computation Offloading Strategy in Heterogeneous Fog Computing with Energy and Delay Constraints. Proceedings of the IEEE International Conference on Communications (ICC), Online.","DOI":"10.1109\/ICC40277.2020.9148852"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"4201","DOI":"10.1109\/JIOT.2018.2875241","article-title":"Secrecy-Based Delay-Aware Computation Offloading via Mobile Edge Computing for Internet of Things","volume":"6","author":"Wu","year":"2019","journal-title":"IEEE Internet Things J."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Meng, H., Chao, D., and Guo, Q. (2019, January 12\u201315). Deep Reinforcement Learning Based Task Offloading Algorithm for Mobile-Edge Computing Systems. Proceedings of the 2019 4th International Conference on Mathematics and Artificial Intelligence, Chegndu, China.","DOI":"10.1145\/3325730.3325732"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"2581","DOI":"10.1109\/TMC.2019.2928811","article-title":"Deep Reinforcement Learning for Online Computation Offloading in Wireless Powered Mobile-Edge Computing Networks","volume":"19","author":"Huang","year":"2020","journal-title":"IEEE Trans. Mob. Comput."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Yan, P., and Choudhury, S. (2020, January 7\u201311). Optimizing Mobile Edge Computing Multi-Level Task Offloading via Deep Reinforcement Learning. Proceedings of the IEEE International Conference on Communications (ICC), Dublin, Ireland.","DOI":"10.1109\/ICC40277.2020.9149024"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1016\/j.dcan.2018.10.003","article-title":"Deep Reinforcement Learning-based Joint Task Offloading and Bandwidth Allocation for Multi-user Mobile Edge Computing","volume":"5","author":"Huang","year":"2019","journal-title":"Digit. Commun. Netw."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"373","DOI":"10.1016\/j.procs.2020.03.240","article-title":"Time Series Data Prediction using IoT and Machine Learning Technique","volume":"167","author":"Kumar","year":"2020","journal-title":"Procedia Comput. Sci."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Abdellah, A.R., Mahmood, O.A.K., Paramonov, A., and Koucheryavy, A. (2019, January 28\u201330). IoT Traffic Prediction Using Multi-step Ahead Prediction with Neural Network. Proceedings of the 2019 11th International Congress on Ultra Modern Telecommunications and Control Systems and Workshops (ICUMT), Dublin, Ireland.","DOI":"10.1109\/ICUMT48472.2019.8970675"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Gao, J., Wang, H., and Shen, H. (2020, January 3\u20136). Machine Learning Based Workload Prediction in Cloud Computing. Proceedings of the 2020 29th International Conference on Computer Communications and Networks (ICCCN), Online.","DOI":"10.1109\/ICCCN49398.2020.9209730"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"2239","DOI":"10.1109\/TITS.2020.3024233","article-title":"Machine Learning-Based Workload Orchestrator for Vehicular Edge Computing","volume":"22","author":"Sonmez","year":"2021","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1678","DOI":"10.1109\/JIOT.2019.2943373","article-title":"Multi-User Offloading for Edge Computing Networks: A Dependency-Aware and Latency-Optimal Approach","volume":"7","author":"Shu","year":"2020","journal-title":"IEEE Internet Things J."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"4514","DOI":"10.1109\/TVT.2018.2790421","article-title":"Collaborative Computation Offloading for Multiaccess Edge Computing Over Fiber\u2013Wireless Networks","volume":"67","author":"Guo","year":"2018","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"152","DOI":"10.1109\/MNET.011.2000611","article-title":"A Federated Reinforcement Learning Framework for Incumbent Technologies in Beyond 5G Networks","volume":"35","author":"Ali","year":"2021","journal-title":"IEEE Netw."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"126","DOI":"10.1109\/MCOMSTD.001.2000055","article-title":"Reinforcement-Learning-Enabled Massive Internet of Things for 6G Wireless Communications","volume":"5","author":"Ali","year":"2021","journal-title":"IEEE Commun. Stand. Mag."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"191","DOI":"10.23919\/JCC.2020.05.015","article-title":"Energy-optimal and Delay-bounded Computation Offloading in Mobile Edge Computing with Heterogeneous Clouds","volume":"17","author":"Zhao","year":"2020","journal-title":"China Commun."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Vu, T.T., Huynh, N.V., Hoang, D.T., Nguyen, D.N., and Dutkiewicz, E. (2018, January 9\u201313). Offloading Energy Efficiency with Delay Constraint for Cooperative Mobile Edge Computing Networks. Proceedings of the 2018 IEEE Global Communications Conference (GLOBECOM), Abu Dhabi, United Arab Emirates.","DOI":"10.1109\/GLOCOM.2018.8647856"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1277","DOI":"10.1109\/TASE.2020.3000946","article-title":"Profit-Maximized Collaborative Computation Offloading and Resource Allocation in Distributed Cloud and Edge Computing Systems","volume":"18","author":"Yuan","year":"2021","journal-title":"IEEE Trans. Autom. Sci. Eng."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"3942","DOI":"10.1109\/TNSM.2021.3123959","article-title":"DeepEdge: A New QoE-Based Resource Allocation Framework Using Deep Reinforcement Learning for Future Heterogeneous Edge-IoT Applications","volume":"18","author":"Alqerm","year":"2021","journal-title":"IEEE Trans. Netw. Serv. Manag."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Amin, F., Ahmad, A., and Sang Choi, G. (2019). Towards Trust and Friendliness Approaches in the Social Internet of Things. Appl. Sci., 9.","DOI":"10.3390\/app9010166"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1659","DOI":"10.1109\/COMST.2021.3073036","article-title":"Deep Reinforcement Learning for Internet of Things: A Comprehensive Survey","volume":"23","author":"Chen","year":"2021","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Huang, L., Feng, X., Feng, A., Huang, Y., and Qian, L.P. (2018). Distributed Deep Learning-based Offloading for Mobile Edge Computing Networks. Mob. Netw. Appl., 1\u20138.","DOI":"10.1007\/s11036-018-1177-x"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Tang, M., and Wong, V.W. (2020). Deep Reinforcement Learning for Task Offloading in Mobile Edge Computing Systems. IEEE Trans. Mob. Comput., 1.","DOI":"10.1109\/ICCWorkshops49005.2020.9145133"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"146588","DOI":"10.1109\/ACCESS.2020.3014922","article-title":"Knowledge Transfer for On-Device Deep Reinforcement Learning in Resource Constrained Edge Computing Systems","volume":"8","author":"Jang","year":"2020","journal-title":"IEEE Access"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Gong, Y., Wang, J., and Nie, T. (2020, January 5\u20138). Deep Reinforcement Learning Aided Computation Offloading and Resource Allocation for IoT. Proceedings of the 2020 IEEE Computing, Communications and IoT Applications (ComComAp), Beijing, China.","DOI":"10.1109\/ComComAp51192.2020.9398891"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"4005","DOI":"10.1109\/JIOT.2018.2876279","article-title":"Optimized Computation Offloading Performance in Virtual Edge Computing Systems Via Deep Reinforcement Learning","volume":"6","author":"Chen","year":"2019","journal-title":"IEEE Internet Things J."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"118192","DOI":"10.1109\/ACCESS.2020.3004861","article-title":"Semi-Online Computational Offloading by Dueling Deep-Q Network for User Behavior Prediction","volume":"8","author":"Song","year":"2020","journal-title":"IEEE Access"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"228","DOI":"10.1109\/TC.2020.2987567","article-title":"A3C-DO: A Regional Resource Scheduling Framework Based on Deep Reinforcement Learning in Edge Scenario","volume":"70","author":"Zou","year":"2021","journal-title":"IEEE Trans. Comput."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"2342","DOI":"10.1109\/JIOT.2020.3048345","article-title":"Blockchain-Enabled Secure Data Sharing Scheme in Mobile-Edge Computing: An Asynchronous Advantage Actor\u2013Critic Learning Approach","volume":"8","author":"Liu","year":"2021","journal-title":"IEEE Internet Things J."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1308","DOI":"10.1109\/JIOT.2020.3003398","article-title":"Soft Actor\u2013Critic DRL for Live Transcoding and Streaming in Vehicular Fog-Computing-Enabled IoV","volume":"8","author":"Fu","year":"2021","journal-title":"IEEE Internet Things J."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"7011","DOI":"10.1109\/JIOT.2019.2913162","article-title":"iRAF: A Deep Reinforcement Learning Approach for Collaborative Mobile Edge Computing IoT Networks","volume":"6","author":"Chen","year":"2019","journal-title":"IEEE Internet Things J."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"433","DOI":"10.1016\/j.dcan.2020.04.008","article-title":"An Intelligent Task Offloading Algorithm (iTOA) for UAV Edge Computing Network","volume":"6","author":"Chen","year":"2020","journal-title":"Digit. Commun. Netw."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"14985","DOI":"10.1109\/JIOT.2021.3073034","article-title":"Online Dispatching and Fair Scheduling of Edge Computing Tasks: A Learning-Based Approach","volume":"8","author":"Yuan","year":"2021","journal-title":"IEEE Internet Things J."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"17508","DOI":"10.1109\/JIOT.2021.3081694","article-title":"A DRL Agent for Jointly Optimizing Computation Offloading and Resource Allocation in MEC","volume":"8","author":"Chen","year":"2021","journal-title":"IEEE Internet Things J."}],"container-title":["Future Internet"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-5903\/14\/2\/30\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:03:28Z","timestamp":1760133808000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-5903\/14\/2\/30"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,1,18]]},"references-count":41,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2022,2]]}},"alternative-id":["fi14020030"],"URL":"https:\/\/doi.org\/10.3390\/fi14020030","relation":{},"ISSN":["1999-5903"],"issn-type":[{"value":"1999-5903","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,1,18]]}}}