{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,27]],"date-time":"2026-03-27T00:38:36Z","timestamp":1774571916268,"version":"3.50.1"},"reference-count":26,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2022,5,28]],"date-time":"2022-05-28T00:00:00Z","timestamp":1653696000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Institute for Information and Communications Technology Planning and Evaluation (IITP) through the Korean Government [Ministry of Science and ICT (MSIT)]","award":["2020-0-00116"],"award-info":[{"award-number":["2020-0-00116"]}]},{"name":"Institute for Information and Communications Technology Planning and Evaluation (IITP) through the Korean Government [Ministry of Science and ICT (MSIT)]","award":["NRF-2020R1I1A3065610"],"award-info":[{"award-number":["NRF-2020R1I1A3065610"]}]},{"name":"Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education","award":["2020-0-00116"],"award-info":[{"award-number":["2020-0-00116"]}]},{"name":"Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education","award":["NRF-2020R1I1A3065610"],"award-info":[{"award-number":["NRF-2020R1I1A3065610"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Recently, intelligent IoT applications based on artificial intelligence (AI) have been deployed with mobile edge computing (MEC). Intelligent IoT applications demand more computing resources and lower service latencies for AI tasks in dynamic MEC environments. Thus, in this paper, considering the resource scalability and resource optimization of edge computing, an intelligent task dispatching model using a deep Q-network, which can efficiently use the computing resource of edge nodes is proposed to maximize the computation ability of the cluster edge system, which consists of multiple edge nodes. The cluster edge system can be implemented with the Kubernetes technology. The objective of the proposed model is to minimize the average response time of tasks offloaded to the edge computing system and optimize the resource allocation for computing the offloaded tasks. For this, we first formulate the optimization problem of resource allocation as a Markov decision process (MDP) and adopt a deep reinforcement learning technology to solve this problem. Thus, the proposed intelligent task dispatching model is designed based on a deep Q-network (DQN) algorithm to update the task dispatching policy. The simulation results show that the proposed model archives a better convergence performanc in terms of the average completion time of all offloaded tasks, than existing task dispatching methods, such as the Random Method, Least Load Method and Round-Robin Method, and has a better task completion rate than the existing task dispatching method when using the same resources as the cluster edge system.<\/jats:p>","DOI":"10.3390\/s22114098","type":"journal-article","created":{"date-parts":[[2022,5,31]],"date-time":"2022-05-31T02:30:06Z","timestamp":1653964206000},"page":"4098","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":13,"title":["Intelligent Task Dispatching and Scheduling Using a Deep Q-Network in a Cluster Edge Computing System"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9952-9649","authenticated-orcid":false,"given":"Joosang","family":"Youn","sequence":"first","affiliation":[{"name":"Department of Industrial ICT Engineering, Dong-Eui University, Busan 47340, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5835-7972","authenticated-orcid":false,"given":"Youn-Hee","family":"Han","sequence":"additional","affiliation":[{"name":"Future Convergence Engineering, Department of Computer Science and Engineering, Korea University of Technology and Education, Cheonan 31253, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,5,28]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"6722","DOI":"10.1109\/JIOT.2020.3004500","article-title":"Toward Edge Intelligence: Multiaccess Edge Computing for 5G and Internet of Things","volume":"7","author":"Liu","year":"2020","journal-title":"IEEE Internet Things J."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"637","DOI":"10.1109\/JIOT.2016.2579198","article-title":"Edge Computing: Vision and Challenges","volume":"3","author":"Shi","year":"2016","journal-title":"IEEE Internet Things J."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"450","DOI":"10.1109\/JIOT.2017.2750180","article-title":"Mobile Edge Computing: A Survey","volume":"5","author":"Abbas","year":"2018","journal-title":"IEEE Internet Things J."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"2322","DOI":"10.1109\/COMST.2017.2745201","article-title":"A survey on mobile edge computing: The communication perspective","volume":"19","author":"Mao","year":"2017","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"6900","DOI":"10.1109\/ACCESS.2017.2778504","article-title":"A Survey on the Edge Computing for the Internet of Things","volume":"6","author":"Yu","year":"2017","journal-title":"IEEE Access"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"47980","DOI":"10.1109\/ACCESS.2018.2866491","article-title":"Fog Computing: Survey of Trends, Architectures, Requirements, and Research Directions","volume":"6","author":"Naha","year":"2018","journal-title":"IEEE Access"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1125","DOI":"10.1109\/JIOT.2017.2683200","article-title":"A Survey on Internet of Things: Architecture, Enabling Technologies, Security and Privacy, and Applications","volume":"4","author":"Lin","year":"2017","journal-title":"IEEE Internet Things J."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"3317","DOI":"10.1109\/TPDS.2014.2381640","article-title":"Albert. Computation Offloading for Service Workflow in Mobile Cloud Computing","volume":"26","author":"Deng","year":"2014","journal-title":"IEEE Trans. Parallel Distrib. Syst."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"54074","DOI":"10.1109\/ACCESS.2020.2981434","article-title":"Task Offloading and Resource Allocation for Mobile Edge Computing by Deep Reinforcement Learning Based on SARSA","volume":"8","author":"Alfakih","year":"2020","journal-title":"IEEE Access"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"85204","DOI":"10.1109\/ACCESS.2020.2991773","article-title":"Distributed Edge Computing Offloading Algorithm Based on Deep Reinforcement Learning","volume":"8","author":"Li","year":"2020","journal-title":"IEEE Access"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1133","DOI":"10.1109\/JSAC.2020.2986615","article-title":"Resource Allocation Based on Deep Reinforcement Learning in IoT Edge Computing","volume":"38","author":"Xiong","year":"2020","journal-title":"IEEE J. Sel. Areas Commun."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"7011","DOI":"10.1109\/JIOT.2019.2913162","article-title":"iRAF: A Deep Reinforcement Learning Approach for Collaborative Mobile Edge Computing IoT Networks","volume":"6","author":"Chen","year":"2019","journal-title":"IEEE Internet Things J."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Sheng, S., Chen, P., Chen, Z., Wu, L., and Yao, Y. (2021). Deep Reinforcement Learning-Based Task Scheduling in IoT Edge Computing. Sensors, 21.","DOI":"10.3390\/s21051666"},{"key":"ref_14","unstructured":"(2022, March 23). Kubernetes. Available online: https:\/\/kubernetes.io\/."},{"key":"ref_15","unstructured":"(2022, March 23). Clusters at the Edge. Available online: https:\/\/www.ibm.com\/cloud\/blog\/clusters-at-the-edge."},{"key":"ref_16","unstructured":"(2022, March 23). Docker Awarm. Available online: https:\/\/github.com\/docker\/swarm."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"263","DOI":"10.1016\/j.future.2021.01.008","article-title":"Programming framework and infrastructure for self-adaptation and optimized evolution method for microservice systems in cloud\u2013edge environments","volume":"118","author":"He","year":"2021","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1603","DOI":"10.1109\/TPDS.2020.3046737","article-title":"Distributed Task Migration Optimization in MEC by Extending Multi-Agent Deep Reinforcement Learning Approach","volume":"32","author":"Liu","year":"2021","journal-title":"IEEE Trans. Parallel Distrib. Syst."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Tian, K., Chai, H., Liu, Y., and Liu, B. (2022). Edge Intelligence Empowered Dynamic Offloading and Resource Management of MEC for Smart City Internet of Things. Electronics, 11.","DOI":"10.3390\/electronics11060879"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"4925","DOI":"10.1109\/TII.2020.3028963","article-title":"Deep reinforcement learning-based dynamic resource management for mobile edge computing in industrial internet of things","volume":"17","author":"Chen","year":"2021","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"12175","DOI":"10.1109\/TVT.2020.3013990","article-title":"Edge intelligence for energy-efficient computation offloading and resource allocation in 5G beyond","volume":"69","author":"Dai","year":"2020","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"105008","DOI":"10.1109\/ACCESS.2019.2931336","article-title":"Joint Cotask-Aware Offloading and Scheduling in Mobile Edge Computing Systems","volume":"7","author":"Chiang","year":"2019","journal-title":"IEEE Access."},{"key":"ref_23","first-page":"5068","article-title":"Energy-Aware Marine Predators Algorithm for Task Scheduling in IoT-based Fog Computing Applications","volume":"7","author":"Mohamed","year":"2021","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1270","DOI":"10.1109\/TPDS.2019.2961905","article-title":"Online Deadline-Aware Task Dispatching and Scheduling in Edge Computing","volume":"31","author":"Meng","year":"2020","journal-title":"IEEE Trans. Parallel Distrib. Syst."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Yang, B., Cao, X., Bassey, J., Li, X., Kroecker, T., and Qian, L. (2019, January 20\u201324). Computation Offloading in Multi-Access Edge Computing Networks: A Multi-Task Learning Approach. Proceedings of the ICC 2019\u20142019 IEEE International Conference on Communications (ICC), Shanghai, China.","DOI":"10.1109\/ICC.2019.8761212"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Symeonides, M., Georgiou, Z., Trihinas, D., Pallis, G., and Dikaiakos, M.D. (2020, January 12\u201314). Fogify: A Fog Computing Emulation Framework. Proceedings of the 2020 IEEE\/ACM Symposium on Edge Computing (SEC), San Jose, CA, USA.","DOI":"10.1109\/SEC50012.2020.00011"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/11\/4098\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:20:23Z","timestamp":1760138423000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/11\/4098"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,5,28]]},"references-count":26,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2022,6]]}},"alternative-id":["s22114098"],"URL":"https:\/\/doi.org\/10.3390\/s22114098","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,5,28]]}}}