{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,13]],"date-time":"2026-07-13T23:21:11Z","timestamp":1783984871417,"version":"3.55.0"},"reference-count":35,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2024,8,21]],"date-time":"2024-08-21T00:00:00Z","timestamp":1724198400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62362068"],"award-info":[{"award-number":["62362068"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["202201AT070156"],"award-info":[{"award-number":["202201AT070156"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["202301AT070194"],"award-info":[{"award-number":["202301AT070194"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["2023SE208"],"award-info":[{"award-number":["2023SE208"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100007471","name":"Applied Basic Research Foundation of Yunnan Province","doi-asserted-by":"publisher","award":["62362068"],"award-info":[{"award-number":["62362068"]}],"id":[{"id":"10.13039\/100007471","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100007471","name":"Applied Basic Research Foundation of Yunnan Province","doi-asserted-by":"publisher","award":["202201AT070156"],"award-info":[{"award-number":["202201AT070156"]}],"id":[{"id":"10.13039\/100007471","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100007471","name":"Applied Basic Research Foundation of Yunnan Province","doi-asserted-by":"publisher","award":["202301AT070194"],"award-info":[{"award-number":["202301AT070194"]}],"id":[{"id":"10.13039\/100007471","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100007471","name":"Applied Basic Research Foundation of Yunnan Province","doi-asserted-by":"publisher","award":["2023SE208"],"award-info":[{"award-number":["2023SE208"]}],"id":[{"id":"10.13039\/100007471","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Open Foundation of Yunnan Key Laboratory of Software Engineering","award":["62362068"],"award-info":[{"award-number":["62362068"]}]},{"name":"Open Foundation of Yunnan Key Laboratory of Software Engineering","award":["202201AT070156"],"award-info":[{"award-number":["202201AT070156"]}]},{"name":"Open Foundation of Yunnan Key Laboratory of Software Engineering","award":["202301AT070194"],"award-info":[{"award-number":["202301AT070194"]}]},{"name":"Open Foundation of Yunnan Key Laboratory of Software Engineering","award":["2023SE208"],"award-info":[{"award-number":["2023SE208"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Algorithms"],"abstract":"<jats:p>In the rapidly evolving domain of mobile edge\u2013cloud computing (MECC), the proliferation of Internet of Things (IoT) devices and mobile applications poses significant challenges, particularly in dynamically managing computational demands and user mobility. Current research has partially addressed aspects of service migration and resource allocation, yet it often falls short in thoroughly examining the nuanced interdependencies between migration strategies and resource allocation, the consequential impacts of migration delays, and the intricacies of handling incomplete tasks during migration. This study advances the discourse by introducing a sophisticated framework optimized through a deep reinforcement learning (DRL) strategy, underpinned by a Markov decision process (MDP) that dynamically adapts service migration and resource allocation strategies. This refined approach facilitates continuous system monitoring, adept decision making, and iterative policy refinement, significantly enhancing operational efficiency and reducing response times in MECC environments. By meticulously addressing these previously overlooked complexities, our research not only fills critical gaps in the literature but also enhances the practical deployment of edge computing technologies, contributing profoundly to both theoretical insights and practical implementations in contemporary digital ecosystems.<\/jats:p>","DOI":"10.3390\/a17080370","type":"journal-article","created":{"date-parts":[[2024,8,22]],"date-time":"2024-08-22T06:28:51Z","timestamp":1724308131000},"page":"370","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Joint Optimization of Service Migration and Resource Allocation in Mobile Edge\u2013Cloud Computing"],"prefix":"10.3390","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7986-2222","authenticated-orcid":false,"given":"Zhenli","family":"He","sequence":"first","affiliation":[{"name":"School of Software, Yunnan University, Kunming 650504, China"},{"name":"Yunnan Key Laboratory of Software Engineering, Yunnan University, Kunming 650504, China"},{"name":"Engineering Research Center of Cyberspace, Yunnan University, Kunming 650504, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-3536-4601","authenticated-orcid":false,"given":"Liheng","family":"Li","sequence":"additional","affiliation":[{"name":"School of Software, Yunnan University, Kunming 650504, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-8864-3478","authenticated-orcid":false,"given":"Ziqi","family":"Lin","sequence":"additional","affiliation":[{"name":"School of Software, Yunnan University, Kunming 650504, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-5251-9928","authenticated-orcid":false,"given":"Yunyun","family":"Dong","sequence":"additional","affiliation":[{"name":"School of Software, Yunnan University, Kunming 650504, China"},{"name":"Engineering Research Center of Cyberspace, Yunnan University, Kunming 650504, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-0982-1653","authenticated-orcid":false,"given":"Jianglong","family":"Qin","sequence":"additional","affiliation":[{"name":"School of Software, Yunnan University, Kunming 650504, China"},{"name":"Yunnan Key Laboratory of Software Engineering, Yunnan University, Kunming 650504, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5224-4048","authenticated-orcid":false,"given":"Keqin","family":"Li","sequence":"additional","affiliation":[{"name":"Department of Computer Science, State University of New York at New Paltz, New Paltz, NY 12561, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2024,8,21]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"726","DOI":"10.1109\/TSC.2018.2826544","article-title":"Multi-User Multi-Task Computation Offloading in Green Mobile Edge Cloud Computing","volume":"12","author":"Chen","year":"2019","journal-title":"IEEE Trans. Serv. Comput."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"4517","DOI":"10.1109\/TNSM.2021.3103533","article-title":"Code Caching-Assisted Computation Offloading and Resource Allocation for Multi-User Mobile Edge Computing","volume":"18","author":"Chen","year":"2021","journal-title":"IEEE Trans. Netw. Serv. Manag."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"102735","DOI":"10.1016\/j.jnca.2020.102735","article-title":"Data-intensive application scheduling on Mobile Edge Cloud Computing","volume":"167","author":"Alkhalaileh","year":"2020","journal-title":"J. Netw. Comput. Appl."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"23472","DOI":"10.1109\/JIOT.2022.3200431","article-title":"Edge Computing for Internet of Everything: A Survey","volume":"9","author":"Kong","year":"2022","journal-title":"IEEE Internet Things J."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1160","DOI":"10.1109\/COMST.2021.3061981","article-title":"A Survey on Mobile Augmented Reality With 5G Mobile Edge Computing: Architectures, Applications, and Technical Aspects","volume":"23","author":"Siriwardhana","year":"2021","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"538","DOI":"10.1109\/JSAC.2022.3233532","article-title":"Dependent Task Scheduling and Offloading for Minimizing Deadline Violation Ratio in Mobile Edge Computing Networks","volume":"41","author":"Liu","year":"2023","journal-title":"IEEE J. Sel. Areas Commun."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1697","DOI":"10.1109\/JPROC.2019.2915983","article-title":"Edge Computing for Autonomous Driving: Opportunities and Challenges","volume":"107","author":"Liu","year":"2019","journal-title":"Proc. IEEE"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"107496","DOI":"10.1016\/j.comnet.2020.107496","article-title":"A survey on the computation offloading approaches in mobile edge computing: A machine learning-based perspective","volume":"182","author":"Shakarami","year":"2020","journal-title":"Comput. Netw."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"591","DOI":"10.1109\/COMST.2022.3218527","article-title":"Distributed Artificial Intelligence Empowered by End-Edge-Cloud Computing: A Survey","volume":"25","author":"Duan","year":"2023","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"13126","DOI":"10.1109\/JIOT.2022.3140183","article-title":"Dynamic Service Migration and Request Routing for Microservice in Multicell Mobile-Edge Computing","volume":"9","author":"Chen","year":"2022","journal-title":"IEEE Internet Things J."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"380","DOI":"10.1109\/TCCN.2021.3103511","article-title":"Intelligent Service Migration Based on Hidden State Inference for Mobile Edge Computing","volume":"8","author":"Li","year":"2022","journal-title":"IEEE Trans. Cogn. Commun. Netw."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"102664","DOI":"10.1016\/j.sysarc.2022.102664","article-title":"Edge intelligence in motion: Mobility-aware dynamic DNN inference service migration with downtime in mobile edge computing","volume":"130","author":"Wang","year":"2022","journal-title":"J. Syst. Archit."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"4132","DOI":"10.1109\/TCOMM.2019.2898573","article-title":"Dynamic Task Offloading and Resource Allocation for Ultra-Reliable Low-Latency Edge Computing","volume":"67","author":"Liu","year":"2019","journal-title":"IEEE Trans. Commun."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Wang, X., Ye, J., and Lui, J.C. (2022, January 2\u20135). Decentralized Task Offloading in Edge Computing: A Multi-User Multi-Armed Bandit Approach. Proceedings of the IEEE INFOCOM 2022\u2014IEEE Conference on Computer Communications, London, UK.","DOI":"10.1109\/INFOCOM48880.2022.9796961"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"3205","DOI":"10.1109\/TNSM.2023.3240415","article-title":"Cooperative Task Offloading for Mobile Edge Computing Based on Multi-Agent Deep Reinforcement Learning","volume":"20","author":"Yang","year":"2023","journal-title":"IEEE Trans. Netw. Serv. Manag."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"694","DOI":"10.1109\/LWC.2023.3240476","article-title":"Joint Task Offloading and Cache Placement for Energy-Efficient Mobile Edge Computing Systems","volume":"12","author":"Liang","year":"2023","journal-title":"IEEE Wirel. Commun. Lett."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Fang, J., Qu, D., Chen, H., and Liu, Y. (2023). Dependency-Aware Dynamic Task Offloading Based on Deep Reinforcement Learning in Mobile Edge Computing. IEEE Trans. Netw. Serv. Manag., 1403\u20131415.","DOI":"10.1109\/TNSM.2023.3319294"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1761","DOI":"10.1109\/TETC.2022.3153494","article-title":"A Dynamic Task Scheduling Strategy for Multi-Access Edge Computing in IRS-Aided Vehicular Networks","volume":"10","author":"Zhu","year":"2022","journal-title":"IEEE Trans. Emerg. Top. Comput."},{"key":"ref_19","first-page":"2169","article-title":"Mobility-Aware Multi-Hop Task Offloading for Autonomous Driving in Vehicular Edge Computing and Networks","volume":"24","author":"Liu","year":"2023","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Dang, X., Su, L., Hao, Z., and Shang, X. (2022). Dynamic Offloading Method for Mobile Edge Computing of Internet of Vehicles Based on Multi-Vehicle Users and Multi-MEC Servers. Electronics, 11.","DOI":"10.3390\/electronics11152326"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1016\/j.jpdc.2022.09.006","article-title":"Online computation offloading with double reinforcement learning algorithm in mobile edge computing","volume":"171","author":"Liao","year":"2023","journal-title":"J. Parallel Distrib. Comput."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"2500","DOI":"10.1109\/JSYST.2023.3249217","article-title":"Joint Computation Offloading and Resource Allocation for Edge-Cloud Collaboration in Internet of Vehicles via Deep Reinforcement Learning","volume":"17","author":"Huang","year":"2023","journal-title":"IEEE Syst. J."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"102780","DOI":"10.1016\/j.sysarc.2022.102780","article-title":"Joint task offloading and resource optimization in NOMA-based vehicular edge computing: A game-theoretic DRL approach","volume":"134","author":"Xu","year":"2023","journal-title":"J. Syst. Archit."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"15513","DOI":"10.1109\/TITS.2023.3249745","article-title":"Asynchronous Deep Reinforcement Learning for Collaborative Task Computing and On-Demand Resource Allocation in Vehicular Edge Computing","volume":"24","author":"Liu","year":"2023","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"10981","DOI":"10.1109\/TWC.2022.3188695","article-title":"A Two-Timescale Approach to Mobility Management for Multicell Mobile Edge Computing","volume":"21","author":"Liang","year":"2022","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"109798","DOI":"10.1016\/j.comnet.2023.109798","article-title":"Digital twin-assisted and mobility-aware service migration in Mobile Edge Computing","volume":"231","author":"Bozkaya","year":"2023","journal-title":"Comput. Netw."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"257","DOI":"10.1109\/TMC.2022.3225239","article-title":"Computing and Communication Cost-Aware Service Migration Enabled by Transfer Reinforcement Learning for Dynamic Vehicular Edge Computing Networks","volume":"23","author":"Peng","year":"2024","journal-title":"IEEE Trans. Mob. Comput."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"394","DOI":"10.1002\/spe.3014","article-title":"PDMA: Probabilistic service migration approach for delay-aware and mobility-aware mobile edge computing","volume":"52","author":"Xu","year":"2022","journal-title":"Softw. Pract. Exp."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"e4413","DOI":"10.1002\/dac.4413","article-title":"Service migration in mobile edge computing: A deep reinforcement learning approach","volume":"36","author":"Wang","year":"2023","journal-title":"Int. J. Commun. Syst."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1016\/j.jpdc.2022.03.001","article-title":"Energy-latency tradeoffs for edge caching and dynamic service migration based on DQN in mobile edge computing","volume":"166","author":"Li","year":"2022","journal-title":"J. Parallel Distrib. Comput."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"101397","DOI":"10.1016\/j.phycom.2021.101397","article-title":"A multi-user service migration scheme based on deep reinforcement learning and SDN in mobile edge computing","volume":"47","author":"Chen","year":"2021","journal-title":"Phys. Commun."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"108552","DOI":"10.1016\/j.compeleceng.2022.108552","article-title":"Service migration for mobile edge computing based on partially observable Markov decision processes","volume":"106","author":"Chen","year":"2023","journal-title":"Comput. Electr. Eng."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"5898","DOI":"10.1109\/TWC.2021.3070974","article-title":"Multi-Cell Mobile Edge Computing: Joint Service Migration and Resource Allocation","volume":"20","author":"Liang","year":"2021","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"11341","DOI":"10.1109\/JIOT.2023.3332421","article-title":"Joint Service Migration and Resource Allocation in Edge IoT System Based on Deep Reinforcement Learning","volume":"11","author":"Liu","year":"2024","journal-title":"IEEE Internet Things J."},{"key":"ref_35","unstructured":"Sutton, R., and Barto, A. (2018). Reinforcement Learning, Second Edition: An Introduction, MIT Press."}],"container-title":["Algorithms"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-4893\/17\/8\/370\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T15:40:08Z","timestamp":1760110808000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-4893\/17\/8\/370"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,8,21]]},"references-count":35,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2024,8]]}},"alternative-id":["a17080370"],"URL":"https:\/\/doi.org\/10.3390\/a17080370","relation":{},"ISSN":["1999-4893"],"issn-type":[{"value":"1999-4893","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,8,21]]}}}