{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,29]],"date-time":"2026-05-29T11:29:55Z","timestamp":1780054195003,"version":"3.54.0"},"reference-count":34,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2022,11,10]],"date-time":"2022-11-10T00:00:00Z","timestamp":1668038400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,11,10]],"date-time":"2022-11-10T00:00:00Z","timestamp":1668038400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62172134"],"award-info":[{"award-number":["62172134"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Cloud Comp"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The edge-cloud computing architecture has been introduced to industrial circles to ensure the time constraints for industrial computing tasks. Besides the central cloud, various numbers of edge servers (ESes) are deployed in a distributed manner. In the meantime, most large factories currently use auto guided vehicles (AGVs). They usually travel along a given route and can help offload tasks to ESes. An ES maybe accessed by multiple AGVs, thus incurring offloading and processing delays due to resource competition. In this paper, we investigate the offloading scheduling issue for cyclical tasks and put forth the Multi-AGV Cyclical Offloading Optimization (MCOO) algorithm to reduce conflicts. The solution divides the offloading optimization problem into two parts. Firstly, the load balancing algorithm and greedy algorithm are utilized to find the optimal allocation of tasks for a single AGV under limited conditions. Then, multiple AGVs are asynchronously trained by applying the Reinforcement Learning-based A3C algorithm to optimize the offloading scheme. The simulation results show that the MCOO algorithm improves the global offloading performance both in task volume and adaptability compared with the baseline algorithms.<\/jats:p>","DOI":"10.1186\/s13677-022-00352-z","type":"journal-article","created":{"date-parts":[[2022,11,10]],"date-time":"2022-11-10T15:04:38Z","timestamp":1668092678000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":16,"title":["Reinforcement learning empowered multi-AGV offloading scheduling in edge-cloud IIoT"],"prefix":"10.1186","volume":"11","author":[{"given":"Peng","family":"Liu","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhe","family":"Liu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ji","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zifu","family":"Wu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Peng","family":"Li","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Huijuan","family":"Lu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2022,11,10]]},"reference":[{"key":"352_CR1","doi-asserted-by":"crossref","unstructured":"Chen Y, Gu W, Xu J et al (2022) Dynamic task offloading for digital twin-empowered mobile edge computing via deep reinforcement learning. China Commun","DOI":"10.1002\/dac.5154"},{"key":"352_CR2","doi-asserted-by":"publisher","DOI":"10.1016\/j.buildenv.2022.109513","author":"K Li","year":"2022","unstructured":"Li K, Zhao J, Hu J et al (2022) Dynamic energy efficient task offloading and resource allocation for noma-enabled iot in smart buildings and environment. Build Environ. https:\/\/doi.org\/10.1016\/j.buildenv.2022.109513","journal-title":"Build Environ"},{"key":"352_CR3","doi-asserted-by":"publisher","first-page":"49","DOI":"10.1186\/s13677-020-00194-7","volume":"9","author":"O Tomarchio","year":"2020","unstructured":"Tomarchio O, Calcaterra D, Modica GD (2020) Cloud resource orchestration in the multi-cloud landscape: a systematic review of existing frameworks. J Cloud Comput 9:49","journal-title":"J Cloud Comput"},{"key":"352_CR4","doi-asserted-by":"publisher","DOI":"10.1016\/j.dcan.2021.09.012","author":"Q Ren","year":"2021","unstructured":"Ren Q, Liu K, Zhang L (2021) Multi-objective optimization for task offloading based on network calculus in fog environments. Digit Commun Netw. https:\/\/doi.org\/10.1016\/j.dcan.2021.09.012","journal-title":"Digit Commun Netw"},{"issue":"1","key":"352_CR5","doi-asserted-by":"publisher","first-page":"41","DOI":"10.1186\/s13677-021-00256-4","volume":"10","author":"Q You","year":"2021","unstructured":"You Q, Tang B (2021) Efficient task offloading using particle swarm optimization algorithm in edge computing for industrial internet of things. J Cloud Comput 10(1):41","journal-title":"J Cloud Comput"},{"issue":"2","key":"352_CR6","doi-asserted-by":"publisher","first-page":"1175","DOI":"10.1109\/COMST.2022.3158270","volume":"24","author":"Y Wu","year":"2022","unstructured":"Wu Y, Dai HN, Wang H, Xiong Z, Guo S (2022) A survey of intelligent network slicing management for industrial iot: Integrated approaches for smart transportation, smart energy, and smart factory. IEEE Commun Surv Tutorials 24(2):1175\u20131211","journal-title":"IEEE Commun Surv Tutorials"},{"issue":"5","key":"352_CR7","doi-asserted-by":"publisher","first-page":"1117","DOI":"10.1109\/JSAC.2019.2906789","volume":"37","author":"N Cheng","year":"2019","unstructured":"Cheng N, Lyu F, Quan W, Zhou C, He H, Shi W, Shen X (2019) Space\/aerial-assisted computing offloading for iot applications: A learning-based approach. IEEE J Sel Areas Comput 37(5):1117\u20131129","journal-title":"IEEE J Sel Areas Comput"},{"issue":"5","key":"352_CR8","doi-asserted-by":"publisher","first-page":"4584","DOI":"10.1109\/TVT.2021.3133586","volume":"71","author":"Y Chen","year":"2022","unstructured":"Chen Y, Zhao F, Chen X, Wu Y (2022) Efficient multi-vehicle task offloading for mobile edge computing in 6g networks. IEEE Trans Veh Technol 71(5):4584\u20134595","journal-title":"IEEE Trans Veh Technol"},{"issue":"4","key":"352_CR9","doi-asserted-by":"publisher","first-page":"433","DOI":"10.1016\/j.dcan.2020.04.008","volume":"6","author":"J Chen","year":"2020","unstructured":"Chen J, Chen S, Luo S, Wang Q, Cao B, Li X (2020) An intelligent task offloading algorithm (itoa) for uav edge computing network. Digit Commun Netw 6(4):433\u2013443","journal-title":"Digit Commun Netw"},{"issue":"6","key":"352_CR10","doi-asserted-by":"publisher","first-page":"3800","DOI":"10.1109\/TITS.2021.3058140","volume":"22","author":"T Yang","year":"2021","unstructured":"Yang T, Kong L, Zhao N, Sun R (2021) Efficient energy and delay tradeoff for vessel communications in sdn based maritime wireless networks. IEEE Trans Intell Transp Syst 22(6):3800\u20133812","journal-title":"IEEE Trans Intell Transp Syst"},{"issue":"8","key":"352_CR11","doi-asserted-by":"publisher","first-page":"6722","DOI":"10.1109\/JIOT.2020.3004500","volume":"7","author":"Y Liu","year":"2020","unstructured":"Liu Y, Peng M, Shou G, Chen Y, Chen S (2020) Toward edge intelligence: Multiaccess edge computing for 5g and internet of things. IEEE Internet Things J 7(8):6722\u20136747","journal-title":"IEEE Internet Things J"},{"key":"352_CR12","doi-asserted-by":"publisher","DOI":"10.1016\/j.buildenv.2022.109218","author":"J Xu","year":"2022","unstructured":"Xu J, Li D, Gu W et al (2022) Uav-assisted task offloading for iot in smart buildings and environment via deep reinforcement learning. Build Environ. https:\/\/doi.org\/10.1016\/j.buildenv.2022.109218","journal-title":"Build Environ"},{"issue":"3","key":"352_CR13","doi-asserted-by":"publisher","first-page":"1678","DOI":"10.1109\/JIOT.2019.2943373","volume":"7","author":"C Shu","year":"2020","unstructured":"Shu C, Zhao Z, Han Y, Min G, Duan H (2020) Multi-user offloading for edge computing networks: A dependency-aware and latency-optimal approach. IEEE Internet Things J 7(3):1678\u20131689","journal-title":"IEEE Internet Things J"},{"key":"352_CR14","doi-asserted-by":"publisher","DOI":"10.26599\/TST.2021.9010050","author":"Y Chen","year":"2021","unstructured":"Chen Y, Zhao F, Lu Y, Chen X (2021) Dynamic task offloading for mobile edge computing with hybrid energy supply. Tsinghua Sci Technol. https:\/\/doi.org\/10.26599\/TST.2021.9010050","journal-title":"Tsinghua Sci Technol"},{"issue":"4","key":"352_CR15","doi-asserted-by":"publisher","first-page":"2737","DOI":"10.1109\/TII.2019.2954944","volume":"16","author":"H Guo","year":"2020","unstructured":"Guo H, Liu J (2020) Uav-enhanced intelligent offloading for internet of things at the edge. IEEE Trans Ind Inform 16(4):2737\u20132746","journal-title":"IEEE Trans Ind Inform"},{"issue":"8","key":"352_CR16","doi-asserted-by":"publisher","first-page":"7443","DOI":"10.1109\/JIOT.2020.2987600","volume":"7","author":"B Shang","year":"2020","unstructured":"Shang B, Liu L (2020) Mobile-edge computing in the sky: Energy optimization for air\u2014ground integrated networks. IEEE Internet Things J 7(8):7443\u20137456","journal-title":"IEEE Internet Things J"},{"key":"352_CR17","doi-asserted-by":"publisher","first-page":"245","DOI":"10.1016\/j.comcom.2019.11.019","volume":"150","author":"Y Wu","year":"2020","unstructured":"Wu Y, Wu J, Chen L, Yan J, Luo Y (2020) Efficient task scheduling for servers with dynamic states in vehicular edge computing. Comput Commun 150:245\u2013253","journal-title":"Comput Commun"},{"issue":"2","key":"352_CR18","doi-asserted-by":"publisher","first-page":"2114","DOI":"10.1109\/TVT.2019.2960103","volume":"69","author":"J Zhang","year":"2020","unstructured":"Zhang J, Zhou L, Zhou F, Seet BC, Zhang H, Cai Z, Wei J (2020) Computation-efficient offloading and trajectory scheduling for multi-uav assisted mobile edge computing. IEEE Trans Veh Technol 69(2):2114\u20132125","journal-title":"IEEE Trans Veh Technol"},{"key":"352_CR19","doi-asserted-by":"publisher","DOI":"10.1016\/j.dcan.2022.03.003","author":"K Sadatdiynov","year":"2022","unstructured":"Sadatdiynov K, Cui L, Zhang L, Huang JZ, Salloum S, Mahmud MS (2022) A review of optimization methods for computation offloading in edge computing networks. Digit Commun Netw. https:\/\/doi.org\/10.1016\/j.dcan.2022.03.003","journal-title":"Digit Commun Netw"},{"key":"352_CR20","doi-asserted-by":"publisher","first-page":"507","DOI":"10.1109\/GreenTech48523.2021.00085","volume-title":"2021 IEEE Green Technologies Conference (GreenTech)","author":"L Ali","year":"2021","unstructured":"Ali L, Muyeen SM, Bizhani H, Simoes MG (2021) Game approach for sizing and cost minimization of a multi-microgrids using a multi-objective optimization. 2021 IEEE Green Technologies Conference (GreenTech). IEEE, Denver, pp 507\u2013512"},{"issue":"1","key":"352_CR21","doi-asserted-by":"publisher","first-page":"15","DOI":"10.1109\/TMC.2019.2892953","volume":"19","author":"B Cao","year":"2020","unstructured":"Cao B, Xia S, Han J, Li Y (2020) A distributed game methodology for crowdsensing in uncertain wireless scenario. IEEE Trans Mob Comput 19(1):15\u201328","journal-title":"IEEE Trans Mob Comput"},{"key":"352_CR22","first-page":"1","volume-title":"ICC 2021 - IEEE International Conference on Communications","author":"W Wang","year":"2021","unstructured":"Wang W, Lu B, Li Y, Wei W, Li J, Mumtaz S, Guizani M (2021) Task scheduling game optimization for mobile edge computing. ICC 2021 - IEEE International Conference on Communications. IEEE, Montreal, pp 1\u20136"},{"key":"352_CR23","doi-asserted-by":"publisher","first-page":"108146","DOI":"10.1016\/j.patcog.2021.108146","volume":"121","author":"S Wan","year":"2022","unstructured":"Wan S, Ding S, Chen C (2022) Edge computing enabled video segmentation for real-time traffic monitoring in internet of vehicles. Pattern Recog 121:108146","journal-title":"Pattern Recog"},{"key":"352_CR24","doi-asserted-by":"publisher","first-page":"28","DOI":"10.1186\/s13677-020-00175-w","volume":"9","author":"S Raza","year":"2020","unstructured":"Raza S, Liu W, Ahmed M, Anwar MR, Mirza MA, Sun Q, Wang S (2020) An efficient task offloading scheme in vehicular edge computing. J Cloud Comput 9:28","journal-title":"J Cloud Comput"},{"key":"352_CR25","first-page":"11","volume":"42","author":"Y Zhou","year":"2022","unstructured":"Zhou Y, GE H, Ma B, Zhang S, Huang J (2022) Collaborative task offloading and resource allocation with hybrid energy supply for uav-assisted multi-clouds. J Cloud Comput 42:11","journal-title":"J Cloud Comput"},{"key":"352_CR26","doi-asserted-by":"publisher","first-page":"308","DOI":"10.1109\/OJCS.2021.3100870","volume":"2","author":"R Chen","year":"2021","unstructured":"Chen R, Cui L, Wang M, Zhang Y, Yao K, Yang Y, Yao C (2021) Joint computation offloading, channel access and scheduling optimization in uav swarms: A game-theoretic learning approach. IEEE Open J Comput Soc 2:308\u2013320","journal-title":"IEEE Open J Comput Soc"},{"issue":"6","key":"352_CR27","doi-asserted-by":"publisher","first-page":"1040","DOI":"10.1109\/JSAC.2020.2986662","volume":"38","author":"Z Yan","year":"2020","unstructured":"Yan Z, Ge J, Wu Y, Li L, Li T (2020) Automatic virtual network embedding: A deep reinforcement learning approach with graph convolutional networks. IEEE J Sel Areas Commun 38(6):1040\u20131057","journal-title":"IEEE J Sel Areas Commun"},{"key":"352_CR28","doi-asserted-by":"publisher","DOI":"10.1002\/dac.5154","author":"Y Chen","year":"2022","unstructured":"Chen Y, Gu W, Li K (2022) Dynamic task offloading for internet of things in mobile edge computing via deep reinforcement learning. Int J Commun Syst. https:\/\/doi.org\/10.1002\/dac.5154","journal-title":"Int J Commun Syst"},{"key":"352_CR29","doi-asserted-by":"publisher","first-page":"29","DOI":"10.1016\/j.future.2022.09.007","volume":"139","author":"J Huang","year":"2023","unstructured":"Huang J, Gao H, Wan S et al (2023) Aoi-aware energy control and computation offloading for industrial iot. Futur Gener Comput Syst 139:29\u201337","journal-title":"Futur Gener Comput Syst"},{"key":"352_CR30","doi-asserted-by":"publisher","first-page":"341","DOI":"10.1109\/ICWS53863.2021.00052","volume-title":"2021 IEEE International Conference on Web Services (ICWS)","author":"Q Jiang","year":"2021","unstructured":"Jiang Q, Xu X, He Q, Zhang X, Dai F, Qi L, Dou W (2021) Game theory-based task offloading and resource allocation for vehicular networks in edge-cloud computing. 2021 IEEE International Conference on Web Services (ICWS). IEEE, Chicago, pp 341\u2013346. https:\/\/doi.org\/10.1109\/ICWS53863.2021.00052"},{"issue":"1","key":"352_CR31","doi-asserted-by":"publisher","first-page":"83","DOI":"10.23919\/JCN.2021.000041","volume":"24","author":"H Tran-Dang","year":"2022","unstructured":"Tran-Dang H, Bhardwaj S, Rahim T, Musaddiq A, Kim DS (2022) Reinforcement learning based resource management for fog computing environment: Literature review, challenges, and open issues. J Commun Netw 24(1):83\u201398","journal-title":"J Commun Netw"},{"issue":"5","key":"352_CR32","doi-asserted-by":"publisher","first-page":"5028","DOI":"10.1109\/TVT.2021.3075860","volume":"70","author":"Y Yuan","year":"2021","unstructured":"Yuan Y, Lei L, Vu TX, Chatzinotas S et al (2021) Energy minimization in uav-aided networks: Actor-critic learning for constrained scheduling optimization. IEEE Trans Veh Technol 70(5):5028\u20135042","journal-title":"IEEE Trans Veh Technol"},{"key":"352_CR33","doi-asserted-by":"publisher","DOI":"10.1002\/dac.5161","author":"J Huang","year":"2022","unstructured":"Huang J, Tong Z, Feng Z (2022) Geographical poi recommendation for internet of things: A federated learning approach using matrix factorization. Int J Commun Syst. https:\/\/doi.org\/10.1002\/dac.5161","journal-title":"Int J Commun Syst"},{"key":"352_CR34","doi-asserted-by":"crossref","unstructured":"Chen Y, Xing H, Ma Z, et\u00a0al. (2022) Cost-efficient edge caching for noma-enabled iot services. China Commun","DOI":"10.1155\/2022\/8072493"}],"container-title":["Journal of Cloud Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13677-022-00352-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s13677-022-00352-z\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13677-022-00352-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,11,10]],"date-time":"2022-11-10T15:09:39Z","timestamp":1668092979000},"score":1,"resource":{"primary":{"URL":"https:\/\/journalofcloudcomputing.springeropen.com\/articles\/10.1186\/s13677-022-00352-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,11,10]]},"references-count":34,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,12]]}},"alternative-id":["352"],"URL":"https:\/\/doi.org\/10.1186\/s13677-022-00352-z","relation":{},"ISSN":["2192-113X"],"issn-type":[{"value":"2192-113X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,11,10]]},"assertion":[{"value":"18 August 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 October 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 November 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"78"}}