{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,20]],"date-time":"2026-04-20T10:04:06Z","timestamp":1776679446633,"version":"3.51.2"},"reference-count":43,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2022,10,20]],"date-time":"2022-10-20T00:00:00Z","timestamp":1666224000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,10,20]],"date-time":"2022-10-20T00:00:00Z","timestamp":1666224000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"The Project of Scientific Research Fund Project of Yunnan Education Department","award":["2022Y561"],"award-info":[{"award-number":["2022Y561"]}]},{"DOI":"10.13039\/501100001809","name":"The Project of National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["62262063"],"award-info":[{"award-number":["62262063"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"The Project of Key Science Foundation of Yunnan Province","award":["202101AS070007"],"award-info":[{"award-number":["202101AS070007"]}]},{"name":"Dou Wanchun Expert Workstation of Yunnan Province","award":["202205AF150013"],"award-info":[{"award-number":["202205AF150013"]}]},{"name":"Science and Technology Youth lift talents of Yunnan Province"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Cloud Comp"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Vehicular edge computing (VEC) is emerging as a new computing paradigm to improve the quality of vehicular services and enhance the capabilities of vehicles. It enables performing tasks with low latency by deploying computing and storage resources close to vehicles. However, the traditional task offloading schemes only focus on one-shot offloading, taking less into consideration task dependency. Furthermore, the continuous action space problem during task offloading should be considered. In this paper, an efficient dependency-aware task offloading scheme for VEC with vehicle-edge-cloud collaborative computation is proposed, where subtasks can be processed locally or can be offloaded to an edge server, or a cloud server for execution. Specifically, first, the directed acyclic graph (DAG) is utilized to model the dependency of subtasks. Second, a task offloading algorithm based on Deep Deterministic Policy Gradient (DDPG) was proposed to obtain the optimal offloading strategy in a vehicle-edge-cloud environment, which efficiently solves the continuous control problem and helps reach fast convergence. Finally, extensive simulation experiments have been conducted, and the experimental results show that the proposed scheme can improve performance by about 13.62% on average against three baselines.<\/jats:p>","DOI":"10.1186\/s13677-022-00340-3","type":"journal-article","created":{"date-parts":[[2022,10,20]],"date-time":"2022-10-20T12:05:54Z","timestamp":1666267554000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":24,"title":["A collaborative computation and dependency-aware task offloading method for vehicular edge computing: a reinforcement learning approach"],"prefix":"10.1186","volume":"11","author":[{"given":"Guozhi","family":"Liu","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fei","family":"Dai","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bi","family":"Huang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhenping","family":"Qiang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shuai","family":"Wang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lecheng","family":"Li","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2022,10,20]]},"reference":[{"key":"340_CR1","doi-asserted-by":"publisher","first-page":"61020","DOI":"10.1109\/ACCESS.2020.2983609","volume":"8","author":"H Ji","year":"2020","unstructured":"Ji H, Alfarraj O, Tolba A (2020) Artificial intelligence-empowered edge of vehicles: architecture, enabling technologies, and applications. IEEE Access 8:61020\u201361034","journal-title":"IEEE Access"},{"issue":"6","key":"340_CR2","doi-asserted-by":"publisher","first-page":"4961","DOI":"10.1109\/JIOT.2020.2972041","volume":"7","author":"Y Liu","year":"2020","unstructured":"Liu Y, Wang S, Zhao Q, Du S, Zhou A, Ma X, Yang F (2020) Dependency-aware task scheduling in vehicular edge computing. IEEE Internet Things J 7(6):4961\u20134971","journal-title":"IEEE Internet Things J"},{"issue":"2","key":"340_CR3","doi-asserted-by":"publisher","first-page":"1414","DOI":"10.1109\/TII.2020.3040180","volume":"18","author":"X Xu","year":"2020","unstructured":"Xu X, Shen B, Ding S, Srivastava G, Bilal M, Khosravi MR, Menon VG, Jan MA, Wang M (2020) Service offloading with deep q-network for digital twinning-empowered internet of vehicles in edge computing. IEEE Trans Ind Inform 18(2):1414\u20131423","journal-title":"IEEE Trans Ind Inform"},{"issue":"4","key":"340_CR4","doi-asserted-by":"publisher","first-page":"1634","DOI":"10.1109\/TCC.2019.2923692","volume":"9","author":"Y Chen","year":"2019","unstructured":"Chen Y, Zhang N, Zhang Y, Chen X, Wu W, Shen XS (2019) Toffee: Task offloading and frequency scaling for energy efficiency of mobile devices in mobile edge computing. IEEE Trans Cloud Comput 9(4):1634\u20131644","journal-title":"IEEE Trans Cloud Comput"},{"issue":"9","key":"340_CR5","doi-asserted-by":"publisher","first-page":"2129","DOI":"10.1109\/TMC.2019.2922316","volume":"19","author":"Y Liu","year":"2019","unstructured":"Liu Y, Li Y, Niu Y, Jin D (2019) Joint optimization of path planning and resource allocation in mobile edge computing. IEEE Trans Mob Comput 19(9):2129\u20132144","journal-title":"IEEE Trans Mob Comput"},{"issue":"2","key":"340_CR6","doi-asserted-by":"publisher","first-page":"2092","DOI":"10.1109\/TVT.2019.2959410","volume":"69","author":"J Zhang","year":"2019","unstructured":"Zhang J, Guo H, Liu J, Zhang Y (2019) Task offloading in vehicular edge computing networks: A load-balancing solution. IEEE Trans Veh Technol 69(2):2092\u20132104","journal-title":"IEEE Trans Veh Technol"},{"key":"340_CR7","doi-asserted-by":"crossref","unstructured":"Chen Y, Zhao F, Chen X, Wu Y (2021) Efficient multi-vehicle task offloading for mobile edge computing in 6g networks. IEEE Trans Veh Technol","DOI":"10.1109\/TVT.2021.3133586"},{"key":"340_CR8","doi-asserted-by":"crossref","unstructured":"Nguyen D, Ding M, Pathirana P, Seneviratne A, Li J, Poor V (2021) Cooperative task offloading and block mining in blockchain-based edge computing with multi-agent deep reinforcement learning. IEEE Trans Mob Comput","DOI":"10.1109\/ICC42927.2021.9500648"},{"key":"340_CR9","doi-asserted-by":"crossref","unstructured":"Dai F, Liu G, Mo Q, Xu W, Huang B (2022) Task offloading for vehicular edge computing with edge-cloud cooperation. World Wide Web:1\u201319","DOI":"10.1007\/s11280-022-01064-9"},{"key":"340_CR10","doi-asserted-by":"crossref","unstructured":"Shakarami A, Ghobaei-Arani M, Shahidinejad A (2020a) A survey on the computation offloading approaches in mobile edge computing: A machine learning-based perspective. Comput Netw 182:107496","DOI":"10.1016\/j.comnet.2020.107496"},{"key":"340_CR11","doi-asserted-by":"crossref","unstructured":"Shakarami A, Ghobaei-Arani M, Masdari M, Hosseinzadeh M (2020b) A survey on the computation offloading approaches in mobile edge\/cloud computing environment: a stochastic-based perspective. J Grid Comput 18(4):639\u2013671","DOI":"10.1007\/s10723-020-09530-2"},{"key":"340_CR12","doi-asserted-by":"crossref","unstructured":"Shakarami A, Shahidinejad A, Ghobaei-Arani M (2020c) A review on the computation offloading approaches in mobile edge computing: A g ame-theoretic perspective. Softw Pract Experience 50(9):1719\u20131759","DOI":"10.1002\/spe.2839"},{"key":"340_CR13","doi-asserted-by":"publisher","DOI":"10.1016\/j.jnca.2021.102974","volume":"178","author":"A Shakarami","year":"2021","unstructured":"Shakarami A, Shahidinejad A, Ghobaei-Arani M (2021) An autonomous computation offloading strategy in mobile edge computing: A deep learning-based hybrid approach. J Netw Comput Appl 178:102974","journal-title":"J Netw Comput Appl"},{"issue":"6","key":"340_CR14","doi-asserted-by":"publisher","first-page":"3500","DOI":"10.1109\/TNET.2017.2748567","volume":"25","author":"Y Liu","year":"2017","unstructured":"Liu Y, Chen CS, Sung CW, Singh C (2017) A game theoretic distributed algorithm for feicic optimization in lte-a hetnets. IEEE\/ACM Trans Netw 25(6):3500\u20133513","journal-title":"IEEE\/ACM Trans Netw"},{"issue":"5","key":"340_CR15","doi-asserted-by":"publisher","first-page":"4514","DOI":"10.1109\/TVT.2018.2790421","volume":"67","author":"H Guo","year":"2018","unstructured":"Guo H, Liu J (2018) Collaborative computation offloading for multiaccess edge computing over fiber-wireless networks. IEEE Trans Veh Technol 67(5):4514\u20134526","journal-title":"IEEE Trans Veh Technol"},{"key":"340_CR16","doi-asserted-by":"crossref","unstructured":"Xu X, Jiang Q, Zhang P, Cao X, Khosravi MR, Alex LT, Qi L, Dou W (2022) Game theory for distributed iov task offloading with fuzzy neural network in edge computing. IEEE Trans Fuzzy Syst","DOI":"10.1109\/TFUZZ.2022.3158000"},{"key":"340_CR17","doi-asserted-by":"crossref","unstructured":"Aceto L, Morichetta A, Tiezzi F (2015) Decision support for mobile cloud computing applications via model checking. In: 2015 3rd IEEE International Conference on Mobile Cloud Computing, Services, and Engineering. IEEE, pp 199\u2013204","DOI":"10.1109\/MobileCloud.2015.21"},{"issue":"3","key":"340_CR18","doi-asserted-by":"publisher","first-page":"1678","DOI":"10.1109\/JIOT.2019.2943373","volume":"7","author":"C Shu","year":"2019","unstructured":"Shu C, Zhao Z, Han Y, Min G, Duan H (2019) Multi-user offloading for edge computing networks: A dependency-aware and latency-optimal approach. IEEE Internet Things J 7(3):1678\u20131689","journal-title":"IEEE Internet Things J"},{"key":"340_CR19","doi-asserted-by":"crossref","unstructured":"Yao L, Xu X, Bilal M, Wang H (2022) Dynamic edge computation offloading for internet of vehicles with deep reinforcement learning. IEEE Trans Intell Transp Syst","DOI":"10.1109\/TITS.2022.3178759"},{"issue":"4","key":"340_CR20","doi-asserted-by":"publisher","first-page":"2252","DOI":"10.1109\/TITS.2020.3016002","volume":"22","author":"X He","year":"2020","unstructured":"He X, Lu H, Du M, Mao Y, Wang K (2020) Qoe-based task offloading with deep reinforcement learning in edge-enabled internet of vehicles. IEEE Trans Intell Transp Syst 22(4):2252\u20132261","journal-title":"IEEE Trans Intell Transp Syst"},{"key":"340_CR21","doi-asserted-by":"publisher","first-page":"26652","DOI":"10.1109\/ACCESS.2019.2900530","volume":"7","author":"C Yang","year":"2019","unstructured":"Yang C, Liu Y, Chen X, Zhong W, Xie S (2019) Efficient mobility-aware task offloading for vehicular edge computing networks. IEEE Access 7:26652\u201326664","journal-title":"IEEE Access"},{"key":"340_CR22","doi-asserted-by":"crossref","unstructured":"Wang J, Hu J, Min G, Zhan W, Zomaya A, Georgalas N (2021) Dependent task offloading for edge computing based on deep reinforcement learning. IEEE Trans Comput","DOI":"10.1109\/TPDS.2020.3014896"},{"issue":"2","key":"340_CR23","doi-asserted-by":"publisher","first-page":"36","DOI":"10.1109\/MVT.2017.2668838","volume":"12","author":"K Zhang","year":"2017","unstructured":"Zhang K, Mao Y, Leng S, He Y, Zhang Y (2017) Mobile-edge computing for vehicular networks: A promising network paradigm with predictive off-loading. IEEE Veh Technol Mag 12(2):36\u201344","journal-title":"IEEE Veh Technol Mag"},{"key":"340_CR24","doi-asserted-by":"crossref","unstructured":"Ren Y, Yu X, Chen X, Guo S, Xue-Song Q (2020) Vehicular network edge intelligent management: A deep deterministic policy gradient approach for service offloading decision. In: 2020 International Wireless Communications and Mobile Computing (IWCMC). IEEE, pp 905\u2013910","DOI":"10.1109\/IWCMC48107.2020.9148507"},{"issue":"6","key":"340_CR25","doi-asserted-by":"publisher","first-page":"883","DOI":"10.1109\/TC.2020.2969148","volume":"69","author":"Y Zhan","year":"2020","unstructured":"Zhan Y, Guo S, Li P, Zhang J (2020) A deep reinforcement learning based offloading game in edge computing. IEEE Trans Comput 69(6):883\u2013893","journal-title":"IEEE Trans Comput"},{"issue":"3","key":"340_CR26","doi-asserted-by":"publisher","first-page":"1227","DOI":"10.1109\/TNET.2020.2979807","volume":"28","author":"Y Zhang","year":"2020","unstructured":"Zhang Y, Lan X, Ren J, Cai L (2020) Efficient computing resource sharing for mobile edge-cloud computing networks. IEEE\/ACM Trans Networking 28(3):1227\u20131240","journal-title":"IEEE\/ACM Trans Networking"},{"key":"340_CR27","doi-asserted-by":"crossref","unstructured":"Chen L, Wu J, Zhang J, Dai HN, Long X, Yao M (2020) Dependency-aware computation offloading for mobile edge computing with edge-cloud cooperation. IEEE Trans Cloud Comput","DOI":"10.1109\/TCC.2020.3037306"},{"key":"340_CR28","doi-asserted-by":"publisher","first-page":"115843","DOI":"10.1109\/ACCESS.2019.2936208","volume":"7","author":"Y Fan","year":"2019","unstructured":"Fan Y, Zhai L, Wang H (2019) Cost-efficient dependent task offloading for multiusers. IEEE Access 7:115843\u2013115856","journal-title":"IEEE Access"},{"key":"340_CR29","doi-asserted-by":"publisher","first-page":"134742","DOI":"10.1109\/ACCESS.2019.2942052","volume":"7","author":"S Pan","year":"2019","unstructured":"Pan S, Zhang Z, Zhang Z, Zeng D (2019) Dependency-aware computation offloading in mobile edge computing: A reinforcement learning approach. IEEE Access 7:134742\u2013134753","journal-title":"IEEE Access"},{"key":"340_CR30","doi-asserted-by":"crossref","unstructured":"Chen J, Yang Y, Wang C, Zhang H, Qiu C, Wang X (2021) Multi-task offloading strategy optimization based on directed acyclic graphs for edge computing. IEEE Internet Things J","DOI":"10.1109\/JIOT.2021.3110412"},{"issue":"3","key":"340_CR31","doi-asserted-by":"publisher","first-page":"3448","DOI":"10.1109\/TNSM.2021.3087258","volume":"18","author":"G Qu","year":"2021","unstructured":"Qu G, Wu H, Li R, Jiao P (2021) Dmro: A deep meta reinforcement learning-based task offloading framework for edge-cloud computing. IEEE Trans Netw Serv Manag 18(3):3448\u20133459","journal-title":"IEEE Trans Netw Serv Manag"},{"key":"340_CR32","doi-asserted-by":"publisher","DOI":"10.1016\/j.engappai.2022.104898","volume":"113","author":"TH Binh","year":"2022","unstructured":"Binh TH, Vo HK, Nguyen BM, Binh HTT, Yu S et al (2022) Value-based reinforcement learning approaches for task offloading in delay constrained vehicular edge computing. Eng Appl Artif Intell 113:104898","journal-title":"Eng Appl Artif Intell"},{"issue":"1","key":"340_CR33","doi-asserted-by":"publisher","first-page":"10","DOI":"10.1016\/j.dcan.2018.10.003","volume":"5","author":"L Huang","year":"2019","unstructured":"Huang L, Feng X, Zhang C, Qian L, Wu Y (2019) Deep reinforcement learning-based joint task offloading and bandwidth allocation for multi-user mobile edge computing. Digit Commun Netw 5(1):10\u201317","journal-title":"Digit Commun Netw"},{"issue":"12","key":"340_CR34","first-page":"2382","volume":"44","author":"X Xu","year":"2021","unstructured":"Xu X, Fang Z, Qi L, Dou W, He Q, Duan Y (2021) A deep reinforcement learning-based distributed service off loading method for edge computing empowered internet of vehicles. Chin J Comput 44(12):2382\u20132405","journal-title":"Chin J Comput"},{"key":"340_CR35","doi-asserted-by":"publisher","first-page":"184172","DOI":"10.1109\/ACCESS.2019.2960547","volume":"7","author":"X Chen","year":"2019","unstructured":"Chen X, Liu Z, Chen Y, Li Z (2019) Mobile edge computing based task offloading and resource allocation in 5g ultra-dense networks. IEEE Access 7:184172\u2013184182","journal-title":"IEEE Access"},{"issue":"4","key":"340_CR36","doi-asserted-by":"publisher","first-page":"2991","DOI":"10.1007\/s11276-021-02632-z","volume":"27","author":"Y Wang","year":"2021","unstructured":"Wang Y, Fang W, Ding Y, Xiong N (2021) Computation offloading optimization for uav-assisted mobile edge computing: a deep deterministic policy gradient approach. Wirel Netw 27(4):2991\u20133006","journal-title":"Wirel Netw"},{"issue":"4","key":"340_CR37","doi-asserted-by":"publisher","first-page":"1122","DOI":"10.1109\/TCCN.2020.3003036","volume":"6","author":"M Li","year":"2020","unstructured":"Li M, Gao J, Zhao L, Shen X (2020) Deep reinforcement learning for collaborative edge computing in vehicular networks. IEEE Trans Cogn Commun Netw 6(4):1122\u20131135","journal-title":"IEEE Trans Cogn Commun Netw"},{"issue":"3","key":"340_CR38","doi-asserted-by":"publisher","first-page":"1397","DOI":"10.1109\/TWC.2016.2633522","volume":"16","author":"C You","year":"2016","unstructured":"You C, Huang K, Chae H, Kim BH (2016) Energy-efficient resource allocation for mobile-edge computation offloading. IEEE Trans Wirel Commun 16(3):1397\u20131411","journal-title":"IEEE Trans Wirel Commun"},{"issue":"7540","key":"340_CR39","doi-asserted-by":"publisher","first-page":"529","DOI":"10.1038\/nature14236","volume":"518","author":"V Mnih","year":"2015","unstructured":"Mnih V, Kavukcuoglu K, Silver D, Rusu AA, Veness J, Bellemare MG, Graves A, Riedmiller M, Fidjeland AK, Ostrovski G et al (2015) Human-level control through deep reinforcement learning. Nature 518(7540):529\u2013533","journal-title":"Nature"},{"issue":"3","key":"340_CR40","doi-asserted-by":"publisher","first-page":"4005","DOI":"10.1109\/JIOT.2018.2876279","volume":"6","author":"X Chen","year":"2018","unstructured":"Chen X, Zhang H, Wu C, Mao S, Ji Y, Bennis M (2018) Optimized computation offloading performance in virtual edge computing systems via deep reinforcement learning. IEEE Internet Things J 6(3):4005\u20134018","journal-title":"IEEE Internet Things J"},{"issue":"11","key":"340_CR41","doi-asserted-by":"publisher","first-page":"2637","DOI":"10.1109\/JSAC.2017.2760160","volume":"35","author":"Y Sun","year":"2017","unstructured":"Sun Y, Zhou S, Xu J (2017) Emm: Energy-aware mobility management for mobile edge computing in ultra dense networks. IEEE J Sel Areas Commun 35(11):2637\u20132646","journal-title":"IEEE J Sel Areas Commun"},{"key":"340_CR42","doi-asserted-by":"publisher","first-page":"333","DOI":"10.1016\/j.future.2021.10.013","volume":"128","author":"F Song","year":"2022","unstructured":"Song F, Xing H, Wang X, Luo S, Dai P, Li K (2022) Offloading dependent tasks in multi-access edge computing: A multi-objective reinforcement learning approach. Futur Gener Comput Syst 128:333\u2013348","journal-title":"Futur Gener Comput Syst"},{"key":"340_CR43","doi-asserted-by":"publisher","first-page":"18797","DOI":"10.1109\/ACCESS.2020.2968595","volume":"8","author":"YH Xu","year":"2020","unstructured":"Xu YH, Yang CC, Hua M, Zhou W (2020) Deep deterministic policy gradient (ddpg)-based resource allocation scheme for noma vehicular communications. IEEE Access 8:18797\u201318807","journal-title":"IEEE Access"}],"container-title":["Journal of Cloud Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13677-022-00340-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s13677-022-00340-3\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13677-022-00340-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,10,20]],"date-time":"2022-10-20T12:14:59Z","timestamp":1666268099000},"score":1,"resource":{"primary":{"URL":"https:\/\/journalofcloudcomputing.springeropen.com\/articles\/10.1186\/s13677-022-00340-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,20]]},"references-count":43,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,12]]}},"alternative-id":["340"],"URL":"https:\/\/doi.org\/10.1186\/s13677-022-00340-3","relation":{},"ISSN":["2192-113X"],"issn-type":[{"value":"2192-113X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,10,20]]},"assertion":[{"value":"28 July 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"1 October 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 October 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The work is a novel work and has not been published elsewhere nor is it currently under review for publication elsewhere.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Informed consent was obtained from all individual participants included in the study.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"68"}}