{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,8]],"date-time":"2026-03-08T00:38:28Z","timestamp":1772930308722,"version":"3.50.1"},"reference-count":40,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2024,3,29]],"date-time":"2024-03-29T00:00:00Z","timestamp":1711670400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In Vehicular Edge Computing Network (VECN) scenarios, the mobility of vehicles causes the uncertainty of channel state information, which makes it difficult to guarantee the Quality of Service (QoS) in the process of computation offloading and the resource allocation of a Vehicular Edge Computing Server (VECS). A multi-user computation offloading and resource allocation optimization model and a computation offloading and resource allocation algorithm based on the Deep Deterministic Policy Gradient (DDPG) are proposed to address this problem. Firstly, the problem is modeled as a Mixed Integer Nonlinear Programming (MINLP) problem according to the optimization objective of minimizing the total system delay. Then, in response to the large state space and the coexistence of discrete and continuous variables in the action space, a reinforcement learning algorithm based on DDPG is proposed. Finally, the proposed method is used to solve the problem and compared with the other three benchmark schemes. Compared with the baseline algorithms, the proposed scheme can effectively select the task offloading mode and reasonably allocate VECS computing resources, ensure the QoS of task execution, and have a certain stability and scalability. Simulation results show that the total completion time of the proposed scheme can be reduced by 24\u201329% compared with the existing state-of-the-art techniques.<\/jats:p>","DOI":"10.3390\/s24072205","type":"journal-article","created":{"date-parts":[[2024,3,31]],"date-time":"2024-03-31T13:32:56Z","timestamp":1711891976000},"page":"2205","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Multi-User Computation Offloading and Resource Allocation Algorithm in a Vehicular Edge Network"],"prefix":"10.3390","volume":"24","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3618-3158","authenticated-orcid":false,"given":"Xiangyan","family":"Liu","sequence":"first","affiliation":[{"name":"School of Communications and Information Engineering, Chongqing University of Posts and Telecommunications, Chongqing 400065, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8384-3147","authenticated-orcid":false,"given":"Jianhong","family":"Zheng","sequence":"additional","affiliation":[{"name":"School of Communications and Information Engineering, Chongqing University of Posts and Telecommunications, Chongqing 400065, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2399-9254","authenticated-orcid":false,"given":"Meng","family":"Zhang","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Block Chain and Data Security, Zhejiang University, Hangzhou 310058, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9930-3233","authenticated-orcid":false,"given":"Yang","family":"Li","sequence":"additional","affiliation":[{"name":"Cyberspace Security Key Laboratory of Sichuan Province, Chengdu 610043, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2877-6834","authenticated-orcid":false,"given":"Rui","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Communications and Information Engineering, Chongqing University of Posts and Telecommunications, Chongqing 400065, China"},{"name":"Department of Electronic Communication Engineering, Yuxi Normal University, Yuxi 653100, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4864-377X","authenticated-orcid":false,"given":"Yun","family":"He","sequence":"additional","affiliation":[{"name":"School of Communications and Information Engineering, Chongqing University of Posts and Telecommunications, Chongqing 400065, China"}]}],"member":"1968","published-online":{"date-parts":[[2024,3,29]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Ren, Y., Yu, X., Chen, X., Guo, S., and Qiu, X.-S. (2020, January 15\u201319). Vehicular Network Edge Intelligent Management: A Deep Deterministic Policy Gradient Approach for Service Offloading Decision. Proceedings of the 2020 International Wireless Communications and Mobile Computing (IWCMC), Limassol, Cyprus.","DOI":"10.1109\/IWCMC48107.2020.9148507"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"19827","DOI":"10.1109\/TITS.2022.3161589","article-title":"SPAS: Smart Pothole-Avoidance Strategy for Autonomous Vehicles","volume":"23","author":"Raja","year":"2022","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Sohail, R., Saeed, Y., Ali, A., Alkanhel, R., Jamil, H., Muthanna, A., and Akbar, H. (2023). A Machine Learning-Based Intelligent Vehicular System (IVS) for Driver\u2019s Diabetes Monitoring in Vehicular Ad-Hoc Networks (VANETs). Appl. Sci., 13.","DOI":"10.3390\/app13053326"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Sohail, H., Hassan, M.u., Elmagzoub, M.A., Rajab, A., Rajab, K., Ahmed, A., Shaikh, A., Ali, A., and Jamil, H. (2023). BBSF: Blockchain-Based Secure Weather Forecasting Information through Routing Protocol in Vanet. Sensors, 23.","DOI":"10.3390\/s23115259"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Jamil, F., Cheikhrouhou, O., Jamil, H., Koubaa, A., Derhab, A., and Ferrag, M.A. (2021). PetroBlock: A Blockchain-Based Payment Mechanism for Fueling Smart Vehicles. Appl. Sci., 11.","DOI":"10.3390\/app11073055"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Dai, Y., Xu, D., and Zhang, K. (2019, January 16\u201319). Deep Reinforcement Learning for Edge Computing and Resource Allocation in 5G Beyond. Proceedings of the IEEE 19th International Conference on Communication Technology (ICCT), Xi\u2019an, China.","DOI":"10.1109\/ICCT46805.2019.8947146"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1109\/MWC.001.1900406","article-title":"QoE-Based Cooperative Task Offloading with Deep Reinforcement Learning in Mobile Edge Networks","volume":"27","author":"He","year":"2020","journal-title":"IEEE Wirel. Commun."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"He, X., Lu, H., Mao, Y., and Wang, K. (2020, January 7\u201311). QoE-driven Task Offloading with Deep Reinforcement Learning in Edge intelligent IoV. Proceedings of the IEEE Global Communications Conference (GLOBECOM), Taipei, Taiwan.","DOI":"10.1109\/GLOBECOM42002.2020.9348050"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"10500","DOI":"10.1109\/JIOT.2023.3327712","article-title":"Deep Reinforcement Learning-Based Computation Offloading and Power Allocation within Dynamic Platoon Network","volume":"11","author":"Wang","year":"2023","journal-title":"IEEE Internet Things J."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1049\/cmu2.12346","article-title":"RLbR: A reinforcement learning based V2V routing framework for offloading 5G cellular IoT","volume":"16","author":"Lu","year":"2022","journal-title":"IET Commun."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Geng, L., Zhao, H., Liu, H., Wang, Y., Feng, W., and Bai, L. (2021, January 26\u201328). Deep Reinforcement Learning-based Computation Offloading in Vehicular Networks. Proceedings of the 8th IEEE International Conference on Cyber Security and Cloud Computing (CSCloud)\/the 7th IEEE International Conference on Edge Computing and Scalable Cloud (EdgeCom), Washington, DC, USA.","DOI":"10.1109\/CSCloud-EdgeCom52276.2021.00044"},{"key":"ref_12","unstructured":"Sun, H., Ma, D., She, H., and Guo, Y. (June, January 28). EC-DDPG: DDPG-Based Task Offloading Framework of Internet of Vehicle for Mission Critical Applications. Proceedings of the IEEE International Conference on Communications Workshops (ICC Workshops), Rome, Italy."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Shan, Y., Liao, P., Wang, Z., and An, L. (2022, January 3\u20135). Partial Computation Offloading and Resource Allocation via Deep Deterministic Policy Gradient. Proceedings of the International Conference on Networking and Network Applications (NaNA), Urumqi, China.","DOI":"10.1109\/NaNA56854.2022.00070"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1186\/s13634-022-00876-1","article-title":"DQN-based mobile edge computing for smart Internet of vehicle","volume":"2022","author":"Zhang","year":"2022","journal-title":"EURASIP J. Adv. Signal Process"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1186\/s13634-022-00867-2","article-title":"Analytical offloading design for mobile edge computing-based smart internet of vehicle","volume":"2022","author":"Lu","year":"2022","journal-title":"EURASIP J. Adv. Signal Process"},{"key":"ref_16","first-page":"1","article-title":"A Multi-user Computation Offloading Optimization Model and Algorithm Based on Deep Reinforcement Learning","volume":"45","author":"Li","year":"2023","journal-title":"J. Electron. Inf. Technol."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"15501","DOI":"10.1109\/JIOT.2023.3264281","article-title":"A Deep-Reinforcement-Learning-Based Computation Offloading with Mobile Vehicles in Vehicular Edge Computing","volume":"10","author":"Lin","year":"2023","journal-title":"IEEE Internet Things J."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1016\/j.future.2020.07.051","article-title":"Intelligent dynamic service pricing strategy for multi-user vehicle-aided MEC networks","volume":"114","author":"Liao","year":"2021","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"9344","DOI":"10.1109\/JIOT.2021.3056396","article-title":"Parking Edge Computing: Parked-Vehicle-Assisted Task Offloading for Urban VANETs","volume":"8","author":"Ma","year":"2021","journal-title":"IEEE Internet Things J."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"102639","DOI":"10.1016\/j.adhoc.2021.102639","article-title":"A dynamic task offloading algorithm based on greedy matching in vehicle network","volume":"123","author":"Tian","year":"2021","journal-title":"Ad Hoc Netw."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"107790","DOI":"10.1016\/j.asoc.2021.107790","article-title":"Dependent tasks offloading based on particle swarm optimization algorithm in multi-access edge computing","volume":"112","author":"Ma","year":"2021","journal-title":"Appl. Soft Comput."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1186\/s13677-021-00232-y","article-title":"Adaptive offloading in mobile-edge computing for ultra-dense cellular networks based on genetic algorithm","volume":"10","author":"Liao","year":"2021","journal-title":"J. Cloud Comput."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"103109","DOI":"10.1016\/j.adhoc.2023.103109","article-title":"Genetic algorithm for delay efficient computation offloading in dispersed computing","volume":"142","author":"Liu","year":"2023","journal-title":"Ad Hoc Netw."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"668","DOI":"10.1109\/JSAC.2019.2894306","article-title":"Dynamic Task Offloading and Scheduling for Low-Latency IoT Services in Multi-Access Edge Computing","volume":"37","author":"Alameddine","year":"2019","journal-title":"IEEE J. Sel. Area Commun."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"102847","DOI":"10.1016\/j.sysarc.2023.102847","article-title":"Stackelberg game-based task offloading and pricing with computing capacity constraint in mobile edge computing","volume":"137","author":"Tong","year":"2023","journal-title":"J. Syst. Archit."},{"key":"ref_26","first-page":"1949","article-title":"Joint Computation Offloading and Resource Allocation for D2D-Assisted Mobile Edge Computing","volume":"16","author":"Jiang","year":"2023","journal-title":"IEEE Trans. Serv. Comput."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"4312","DOI":"10.1109\/TVT.2020.2973705","article-title":"Deep Reinforcement Learning and Permissioned Blockchain for Content Caching in Vehicular Edge Computing and Networks","volume":"69","author":"Dai","year":"2020","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Gueriani, A., Kheddar, H., and Mazari, A.C. (2023, January 28\u201329). Deep Reinforcement Learning for Intrusion Detection in IoT: A Survey. Proceedings of the 2023 2nd International Conference on Electronics, Energy and Measurement (IC2EM), Medea, Algeria.","DOI":"10.1109\/IC2EM59347.2023.10419560"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"446","DOI":"10.1109\/JSAC.2022.3227097","article-title":"User Scheduling and Task Offloading in Multi-Tier Computing 6G Vehicular Network","volume":"41","author":"Zhang","year":"2023","journal-title":"IEEE J. Sel. Area Commun."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"12991","DOI":"10.1109\/TITS.2022.3178759","article-title":"Dynamic Edge Computation Offloading for Internet of Vehicles with Deep Reinforcement Learning","volume":"24","author":"Yao","year":"2023","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"2252","DOI":"10.1109\/TITS.2020.3016002","article-title":"QoE-Based Task Offloading With Deep Reinforcement Learning in Edge-Enabled Internet of Vehicles","volume":"22","author":"He","year":"2021","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"8027","DOI":"10.1109\/TII.2022.3168292","article-title":"DRL-Based Resource Allocation for Computation Offloading in IoV Networks","volume":"18","author":"Hazarika","year":"2022","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"16918","DOI":"10.1038\/s41598-021-96284-w","article-title":"A novel D2D\u2013MEC method for enhanced computation capability in cellular networks","volume":"11","author":"Liu","year":"2021","journal-title":"Sci. Rep."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Liu, X., Zheng, J., Zhang, M., Li, Y., Wang, R., and He, Y. (2024). A Game-Based Computing Resource Allocation Scheme of Edge Server in Vehicular Edge Computing Networks Considering Diverse Task Offloading Modes. Sensors, 24.","DOI":"10.3390\/s24010069"},{"key":"ref_35","unstructured":"3GPP (2016). 3rd Generation Partnership Project; Technical Specification Group Radio Access Network, 3GPP. Study on LTE-based V2X Services (Release 14); Technical Report TR 36.885."},{"key":"ref_36","unstructured":"Sutton, R.S., and Barto, A.G. (2018). Reinforcement Learning: An Introduction, The MIT Press. [2nd ed.]."},{"key":"ref_37","first-page":"64","article-title":"Optimized communication resource allocation in vehicular networks based on multi-agent deep reinforcement learning","volume":"46","author":"Fang","year":"2022","journal-title":"J. Beijing Jiaotong Univ."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"101085","DOI":"10.1016\/j.iot.2024.101085","article-title":"A comprehensive review on development strategies of integrated electronic control units in IoEVs for energy management","volume":"25","author":"Naqvi","year":"2024","journal-title":"Internet Things"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Nasir, T., Raza, S., Abrar, M., Muqeet, H.A., Jamil, H., Qayyum, F., Cheikhrouhou, O., Alassery, F., and Hamam, H. (2021). Optimal Scheduling of Campus Microgrid Considering the Electric Vehicle Integration in Smart Grid. Sensors, 21.","DOI":"10.3390\/s21217133"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1007\/s40866-023-00190-1","article-title":"Analysis on the Driving and Braking Control Logic Algorithm for Mobility Energy Efficiency in Electric Vehicle","volume":"9","author":"Jamil","year":"2024","journal-title":"Smart Grids Energy"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/7\/2205\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T14:20:58Z","timestamp":1760106058000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/7\/2205"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,3,29]]},"references-count":40,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2024,4]]}},"alternative-id":["s24072205"],"URL":"https:\/\/doi.org\/10.3390\/s24072205","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,3,29]]}}}