{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,10]],"date-time":"2026-04-10T16:11:30Z","timestamp":1775837490160,"version":"3.50.1"},"reference-count":54,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2023,1,12]],"date-time":"2023-01-12T00:00:00Z","timestamp":1673481600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Beijing Nova Program of Science and Technology","award":["Z191100001119094"],"award-info":[{"award-number":["Z191100001119094"]}]},{"name":"Beijing Nova Program of Science and Technology","award":["040000514122607"],"award-info":[{"award-number":["040000514122607"]}]},{"name":"Beijing Nova Program of Science and Technology","award":["L202016"],"award-info":[{"award-number":["L202016"]}]},{"name":"Urban Carbon Neutral Science and Technology Innovation Fund Project of Beijing University of Technology","award":["Z191100001119094"],"award-info":[{"award-number":["Z191100001119094"]}]},{"name":"Urban Carbon Neutral Science and Technology Innovation Fund Project of Beijing University of Technology","award":["040000514122607"],"award-info":[{"award-number":["040000514122607"]}]},{"name":"Urban Carbon Neutral Science and Technology Innovation Fund Project of Beijing University of Technology","award":["L202016"],"award-info":[{"award-number":["L202016"]}]},{"name":"Beijing Natural Science Foundation","award":["Z191100001119094"],"award-info":[{"award-number":["Z191100001119094"]}]},{"name":"Beijing Natural Science Foundation","award":["040000514122607"],"award-info":[{"award-number":["040000514122607"]}]},{"name":"Beijing Natural Science Foundation","award":["L202016"],"award-info":[{"award-number":["L202016"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"<jats:p>With the emergence of intelligent terminals, the Internet of Vehicles (IoV) has been drawing great attention by taking advantage of mobile communication technologies. However, high computation complexity, collaboration communication overhead and limited network bandwidths bring severe challenges to the provision of latency-sensitive IoV services. To overcome these problems, we design a cloud-edge cooperative content-delivery strategy in asymmetrical IoV environments to minimize network latency by providing optimal computing, caching and communication resource allocation. We abstract the joint allocation issue of heterogeneous resources as a queuing theory-based latency minimization objective. Next, a new deep reinforcement learning (DRL) scheme works in each network node to achieve optimal content caching and request routing on the basis of the perceptive request history and network state. Extensive simulations show that our proposed strategy has lower network latency compared with the current solutions in the cloud-edge collaboration system and converges fast under different scenarios.<\/jats:p>","DOI":"10.3390\/sym15010217","type":"journal-article","created":{"date-parts":[[2023,1,12]],"date-time":"2023-01-12T04:29:38Z","timestamp":1673497778000},"page":"217","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":36,"title":["Deep Reinforcement Learning-Based Resource Allocation for Content Distribution in IoT-Edge-Cloud Computing Environments"],"prefix":"10.3390","volume":"15","author":[{"given":"Tongke","family":"Cui","sequence":"first","affiliation":[{"name":"College of Information and Communication, National University of Defense Technology, Changsha 410073, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ruopeng","family":"Yang","sequence":"additional","affiliation":[{"name":"College of Information and Communication, National University of Defense Technology, Changsha 410073, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3989-3964","authenticated-orcid":false,"given":"Chao","family":"Fang","sequence":"additional","affiliation":[{"name":"Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shui","family":"Yu","sequence":"additional","affiliation":[{"name":"School of Computer Science, University of Technology Sydney, Sydney, NSW 2007, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,1,12]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1777","DOI":"10.1109\/TITS.2020.2994972","article-title":"Internet of Vehicles: Key Technologies, Network Model, Solutions and Challenges With Future Aspects","volume":"22","author":"Qureshi","year":"2021","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Li, X., Zheng, Y., Alshehri, M.D., Hai, L., Balasubramanian, V., Zeng, M., and Nie, G. (2021). Cognitive AmBC-NOMA IoV-MTS Networks With IQI: Reliability and Security Analysis. IEEE Trans. Intell. Transp. Syst., 1\u201312.","DOI":"10.1109\/TITS.2021.3113995"},{"key":"ref_3","first-page":"100164","article-title":"A tutorial survey on vehicular communication state of the art, and future research directions","volume":"18","author":"Singh","year":"2019","journal-title":"Veh. Commun."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"657","DOI":"10.1109\/COMST.2016.2611524","article-title":"A Comparative Survey of VANET Clustering Techniques","volume":"19","author":"Cooper","year":"2017","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1605734","DOI":"10.1155\/2016\/1605734","article-title":"Road-aware routing strategies for vehicular ad hoc networks: Characteristics and comparisons","volume":"12","author":"Qureshi","year":"2016","journal-title":"Int. J. Distrib. Sens. Netw."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"7637","DOI":"10.1109\/TVT.2021.3087399","article-title":"Artificial Noise Assisted Secure Mobile Crowd Computing in Intelligently Connected Vehicular Networks","volume":"70","author":"Luo","year":"2021","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"4738","DOI":"10.1109\/TWC.2019.2928539","article-title":"UAV-Assisted Relaying and Edge Computing: Scheduling and Trajectory Optimization","volume":"18","author":"Hu","year":"2019","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1117","DOI":"10.1109\/JSAC.2019.2906789","article-title":"Space\/Aerial-Assisted Computing Offloading for IoT Applications: A Learning-Based Approach","volume":"37","author":"Cheng","year":"2019","journal-title":"IEEE J. Sel. Areas Commun."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"3555","DOI":"10.1109\/TWC.2021.3051772","article-title":"Physical Layer Security Assisted Computation Offloading in Intelligently Connected Vehicle Networks","volume":"20","author":"Liu","year":"2021","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Cao, Y., and Chen, Y. (2017, January 10\u201313). QoE-based node selection strategy for edge computing enabled Internet-of-Vehicles (EC-IoV). Proceedings of the 2017 IEEE Visual Communications and Image Processing (VCIP), St. Petersburg, FL, USA.","DOI":"10.1109\/VCIP.2017.8305121"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"2461","DOI":"10.1109\/COMST.2015.2440374","article-title":"TDMA-Based MAC Protocols for Vehicular Ad Hoc Networks: A Survey, Qualitative Analysis, and Open Research Issues","volume":"17","author":"Hadded","year":"2015","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Das, T., Chen, L., Kundu, R., Bakshi, A., Sinha, P., Srinivasan, K., Bansal, G., and Shimizu, T. (2018, January 10\u201315). CoReCast: Collision resilient broadcasting in vehicular networks. Proceedings of the 16th Annual International Conference on Mobile Systems, Applications, and Services, Munich, Germany.","DOI":"10.1145\/3210240.3210341"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"2378","DOI":"10.1109\/COMST.2020.3005361","article-title":"Caching in Vehicular Named Data Networking: Architecture, Schemes and Future Directions","volume":"22","author":"Chen","year":"2020","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"An, K., Yan, X., Liang, T., and Lu, W. (2019, January 16\u201319). Mobility Prediction Based Vehicular Edge Caching: A Deep Reinforcement Learning Based Approach. Proceedings of the 2019 IEEE 19th International Conference on Communication Technology (ICCT), Xi\u2019an, China.","DOI":"10.1109\/ICCT46805.2019.8947024"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"270","DOI":"10.26599\/TST.2020.9010025","article-title":"Artificial intelligence for edge service optimization in Internet of Vehicles: A survey","volume":"27","author":"Xu","year":"2022","journal-title":"Tsinghua Sci. Technol."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Zhou, J., Wu, F., Zhang, K., Mao, Y., and Leng, S. (2018, January 10\u201320). Joint optimization of Offloading and Resource Allocation in Vehicular Networks with Mobile Edge Computing. Proceedings of the 2018 tenth International Conference on Wireless Communications and Signal Processing (WCSP), Hangzhou, China.","DOI":"10.1109\/WCSP.2018.8555636"},{"key":"ref_17","first-page":"100182","article-title":"A survey on internet of vehicles: Applications, security issues & solutions","volume":"20","author":"Sharma","year":"2019","journal-title":"Veh. Commun."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"2253","DOI":"10.1109\/TC.2014.2366735","article-title":"Multi-User Computation Partitioning for Latency Sensitive Mobile Cloud Applications","volume":"64","author":"Yang","year":"2015","journal-title":"IEEE Trans. Comput."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Zhang, M., Wo, T., Lin, X., Yang, R., and Xu, J. (2018, January 26\u201329). A Scalable lnternet-of-Vehicles Service over Joint Clouds. Proceedings of the 2018 IEEE Symposium on Service-Oriented System Engineering (SOSE), Bamberg, Germany.","DOI":"10.1109\/SOSE.2018.00035"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Chaqfeh, M., Mohamed, N., Jawhar, I., and Wu, J. (2016, January 19\u201321). Vehicular Cloud data collection for Intelligent Transportation Systems. Proceedings of the 2016 third Smart Cloud Networks Systems (SCNS), Dubai, United Arab Emirates.","DOI":"10.1109\/SCNS.2016.7870555"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"2353","DOI":"10.1109\/COMST.2018.2809670","article-title":"A Survey of Mobile Information-Centric Networking: Research Issues and Challenges","volume":"20","author":"Fang","year":"2018","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1109\/MCOM.2019.1800769","article-title":"Data-Driven Intelligent Future Network: Architecture, Use Cases, and Challenges","volume":"57","author":"Fang","year":"2019","journal-title":"IEEE Commun. Mag."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"5198","DOI":"10.1109\/TITS.2021.3052355","article-title":"Towards Hit-Interruption Tradeoff in Vehicular Edge Caching: Algorithm and Analysis","volume":"23","author":"Zhang","year":"2021","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"2795","DOI":"10.1109\/TNET.2015.2487344","article-title":"Efficient Multi-User Computation Offloading for Mobile-Edge Cloud Computing","volume":"24","author":"Chen","year":"2016","journal-title":"IEEE\/ACM Trans. Netw."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"2262","DOI":"10.1109\/TITS.2020.3035841","article-title":"DRLE: Decentralized Reinforcement Learning at the Edge for Traffic Light Control in the IoV","volume":"22","author":"Zhou","year":"2021","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"4192","DOI":"10.1109\/TVT.2019.2894437","article-title":"Knowledge-Driven Service Offloading Decision for Vehicular Edge Computing: A Deep Reinforcement Learning Approach","volume":"68","author":"Qi","year":"2019","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"228","DOI":"10.1109\/TC.2020.2987567","article-title":"A3C-DO: A Regional Resource Scheduling Framework Based on Deep Reinforcement Learning in Edge Scenario","volume":"70","author":"Zou","year":"2021","journal-title":"IEEE Trans. Comput."},{"key":"ref_28","first-page":"4268","article-title":"Mobile-Edge Computing: Partial Computation Offloading Using Dynamic Voltage Scaling","volume":"64","author":"Wang","year":"2016","journal-title":"IEEE Trans. Commun."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1397","DOI":"10.1109\/TWC.2016.2633522","article-title":"Energy-Efficient Resource Allocation for Mobile-Edge Computation Offloading","volume":"16","author":"You","year":"2017","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"250","DOI":"10.1109\/TGCN.2018.2885443","article-title":"Centralized and Distributed Architectures for Energy and Delay Efficient Fog Network-Based Edge Computing Services","volume":"3","author":"Bozorgchenani","year":"2019","journal-title":"IEEE Trans. Green Commun. Netw."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"5031","DOI":"10.1109\/TVT.2019.2904244","article-title":"Collaborative cloud and edge computing for latency minimization","volume":"68","author":"Ren","year":"2019","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"271","DOI":"10.23919\/JCC.2021.02.019","article-title":"Proactive load balancing mechanism for fog computing supported by parked vehicles in IoV-SDN","volume":"18","author":"Kadhim","year":"2021","journal-title":"China Commun."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"8108","DOI":"10.1109\/TVT.2021.3091458","article-title":"Joint Task Partitioning and User Association for Latency Minimization in Mobile Edge Computing Networks","volume":"70","author":"Feng","year":"2021","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Shen, B., Xu, X., Dai, F., Qi, L., Zhang, X., and Dou, W. (2020, January 19\u201323). Dynamic Task Offloading with Minority Game for Internet of Vehicles in Cloud-Edge Computing. Proceedings of the 2020 IEEE International Conference on Web Services (ICWS), Beijing, China.","DOI":"10.1109\/ICWS49710.2020.00055"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"4706","DOI":"10.1109\/TITS.2021.3071328","article-title":"Optimal Distribution of Workloads in Cloud-Fog Architecture in Intelligent Vehicular Networks","volume":"22","author":"Abbasi","year":"2021","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Li, Y., and Xu, S. (2021, January 19\u201322). Collaborative optimization of Edge-Cloud Computation Offloading in Internet of Vehicles. Proceedings of the 2021 International Conference on Computer Communications and Networks (ICCCN), Online.","DOI":"10.1109\/ICCCN52240.2021.9522252"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"243","DOI":"10.23919\/ICN.2020.0020","article-title":"Deep reinforcement learning based computation offloading and resource allocation for low-latency fog radio access networks","volume":"1","author":"Rahman","year":"2020","journal-title":"Intell. Converg. Netw."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Dat Tuong, V., Phung Truong, T., Tran, A.T., Masood, A., Shumeye Lakew, D., Lee, C., Lee, Y., and Cho, S. (2020, January 21\u201323). Delay-Sensitive Task Offloading for Internet of Things in Nonorthogonal Multiple Access MEC Networks. Proceedings of the 2020 International Conference on Information and Communication Technology Convergence (ICTC), Jeju Island, Republic of Korea.","DOI":"10.1109\/ICTC49870.2020.9289406"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"2238","DOI":"10.1109\/JIOT.2020.3026589","article-title":"When Deep Reinforcement Learning Meets Federated Learning: Intelligent Multitimescale Resource Management for Multiaccess Edge Computing in 5G Ultradense Network","volume":"8","author":"Yu","year":"2021","journal-title":"IEEE Internet Things J."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"8148","DOI":"10.1109\/TVT.2021.3092346","article-title":"Blockchain-Based VEC Network Trust Management: A DRL Algorithm for Vehicular Service Offloading and Migration","volume":"70","author":"Ren","year":"2021","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Katsaros, K., Xylomenos, G., and Polyzos, G.C. (2010, January 14\u201319). MultiCache: An incrementally deployable overlay architecture for information-centric networking. Proceedings of the Proceedings IEEE INFOCOM\u201910, San Diego, CA, USA.","DOI":"10.1109\/INFCOMW.2010.5466639"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"625","DOI":"10.1109\/JSYST.2015.2454231","article-title":"Distributed Energy Consumption Management in Green Content-Centric Networks via Dual Decomposition","volume":"11","author":"Fang","year":"2017","journal-title":"IEEE Syst. J."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"4196","DOI":"10.1109\/TWC.2013.071613.122092","article-title":"Traffic-aware base station sleeping control and power matching for energy-delay tradeoffs in green cellular networks","volume":"12","author":"Wu","year":"2013","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"3657","DOI":"10.1109\/TVT.2015.2434381","article-title":"Base-station sleeping control and power matching for energy-delay tradeoffs with bursty traffic","volume":"65","author":"Wu","year":"2015","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"2432","DOI":"10.1109\/COMST.2017.2707140","article-title":"State-of-the-Art Deep Learning: Evolving Machine Intelligence Toward Tomorrow\u2019s Intelligent Network Traffic Control Systems","volume":"19","author":"Fadlullah","year":"2017","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1109\/MNET.2018.1800109","article-title":"Deep reinforcement learning for mobile edge caching: Review, new features, and open issues","volume":"32","author":"Zhu","year":"2018","journal-title":"IEEE Netw."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"1946","DOI":"10.1109\/TC.2017.2709742","article-title":"Routing or Computing? The Paradigm Shift Towards Intelligent Computer Network Packet Transmission Based on Deep Learning","volume":"66","author":"Mao","year":"2017","journal-title":"IEEE Trans. Comput."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"1658","DOI":"10.1109\/TVT.2021.3055511","article-title":"Multi-Agent Reinforcement Learning Based Distributed Transmission in Collaborative Cloud-Edge Systems","volume":"70","author":"Xu","year":"2021","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Breslau, L., Cao, P., Fan, L., Phillips, G., and Shenker, S. (1999). Web Caching and Zipf-Like Distributions: Evidence and Implications, IEEE.","DOI":"10.1109\/INFCOM.1999.749260"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Choi, N., Guan, K., Kilper, D.C., and Atkinson, G. (2012, January 10\u201315). In-network caching effect on optimal energy consumption in content-centric networking. Proceedings of the IEEE International Conference on Communications (ICC), Ottawa, ON, Canada.","DOI":"10.1109\/ICC.2012.6364320"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Xie, H., Shi, G., and Wang, P. (2012, January 25\u201330). TECC: Towards collaborative in-network caching guided by traffic engineering. Proceedings of the 2012 Proceedings IEEE INFOCOM, Orlando, FL, USA.","DOI":"10.1109\/INFCOM.2012.6195650"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"797","DOI":"10.1109\/LCOMM.2013.022213.122741","article-title":"Energy-efficient in-network caching for content-centric networking","volume":"17","author":"Li","year":"2013","journal-title":"IEEE Commun. Lett."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1109\/MCOM.2014.6736753","article-title":"Cache in the air: Exploiting content caching and delivery techniques for 5g systems","volume":"52","author":"Wang","year":"2014","journal-title":"IEEE Commun. Mag."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"2465","DOI":"10.1016\/j.comnet.2012.11.026","article-title":"Performance analysis of in-network caching for content-centric networking","volume":"57","author":"Kim","year":"2013","journal-title":"Comput. Netw."}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/15\/1\/217\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:04:07Z","timestamp":1760119447000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/15\/1\/217"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,12]]},"references-count":54,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,1]]}},"alternative-id":["sym15010217"],"URL":"https:\/\/doi.org\/10.3390\/sym15010217","relation":{},"ISSN":["2073-8994"],"issn-type":[{"value":"2073-8994","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,1,12]]}}}