{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,18]],"date-time":"2025-12-18T14:27:41Z","timestamp":1766068061378,"version":"3.41.0"},"reference-count":46,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2024,11,22]],"date-time":"2024-11-22T00:00:00Z","timestamp":1732233600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["62171330, 62372344, 62172438"],"award-info":[{"award-number":["62171330, 62372344, 62172438"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Key Research and Development Plan of Hubei Province","award":["2023BAB075"],"award-info":[{"award-number":["2023BAB075"]}]},{"name":"International Science and Technology Cooperation Project of Hubei Province","award":["2024EHA042"],"award-info":[{"award-number":["2024EHA042"]}]},{"name":"Wuhan Key RD Program Projects","award":["2024050702030091"],"award-info":[{"award-number":["2024050702030091"]}]},{"name":"Shenzhen Science and Technology Program","award":["JCYJ20220818103200002"],"award-info":[{"award-number":["JCYJ20220818103200002"]}]},{"name":"Natural Science Foundation of Guangdong Province of China","award":["2024A1515011155"],"award-info":[{"award-number":["2024A1515011155"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Sen. Netw."],"published-print":{"date-parts":[[2024,11,30]]},"abstract":"<jats:p>In vehicular edge computing, Unmanned Aerial Vehicles (UAVs) have become a feasible solution for addressing high deployment costs faced by base stations in congested roads during peak hours. However, UAVs cannot cache all requested content due to limited storage. Hence, we propose a content caching strategy based on user preference predictions. To address resource consumption and user privacy concerns during the training process, we propose a user preference prediction model based on hierarchical federated learning training. Specifically, we employ a hierarchical clustering approach to partition user vehicles and UAVs into multiple clusters and utilize hierarchical federated learning to train prediction models within each cluster. Furthermore, to tackle the joint optimization problem of content caching and bandwidth allocation, we propose I-MADDPG, an improved multi-agent deep deterministic policy gradient algorithm. It determines the next continuous action based on the reward value at the current moment and the average reward value in the iteration period as reference parameters. The experimental results demonstrate that the proposed algorithm has significantly enhanced training efficiency compared to the baselines. Additionally, it has improved cache hit rate and reduced content request delay through effective resource allocation.<\/jats:p>","DOI":"10.1145\/3701234","type":"journal-article","created":{"date-parts":[[2024,10,18]],"date-time":"2024-10-18T10:58:50Z","timestamp":1729249130000},"page":"1-32","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":4,"title":["DRL-based Content Caching Strategy With Efficient User Preference Predictions in UAV-assisted VEC"],"prefix":"10.1145","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8338-6065","authenticated-orcid":false,"given":"Chunlin","family":"Li","sequence":"first","affiliation":[{"name":"Wuhan University of Technology, Wuhan, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-5502-6258","authenticated-orcid":false,"given":"Yong","family":"Zhang","sequence":"additional","affiliation":[{"name":"Wuhan University of Technology, Wuhan, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-5905-3110","authenticated-orcid":false,"given":"Long","family":"Yu","sequence":"additional","affiliation":[{"name":"Wuhan University of Technology, Wuhan, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-6304-4637","authenticated-orcid":false,"given":"Kun","family":"Jiang","sequence":"additional","affiliation":[{"name":"Wuhan University of Technology, Wuhan, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-2313-0695","authenticated-orcid":false,"given":"Youlong","family":"Luo","sequence":"additional","affiliation":[{"name":"Wuhan University of Technology, Wuhan, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7013-9081","authenticated-orcid":false,"given":"Shaohua","family":"Wan","sequence":"additional","affiliation":[{"name":"Shenzhen Institute for Advanced Study, University of Electronic Science and Technology of China, Shenzhen, China"}]}],"member":"320","published-online":{"date-parts":[[2024,11,22]]},"reference":[{"volume-title":"Proceedings of the 2011 20th International Conference on Computer Communications and Networks (ICCCN \u201911)","author":"Amoroso Alessandro","key":"e_1_3_1_2_2","unstructured":"Alessandro Amoroso, Gianluca Marfia, Massimo Roccetti, and Claudio E. Palazzi. 2011. A simulative evaluation of V2V algorithms for road safety and in-car entertainment. In Proceedings of the 2011 20th International Conference on Computer Communications and Networks (ICCCN \u201911). 1\u20136."},{"key":"e_1_3_1_3_2","article-title":"A design methodology for energy-aware processing in unmanned aerial vehicles","volume":"27","author":"He Jingyu","year":"2021","unstructured":"Jingyu He, Yao Xiao, Corina Bogdan, Shahin Nazarian, and Paul Bogdan. 2021. A design methodology for energy-aware processing in unmanned aerial vehicles. ACM Transactions on Design Automation of Electronic Systems 27, 1 (2021), Article 4, 20 pages.","journal-title":"ACM Transactions on Design Automation of Electronic Systems"},{"key":"e_1_3_1_4_2","doi-asserted-by":"publisher","DOI":"10.1109\/TITS.2022.3224395"},{"key":"e_1_3_1_5_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCC.2023.3339394"},{"key":"e_1_3_1_6_2","doi-asserted-by":"publisher","DOI":"10.1145\/3695882"},{"key":"e_1_3_1_7_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVT.2023.3291174"},{"key":"e_1_3_1_8_2","doi-asserted-by":"publisher","DOI":"10.1109\/TNSM.2023.3332899"},{"key":"e_1_3_1_9_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVT.2023.3272648"},{"key":"e_1_3_1_10_2","doi-asserted-by":"publisher","DOI":"10.1145\/3447032"},{"key":"e_1_3_1_11_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCCN.2022.3204572"},{"key":"e_1_3_1_12_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVT.2020.2973705"},{"key":"e_1_3_1_13_2","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2021.3053283"},{"key":"e_1_3_1_14_2","doi-asserted-by":"publisher","DOI":"10.1109\/TWC.2020.3010845"},{"key":"e_1_3_1_15_2","doi-asserted-by":"publisher","DOI":"10.1109\/TWC.2020.3022907"},{"key":"e_1_3_1_16_2","doi-asserted-by":"publisher","DOI":"10.1109\/TWC.2020.2992926"},{"key":"e_1_3_1_17_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPDS.2020.3012704"},{"key":"e_1_3_1_18_2","doi-asserted-by":"publisher","DOI":"10.1109\/TNSM.2022.3207994"},{"key":"e_1_3_1_19_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVT.2022.3179413"},{"key":"e_1_3_1_20_2","doi-asserted-by":"publisher","DOI":"10.1109\/MNET.011.2000663"},{"key":"e_1_3_1_21_2","doi-asserted-by":"publisher","DOI":"10.1109\/TWC.2021.3124586"},{"key":"e_1_3_1_22_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jpdc.2022.03.001"},{"key":"e_1_3_1_23_2","doi-asserted-by":"publisher","DOI":"10.23919\/ICN.2020.0014"},{"key":"e_1_3_1_24_2","doi-asserted-by":"publisher","DOI":"10.1109\/TNSM.2022.3198074"},{"key":"e_1_3_1_25_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMC.2023.3289611"},{"key":"e_1_3_1_26_2","doi-asserted-by":"publisher","DOI":"10.1145\/3687482"},{"key":"e_1_3_1_27_2","volume-title":"Proceedings of the 2020 IEEE Global Communications Conference (GLOBECOM \u201920)","author":"Zheng S.","year":"2020","unstructured":"S. Zheng, Z. Ren, X. Hou, and H. Zhang. 2020. Optimal communication-computing-caching for maximizing revenue in UAV-aided mobile edge computing. In Proceedings of the 2020 IEEE Global Communications Conference (GLOBECOM \u201920). IEEE, 2020, 1\u20136."},{"key":"e_1_3_1_28_2","doi-asserted-by":"publisher","DOI":"10.1109\/TNSE.2020.3016569"},{"key":"e_1_3_1_29_2","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2020.3015479"},{"key":"e_1_3_1_30_2","volume-title":"Retrieved","author":"MOSEK.","year":"2019","unstructured":"MOSEK. 2019. The MOSEK Optimization Software. Retrieved October 21, 2024 from http:\/\/www.mosek.com"},{"key":"e_1_3_1_31_2","doi-asserted-by":"publisher","DOI":"10.1109\/TWC.2019.2902559"},{"key":"e_1_3_1_32_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVT.2023.3253905"},{"key":"e_1_3_1_33_2","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2020.3000527"},{"volume-title":"Proceedings of the 2021 IEEE\/ACM 21st International Symposium on Cluster, Cloud, and Internet Computing (CCGrid \u201921)","author":"Dong C.","key":"e_1_3_1_34_2","unstructured":"C. Dong, F. Jiang, X. Li, A. Yao, G. Li, and X. Liu. 2021. A blockchain-aided self-sovereign identity framework for edge-based UAV delivery system. In Proceedings of the 2021 IEEE\/ACM 21st International Symposium on Cluster, Cloud, and Internet Computing (CCGrid \u201921). 622\u2013624."},{"key":"e_1_3_1_35_2","volume-title":"n.d. MovieLens 100k Dataset. Retrieved","author":"Group","year":"2024","unstructured":"GroupLens. n.d. MovieLens 100k Dataset. Retrieved October 21, 2024 from https:\/\/grouplens.org\/datasets\/movielens\/100k\/"},{"key":"e_1_3_1_36_2","doi-asserted-by":"publisher","DOI":"10.1109\/TWC.2021.3075278"},{"volume-title":"Proceedings of the 2018 16th International Symposium on Modeling and Optimization in Mobile, Ad Hoc, and Wireless Networks (WiOpt \u201918)","author":"Hasslinger G.","key":"e_1_3_1_37_2","unstructured":"G. Hasslinger, J. Heikkinen, K. Ntougias, F. Hasslinger, and O. Hohlfeld. 2018. Optimum caching versus LRU and LFU: Comparison and combined limited look-ahead strategies. In Proceedings of the 2018 16th International Symposium on Modeling and Optimization in Mobile, Ad Hoc, and Wireless Networks (WiOpt \u201918). IEEE, 1\u20136."},{"key":"e_1_3_1_38_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVT.2020.3004720"},{"key":"e_1_3_1_39_2","first-page":"55","article-title":"Trade-off between hit rate and hit latency for optimizing DRAM cache","volume":"9","author":"Chen P.","year":"2021","unstructured":"P. Chen, J. Yue, X. Liao, and H. Jin. 2021. Trade-off between hit rate and hit latency for optimizing DRAM cache. IEEE Transactions on Emerging Topics in Computing 9, 1 (2021), 55\u201364.","journal-title":"IEEE Transactions on Emerging Topics in Computing"},{"key":"e_1_3_1_40_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCOMM.2020.3044074"},{"key":"e_1_3_1_41_2","doi-asserted-by":"publisher","DOI":"10.1109\/MNET.011.2000558"},{"key":"e_1_3_1_42_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVT.2020.2973651"},{"key":"e_1_3_1_43_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2021.11.020"},{"key":"e_1_3_1_44_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCOMM.2023.3262306"},{"key":"e_1_3_1_45_2","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2021.3095677"},{"key":"e_1_3_1_46_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.comnet.2021.108710"},{"key":"e_1_3_1_47_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jnca.2024.103919"}],"container-title":["ACM Transactions on Sensor Networks"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3701234","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3701234","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T01:17:17Z","timestamp":1750295837000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3701234"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11,22]]},"references-count":46,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2024,11,30]]}},"alternative-id":["10.1145\/3701234"],"URL":"https:\/\/doi.org\/10.1145\/3701234","relation":{},"ISSN":["1550-4859","1550-4867"],"issn-type":[{"type":"print","value":"1550-4859"},{"type":"electronic","value":"1550-4867"}],"subject":[],"published":{"date-parts":[[2024,11,22]]},"assertion":[{"value":"2024-02-06","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-10-09","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-11-22","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}