{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,31]],"date-time":"2026-03-31T21:33:18Z","timestamp":1774992798739,"version":"3.50.1"},"reference-count":40,"publisher":"Association for Computing Machinery (ACM)","issue":"6","funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["62372344, No. 62171330, No. 62172438"],"award-info":[{"award-number":["62372344, No. 62171330, No. 62172438"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100012166","name":"National Key R&D Program of China","doi-asserted-by":"crossref","award":["2023YFB3308701"],"award-info":[{"award-number":["2023YFB3308701"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Key Research and Development Plan of Hubei Province","award":["2023BAB075"],"award-info":[{"award-number":["2023BAB075"]}]},{"name":"International Science and Technology Cooperation Project of Hubei Province","award":["2024EHA042"],"award-info":[{"award-number":["2024EHA042"]}]},{"name":"Wuhan Key RD Program Projects","award":["2024050702030091"],"award-info":[{"award-number":["2024050702030091"]}]},{"name":"Natural Science Foundation of Guangdong Province of China","award":["2024A1515011155"],"award-info":[{"award-number":["2024A1515011155"]}]},{"name":"Shenzhen Science and Technology Program","award":["JCYJ20220818103200002, JCYJ20240813114223031"],"award-info":[{"award-number":["JCYJ20220818103200002, JCYJ20240813114223031"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Sen. Netw."],"published-print":{"date-parts":[[2025,11,30]]},"abstract":"<jats:p>Vehicular edge computing (VEC) has emerged to address the increasing demands on wireless networks posed by massive data and diverse applications in intelligent vehicular services. However, challenges such as low spectrum utilization due to massive sensor deployment, signal degradation from high-speed mobility, and computational resource allocation issues hinder the real-time and secure operation of intelligent vehicles. Therefore, we propose a resource allocation optimization method for VEC based on Integrated Sensing and Communication (ISAC) and Orthogonal Time Frequency Space (OTFS) technologies. Specifically, OTFS is leveraged to multiplex roadside unit (RSU) radar resources, improving spectrum efficiency. We develop comprehensive models for communication, vehicle mobility, sensing, delay, energy consumption, and formulate a delay-minimization resource allocation problem. The problem is modeled as a Markov Decision Process and solved with an improved Twin Delayed Deep Deterministic Policy Gradient (TD3) algorithm, which incorporates prioritized experience sampling and dynamic parameter update to accelerate training and enhance agent-environment interaction. Extensive simulations are conducted in a VEC environment, where the proposed algorithm is compared with DDQN, MADDPG, and MRL-DDPG. The results demonstrate that our method effectively mitigates the impact of vehicle mobility on signal transmission and significantly reduces task completion delay compared with existing algorithms.<\/jats:p>","DOI":"10.1145\/3767332","type":"journal-article","created":{"date-parts":[[2025,9,13]],"date-time":"2025-09-13T07:23:08Z","timestamp":1757748188000},"page":"1-27","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["Improved TD3 Based Resource Allocation Optimization for Latency-sensitive Tasks in ISAC-aided VEC"],"prefix":"10.1145","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8338-6065","authenticated-orcid":false,"given":"Chunlin","family":"Li","sequence":"first","affiliation":[{"name":"Wuhan University of Technology","place":["Wuhan, China"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-6807-3191","authenticated-orcid":false,"given":"Shuai","family":"Zhang","sequence":"additional","affiliation":[{"name":"Wuhan University of Technology","place":["Wuhan, China"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-2476-1517","authenticated-orcid":false,"given":"Yaojuan","family":"Wu","sequence":"additional","affiliation":[{"name":"Wuhan University of Technology","place":["Wuhan, China"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-6304-4637","authenticated-orcid":false,"given":"Kun","family":"Jiang","sequence":"additional","affiliation":[{"name":"Wuhan University of Technology","place":["Wuhan, China"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-5582-563X","authenticated-orcid":false,"given":"Wenhao","family":"Wu","sequence":"additional","affiliation":[{"name":"Wuhan University of Technology","place":["Wuhan, China"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-8315-5554","authenticated-orcid":false,"given":"Shaochong","family":"Yuan","sequence":"additional","affiliation":[{"name":"Wuhan University of Technology","place":["Wuhan, China"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7013-9081","authenticated-orcid":false,"given":"Shaohua","family":"Wan","sequence":"additional","affiliation":[{"name":"Shenzhen Institute for Advanced Study, University of Electronic Science and Technology of China","place":["Shenzhen, China"]}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2025,10,18]]},"reference":[{"key":"e_1_3_1_2_2","doi-asserted-by":"publisher","DOI":"10.1109\/TITS.2025.3525735"},{"key":"e_1_3_1_3_2","doi-asserted-by":"publisher","DOI":"10.1109\/COMST.2020.2970550"},{"key":"e_1_3_1_4_2","doi-asserted-by":"publisher","DOI":"10.1145\/3725734"},{"key":"e_1_3_1_5_2","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2018.2812300"},{"key":"e_1_3_1_6_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11227-019-03011-4"},{"key":"e_1_3_1_7_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMC.2025.3573278"},{"key":"e_1_3_1_8_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIV.2022.3224057"},{"key":"e_1_3_1_9_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVT.2023.3327073"},{"key":"e_1_3_1_10_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICC45041.2023.10279392"},{"key":"e_1_3_1_11_2","article-title":"Deep reinforcement learning-based resource allocation with enhanced perception and low-latency for autonomous driving in ISAC-aided VEC","volume":"30","author":"Li Chunlin","year":"2025","unstructured":"Chunlin Li, Long Chai, Yong Zhang, Mengjie Yang, Ruidong Zhao, and Shaohua Wan. 2025. Deep reinforcement learning-based resource allocation with enhanced perception and low-latency for autonomous driving in ISAC-aided VEC. ACM Transactions on Design Automation of Electronic Systems 30, 3 (2025), 49:1\u201349:34.","journal-title":"ACM Transactions on Design Automation of Electronic Systems"},{"key":"e_1_3_1_12_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVT.2023.3327073"},{"key":"e_1_3_1_13_2","doi-asserted-by":"publisher","DOI":"10.1109\/TGCN.2023.3234263"},{"key":"e_1_3_1_14_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICC51166.2024.10622875"},{"key":"e_1_3_1_15_2","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2024.3432728"},{"key":"e_1_3_1_16_2","volume-title":"2023 14th International Conference on Information and Communication Technology Convergence (ICTC), 1042\u20131044","author":"Orikumhi Igbafe","year":"2023","unstructured":"Igbafe Orikumhi, Jungsook Bae, and Sunwoo Kim. 2023. Mobility-aware resource allocation in UAV-assisted ISAC networks. In 2023 14th International Conference on Information and Communication Technology Convergence (ICTC), 1042\u20131044."},{"key":"e_1_3_1_17_2","volume-title":"ICC 2023 - IEEE International Conference on Communications, 416\u2013421","author":"Bansal Nishu","year":"2023","unstructured":"Nishu Bansal, Shilpi Mittal, Rasmeet S. Bali, Neeraj Kumar, Joel Rodrigues, and Liang Zhao. 2023. Federated learning based task orchestration scheme using intelligent vehicular edge networks. In ICC 2023 - IEEE International Conference on Communications, 416\u2013421."},{"key":"e_1_3_1_18_2","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2021.3111838"},{"key":"e_1_3_1_19_2","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2024.3387072"},{"key":"e_1_3_1_20_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVT.2023.3271613"},{"key":"e_1_3_1_21_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVT.2024.3370196"},{"key":"e_1_3_1_22_2","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2024.3469547"},{"key":"e_1_3_1_23_2","volume-title":"2023 IEEE International Conference on Smart Internet of Things (SmartIoT), 104\u2013110","author":"Liao Jiaxuan","year":"2023","unstructured":"Jiaxuan Liao, Xin Chen, Libo Jiao, and Yijie Wang. 2023. Priority-aware task offloading in UAV-assisted vehicular network via deep reinforcement learning. In 2023 IEEE International Conference on Smart Internet of Things (SmartIoT), 104\u2013110."},{"key":"e_1_3_1_24_2","volume-title":"2021 15th International Conference on Signal Processing and Communication Systems (ICSPCS), 1\u20136.","author":"Ren Huarong","year":"2021","unstructured":"Huarong Ren, Weikai Xu, and Lin Wang. 2021. Orthogonal time-frequency space with improved index modulation. In 2021 15th International Conference on Signal Processing and Communication Systems (ICSPCS), 1\u20136."},{"key":"e_1_3_1_25_2","doi-asserted-by":"publisher","DOI":"10.1109\/JSAC.2022.3156632"},{"key":"e_1_3_1_26_2","doi-asserted-by":"publisher","DOI":"10.1109\/TWC.2018.2860011"},{"key":"e_1_3_1_27_2","volume-title":"Cambridge University Press","author":"Wireless Communications\u201d Goldsmith A.","year":"2005","unstructured":"Goldsmith A. \u201dWireless Communications\u201d. Cambridge University Press, 2005."},{"key":"e_1_3_1_28_2","doi-asserted-by":"crossref","first-page":"2897","DOI":"10.1109\/TSC.2021.3064579","article-title":"Minimizing the delay and cost of computation offloading for vehicular edge computing","volume":"15","author":"Luo Quyuan","year":"2022","unstructured":"Quyuan Luo, Changle Li, Tom H. Luan, and Weisong Shi. 2022. Minimizing the delay and cost of computation offloading for vehicular edge computing. IEEE Transactions on Services Computing 15, 5 (2022), 2897\u20132909.","journal-title":"IEEE Transactions on Services Computing"},{"key":"e_1_3_1_29_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVT.2018.2883156"},{"key":"e_1_3_1_30_2","doi-asserted-by":"publisher","DOI":"10.1109\/JSAC.2022.3180803"},{"key":"e_1_3_1_31_2","doi-asserted-by":"publisher","DOI":"10.1109\/TWC.2020.3015735"},{"key":"e_1_3_1_32_2","first-page":"465","volume":"37","author":"Sengijpta S. K.","year":"1994","unstructured":"S. K. Sengijpta. 1994. \u201dFundamentals of statistical signal processing: Estimation theory,\u201d Control Engineering Practice 37, 4 (1994), 465\u2013466.","journal-title":"Control Engineering Practice"},{"key":"e_1_3_1_33_2","doi-asserted-by":"publisher","DOI":"10.1109\/TII.2022.3168292"},{"key":"e_1_3_1_34_2","doi-asserted-by":"crossref","first-page":"e32167","DOI":"10.1016\/j.heliyon.2024.e32167","article-title":"Path planning of mobile robot based on improved TD3 algorithm in dynamic environment","volume":"10","author":"Li Peng","year":"2024","unstructured":"Peng Li, Donghui Chen, Yuchen Wang, Lanyong Zhang, and Shiquan Zhao. 2024. Path planning of mobile robot based on improved TD3 algorithm in dynamic environment. Heliyon 10, 11 (2024), e32167.","journal-title":"Heliyon"},{"key":"e_1_3_1_35_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCCN.2021.3116251"},{"key":"e_1_3_1_36_2","volume-title":"2022 14th International Conference on Wireless Communications and Signal Processing (WCSP), 556\u2013561","author":"Fan Qingrui","year":"2022","unstructured":"Qingrui Fan, Yu Zhang, Zhaoye Wang, Jiamin Li, Pengcheng Zhu, and Dongming Wang. 2022. MADDPG-Based power allocation algorithm for network-assisted full-duplex cell-free mmwave massive MIMO systems with DAC quantization. In 2022 14th International Conference on Wireless Communications and Signal Processing (WCSP), 556\u2013561."},{"key":"e_1_3_1_37_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVT.2021.3098854"},{"key":"e_1_3_1_38_2","volume-title":"2023 IEEE 24th International Workshop on Signal Processing Advances in Wireless Communications (SPAWC), 646\u2013650","author":"Zhang Xiaoqi","year":"2023","unstructured":"Xiaoqi Zhang, Weijie Yuan, Chang Liu, Jun Wu, and Zhongjie Li. 2023. Deep learning-based Cram\u00e9r-rao bound optimization for integrated sensing and communication in vehicular networks. In 2023 IEEE 24th International Workshop on Signal Processing Advances in Wireless Communications (SPAWC), 646\u2013650."},{"key":"e_1_3_1_39_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVT.2022.3228583"},{"key":"e_1_3_1_40_2","volume-title":"International Conference on Machine Learning (ICML","author":"Fujimoto Scott","year":"2018","unstructured":"Scott Fujimoto, Herke van Hoof, and David Meger. 2018. Addressing function approximation error in actor-critic methods. In International Conference on Machine Learning (ICML 2018). https:\/\/api.semanticscholar.org\/CorpusID:3544558"},{"key":"e_1_3_1_41_2","doi-asserted-by":"publisher","DOI":"10.1109\/SAM53842.2022.9827830"}],"container-title":["ACM Transactions on Sensor Networks"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3767332","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,18]],"date-time":"2025-10-18T11:11:42Z","timestamp":1760785902000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3767332"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,10,18]]},"references-count":40,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2025,11,30]]}},"alternative-id":["10.1145\/3767332"],"URL":"https:\/\/doi.org\/10.1145\/3767332","relation":{},"ISSN":["1550-4859","1550-4867"],"issn-type":[{"value":"1550-4859","type":"print"},{"value":"1550-4867","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,10,18]]},"assertion":[{"value":"2025-01-08","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-09-01","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-10-18","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}