{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,21]],"date-time":"2026-11-21T06:34:49Z","timestamp":1795242889615,"version":"4.10.3"},"reference-count":41,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2019,10,18]],"date-time":"2019-10-18T00:00:00Z","timestamp":1571356800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"State Key Laboratory of Integrated Services Networks, Xidian University","id":[{"id":"https:\/\/ror.org\/05s92vm98","id-type":"ROR","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["61572106 and 61971084"],"award-info":[{"award-number":["61572106 and 61971084"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100002858","name":"China Postdoctoral Science Foundation","doi-asserted-by":"crossref","award":["2018T110210"],"award-info":[{"award-number":["2018T110210"]}],"id":[{"id":"10.13039\/501100002858","id-type":"DOI","asserted-by":"crossref"}]},{"name":"State Key Laboratory for Novel Software Technology, Nanjing University","award":["KFKT2018B04"],"award-info":[{"award-number":["KFKT2018B04"]}]},{"DOI":"10.13039\/501100017683","name":"Dalian Science and Technology Innovation Fund","doi-asserted-by":"crossref","award":["2018J12GX048"],"award-info":[{"award-number":["2018J12GX048"]}],"id":[{"id":"10.13039\/501100017683","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of Chongqing","doi-asserted-by":"crossref","award":["cstc2019jcyj-msxmX0208"],"award-info":[{"award-number":["cstc2019jcyj-msxmX0208"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100003593","name":"Brazilian National Council for Research and Development","doi-asserted-by":"crossref","award":["309335\/2017-5"],"award-info":[{"award-number":["309335\/2017-5"]}],"id":[{"id":"10.13039\/501100003593","id-type":"DOI","asserted-by":"crossref"}]},{"name":"National Funding from the FCT\u2014Funda\u00e7\u00e3o para a Ci\u00eancia e a Tecnologia","award":["UID\/EEA\/50008\/2019 Project"],"award-info":[{"award-number":["UID\/EEA\/50008\/2019 Project"]}],"id":[{"id":"https:\/\/ror.org\/00snfqn58","id-type":"ROR","asserted-by":"crossref"}]},{"name":"RNP, with resources from MCTIC","award":["01250.075413\/2018-04"],"award-info":[{"award-number":["01250.075413\/2018-04"]}]},{"name":"Centro de Refer\u00eancia em Radiocomunica\u00e7\u00f5es\u2014CRR project of the Instituto Nacional de Telecomunica\u00e7\u00f5es (Inatel), Brazil","id":[{"id":"https:\/\/ror.org\/0378w3a30","id-type":"ROR","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Intell. Syst. Technol."],"published-print":{"date-parts":[[2019,11,30]]},"abstract":"<jats:p>The development of smart vehicles brings drivers and passengers a comfortable and safe environment. Various emerging applications are promising to enrich users\u2019 traveling experiences and daily life. However, how to execute computing-intensive applications on resource-constrained vehicles still faces huge challenges. In this article, we construct an intelligent offloading system for vehicular edge computing by leveraging deep reinforcement learning. First, both the communication and computation states are modelled by finite Markov chains. Moreover, the task scheduling and resource allocation strategy is formulated as a joint optimization problem to maximize users\u2019 Quality of Experience (QoE). Due to its complexity, the original problem is further divided into two sub-optimization problems. A two-sided matching scheme and a deep reinforcement learning approach are developed to schedule offloading requests and allocate network resources, respectively. Performance evaluations illustrate the effectiveness and superiority of our constructed system.<\/jats:p>","DOI":"10.1145\/3317572","type":"journal-article","created":{"date-parts":[[2019,10,18]],"date-time":"2019-10-18T08:58:45Z","timestamp":1571389125000},"page":"1-24","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":282,"title":["Deep Reinforcement Learning for Vehicular Edge Computing"],"prefix":"10.1145","volume":"10","author":[{"given":"Zhaolong","family":"Ning","sequence":"first","affiliation":[{"name":"Dalian University of Technology, Dalian, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1129-9218","authenticated-orcid":false,"given":"Peiran","family":"Dong","sequence":"additional","affiliation":[{"name":"Dalian University of Technology, Dalian, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaojie","family":"Wang","sequence":"additional","affiliation":[{"name":"Dalian University of Technology, Dalian, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Joel J. P. C.","family":"Rodrigues","sequence":"additional","affiliation":[{"name":"National Institute of Telecommunications (Inatel), Santa Rita do Sapuca\u00ed--MG, Brazil; Instituto de Telecomunica\u00e7\u00f5es, Portugal; Federal University of Piau\u00ed, Teresina--PI, Brazil"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8324-1859","authenticated-orcid":false,"given":"Feng","family":"Xia","sequence":"additional","affiliation":[{"name":"Dalian University of Technology, Dalian, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2019,10,18]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/3078847"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNET.2015.2487344"},{"key":"e_1_2_1_3_1","volume-title":"Proceedings of the IEEE International Conference on Communications (ICC\u201915)","author":"Deng Ruilong","unstructured":"Ruilong Deng , Rongxing Lu , Chengzhe Lai , and Tom H. Luan . 2015. Towards power consumption-delay tradeoff by workload allocation in cloud-fog computing . In Proceedings of the IEEE International Conference on Communications (ICC\u201915) . IEEE, 3909--3914. Ruilong Deng, Rongxing Lu, Chengzhe Lai, and Tom H. Luan. 2015. Towards power consumption-delay tradeoff by workload allocation in cloud-fog computing. In Proceedings of the IEEE International Conference on Communications (ICC\u201915). IEEE, 3909--3914."},{"key":"e_1_2_1_4_1","first-page":"1171","article-title":"Optimal workload allocation in fog-cloud computing toward balanced delay and power consumption","volume":"3","author":"Deng Ruilong","year":"2016","unstructured":"Ruilong Deng , Rongxing Lu , Chengzhe Lai , Tom H. Luan , and Hao Liang . 2016 . Optimal workload allocation in fog-cloud computing toward balanced delay and power consumption . IEEE Int. Things J. 3 , 6 (2016), 1171 -- 1181 . Ruilong Deng, Rongxing Lu, Chengzhe Lai, Tom H. Luan, and Hao Liang. 2016. Optimal workload allocation in fog-cloud computing toward balanced delay and power consumption. IEEE Int. Things J. 3, 6 (2016), 1171--1181.","journal-title":"IEEE Int. Things J."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSG.2013.2287494"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/JSAC.2017.2726018"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/TETC.2015.2508382"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSC.2016.2540629"},{"key":"e_1_2_1_9_1","article-title":"Trust-based social networks with computing, caching, and communications: A deep reinforcement learning approach","volume":"10","author":"He Ying","year":"2018","unstructured":"Ying He , Chengchao Liang , Richard Yu , and Zhu Han . 2018 . Trust-based social networks with computing, caching, and communications: A deep reinforcement learning approach . IEEE Trans. Netw. Sci. Eng. DOI : 10 .1109\/TNSE.2018.2865183 10.1109\/TNSE.2018.2865183 Ying He, Chengchao Liang, Richard Yu, and Zhu Han. 2018. Trust-based social networks with computing, caching, and communications: A deep reinforcement learning approach. IEEE Trans. Netw. Sci. Eng. DOI:10.1109\/TNSE.2018.2865183","journal-title":"IEEE Trans. Netw. Sci. Eng. DOI"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCOM.2017.1700246"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVT.2017.2760281"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/TC.2014.2360513"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2016.2522428"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVT.2017.2730230"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICC.2018.8422743"},{"key":"e_1_2_1_16_1","first-page":"865","article-title":"Traffic flow prediction with big data: A deep learning approach","volume":"16","author":"Lv Yisheng","year":"2015","unstructured":"Yisheng Lv , Yanjie Duan , Wenwen Kang , Zhengxi Li , Fei-Yue Wang 2015 . Traffic flow prediction with big data: A deep learning approach . IEEE Trans. Intell. Transport. Syst. 16 , 2 (2015), 865 -- 873 . Yisheng Lv, Yanjie Duan, Wenwen Kang, Zhengxi Li, Fei-Yue Wang et al. 2015. Traffic flow prediction with big data: A deep learning approach. IEEE Trans. Intell. Transport. Syst. 16, 2 (2015), 865--873.","journal-title":"IEEE Trans. Intell. Transport. Syst."},{"key":"e_1_2_1_17_1","volume-title":"Georg Ostrovski et al","author":"Mnih Volodymyr","year":"2015","unstructured":"Volodymyr Mnih , Koray Kavukcuoglu , David Silver , Andrei A. Rusu , Joel Veness , Marc G. Bellemare , Alex Graves , Martin Riedmiller , Andreas K. Fidjeland , Georg Ostrovski et al . 2015 . Human-level control through deep reinforcement learning. Nature 518, 7540 (2015), 529. Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Andrei A. Rusu, Joel Veness, Marc G. Bellemare, Alex Graves, Martin Riedmiller, Andreas K. Fidjeland, Georg Ostrovski et al. 2015. Human-level control through deep reinforcement learning. Nature 518, 7540 (2015), 529."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/TITS.2016.2600515"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2017.2764259"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/MVT.2018.2882873"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/TII.2019.2892767"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCOM.2017.1600263"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVT.2018.2867191"},{"key":"e_1_2_1_24_1","volume-title":"Fundamentals of Wireless Communication","author":"Tse David","unstructured":"David Tse and Pramod Viswanath . 2005. Fundamentals of Wireless Communication . Cambridge University Press . David Tse and Pramod Viswanath. 2005. Fundamentals of Wireless Communication. Cambridge University Press."},{"key":"e_1_2_1_25_1","volume-title":"Proceedings of the 30th AAAI Conference on Artificial Intelligence (AAAI\u201905)","volume":"2","author":"Hasselt Hado Van","year":"2016","unstructured":"Hado Van Hasselt , Arthur Guez , and David Silver . 2016 . Deep reinforcement learning with double Q-learning . In Proceedings of the 30th AAAI Conference on Artificial Intelligence (AAAI\u201905) , Vol. 2 . 5. Hado Van Hasselt, Arthur Guez, and David Silver. 2016. Deep reinforcement learning with double Q-learning. In Proceedings of the 30th AAAI Conference on Artificial Intelligence (AAAI\u201905), Vol. 2. 5."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/TWC.2017.2703901"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/TII.2018.2816590"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCOM.2017.1700360"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/TWC.2017.2712645"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVT.2010.2041803"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCOM.2018.1701054"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jnca.2018.02.003"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2018.05.022"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCCN.2017.2725277"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/TITS.2017.2749965"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2018.2847447"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3092692"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/TWC.2017.2661281"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/3178115"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3152397"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/SAHCN.2018.8397129"}],"container-title":["ACM Transactions on Intelligent Systems and Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3317572","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3317572","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:02:27Z","timestamp":1750194147000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3317572"}},"subtitle":["An Intelligent Offloading System"],"short-title":[],"issued":{"date-parts":[[2019,10,18]]},"references-count":41,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2019,11,30]]}},"alternative-id":["10.1145\/3317572"],"URL":"https:\/\/doi.org\/10.1145\/3317572","relation":{},"ISSN":["2157-6904","2157-6912"],"issn-type":[{"value":"2157-6904","type":"print"},{"value":"2157-6912","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,10,18]]},"assertion":[{"value":"2018-12-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-03-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-10-18","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}