{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,19]],"date-time":"2026-03-19T18:32:52Z","timestamp":1773945172295,"version":"3.50.1"},"reference-count":38,"publisher":"Institute of Electrical and Electronics Engineers (IEEE)","issue":"1","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IEICE Trans. Commun."],"published-print":{"date-parts":[[2023,1,1]]},"DOI":"10.1587\/transcom.2021ebp3210","type":"journal-article","created":{"date-parts":[[2022,5,30]],"date-time":"2022-05-30T22:09:45Z","timestamp":1653948585000},"page":"1-17","source":"Crossref","is-referenced-by-count":5,"title":["A Hybrid Routing Algorithm for V2V Communication in VANETs Based on Blocked Q-Learning"],"prefix":"10.23919","volume":"E106.B","author":[{"given":"Xiang","family":"BI","sequence":"first","affiliation":[{"name":"School of Computer Science and Information Engineering, Hefei University of Technology"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Huang","family":"HUANG","sequence":"additional","affiliation":[{"name":"School of Computer Science and Information Engineering, Hefei University of Technology"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Benhong","family":"ZHANG","sequence":"additional","affiliation":[{"name":"School of Computer Science and Information Engineering, Hefei University of Technology"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xing","family":"WEI","sequence":"additional","affiliation":[{"name":"Intelligent Manufacturing Institute, Hefei University of Technology"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"263","reference":[{"key":"1","doi-asserted-by":"publisher","unstructured":"[1] M. Tsuru, M. Takai, S. Kaneda, Agussalim, and R.A. Tsiory, \u201cTowards practical store-carry-forward networking: Examples and issues,\u201d IEICE Trans. Commun., vol.100, no.1, pp.2-10, Jan. 2017. 10.1587\/transcom.2016cqi0001","DOI":"10.1587\/transcom.2016CQI0001"},{"key":"2","doi-asserted-by":"crossref","unstructured":"[2] X. Duan, X. Wang, Y. Liu, and K. Zheng, \u201cSDN enabled dual cluster head selection and adaptive clustering in 5G-VANET,\u201d 2016 IEEE 84th Vehicular Technology Conference (VTC-Fall), pp.1-5, 2016. 10.1109\/vtcfall.2016.7881214","DOI":"10.1109\/VTCFall.2016.7881214"},{"key":"3","doi-asserted-by":"publisher","unstructured":"[3] J.B. Kenney, \u201cDedicated short-range communications (DSRC) standards in the united states,\u201d Proc. IEEE, vol.99, no.7, pp.1162-1182, 2011. 10.1109\/jproc.2011.2132790","DOI":"10.1109\/JPROC.2011.2132790"},{"key":"4","doi-asserted-by":"crossref","unstructured":"[4] X. Ji, W. Xu, C. Zhang, T. Yun, G. Zhang, X. Wang, Y. Wang, and B. Liu, \u201cKeep forwarding path freshest in VANET via applying reinforcement learning,\u201d 2019 IEEE First International Workshop on Network Meets Intelligent Computations (NMIC), pp.13-18, 2019. 10.1109\/nmic.2019.00008","DOI":"10.1109\/NMIC.2019.00008"},{"key":"5","doi-asserted-by":"publisher","unstructured":"[5] X. Bi, B. Guo, L. Shi, Y. Lu, L. Feng, and Z. Lyu, \u201cA new affinity propagation clustering algorithm for V2V-supported VANETs,\u201d IEEE Access, vol.8, pp.71405-71421, 2020. 10.1109\/access.2020.2987968","DOI":"10.1109\/ACCESS.2020.2987968"},{"key":"6","doi-asserted-by":"publisher","unstructured":"[6] S. Boussoufa-Lahlah, F. Semchedine, and L. Bouallouche-Medjkoune, \u201cGeographic routing protocols for vehicular ad hoc networks (VANETs): A survey,\u201d Vehicular Communications, vol.11, pp.20-31, 2018. 10.1016\/j.vehcom.2018.01.006","DOI":"10.1016\/j.vehcom.2018.01.006"},{"key":"7","doi-asserted-by":"publisher","unstructured":"[7] X. Yang, M. Li, Z. Qian, and T. Di, \u201cImprovement of GPSR protocol in vehicular ad hoc network,\u201d IEEE Access, vol.6, pp.39515-39524, 2018. 10.1109\/access.2018.2853112","DOI":"10.1109\/ACCESS.2018.2853112"},{"key":"8","doi-asserted-by":"crossref","unstructured":"[8] B. Karp and H.T. Kung, \u201cGPSR: Greedy perimeter stateless routing for wireless networks,\u201d MobiCom'00, pp.243-254, 2000. 10.1145\/345910.345953","DOI":"10.1145\/345910.345953"},{"key":"9","doi-asserted-by":"crossref","unstructured":"[9] M.B. Kokare and D. Kakkar, \u201cA survey on clustering algorithms for cluster-head selection in VANET,\u201d 2021 Second International Conference on Electronics and Sustainable Communication Systems (ICESC), pp.992-996, 2021. 10.1109\/icesc51422.2021.9532807","DOI":"10.1109\/ICESC51422.2021.9532807"},{"key":"10","doi-asserted-by":"publisher","unstructured":"[10] X. Ji, H. Yu, G. Fan, H. Sun, and L. Chen, \u201cEfficient and reliable cluster-based data transmission for vehicular ad hoc networks,\u201d Mobile Information Systems, vol.2018, p.9826782, 2018. 10.1155\/2018\/9826782","DOI":"10.1155\/2018\/9826782"},{"key":"11","unstructured":"[11] M. Mottahedi, S. Jabbehdari, and S. Adabi, \u201cIBCAV: Intelligent based clustering algorithm in vanet,\u201d International Journal of Computer Science Issues, vol.10, no.1, 2013."},{"key":"12","doi-asserted-by":"publisher","unstructured":"[12] K. Aravindhan and C.S.G. Dhas, \u201cDestination-aware context-based routing protocol with hybrid soft computing cluster algorithm for VANET,\u201d Soft Comput., vol.23, no.8, pp.2499-2507, 2019. 10.1007\/s00500-018-03685-7","DOI":"10.1007\/s00500-018-03685-7"},{"key":"13","doi-asserted-by":"crossref","unstructured":"[13] C. Le, H. Xiaohui, and Q. Yu, \u201cA cluster routing protocol based on vehicle density in vehicular ad hoc networks,\u201d RICAI 2020: 2020 2nd International Conference on Robotics, Intelligent Control and Artificial Intelligence, pp.115-119, 2020. 10.1145\/3438872.3439066","DOI":"10.1145\/3438872.3439066"},{"key":"14","unstructured":"[14] W.K. Wu, \u201cImproved paired cluster-based routing protocol in vehicular ad-hoc networks,\u201d International journal of advanced smart convergence, vol.7, no.2, pp.22-32, 2018. 10.7236\/IJASC.2018.7.2.22"},{"key":"15","doi-asserted-by":"publisher","unstructured":"[15] X. Bao, H. Li, G. Zhao, L. Chang, J. Zhou, and Y. Li, \u201cEfficient clustering V2V routing based on PSO in VANETs,\u201d Measurement, vol.152, p.107306, 2020. 10.1016\/j.measurement.2019.107306","DOI":"10.1016\/j.measurement.2019.107306"},{"key":"16","doi-asserted-by":"publisher","unstructured":"[16] T. Qiu, X. Wang, C. Chen, M. Atiquzzaman, and L. Liu, \u201cTMED: A spider-web-like transmission mechanism for emergency data in vehicular ad hoc networks,\u201d IEEE Trans. Veh. Technol., vol.67, no.9, pp.8682-8694, 2018. 10.1109\/tvt.2018.2841348","DOI":"10.1109\/TVT.2018.2841348"},{"key":"17","doi-asserted-by":"publisher","unstructured":"[17] J. Dowling, E. Curran, R. Cunningham, and V. Cahill, \u201cUsing feedback in collaborative reinforcement learning to adaptively optimize manet routing,\u201d IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol.35, no.3, pp.360-372, 2005. 10.1109\/tsmca.2005.846390","DOI":"10.1109\/TSMCA.2005.846390"},{"key":"18","unstructured":"[18] M.L. Puterman, Markov Decision Processes: Discrete Stochastic Dynamic Programming, Wiley, 2014. 10.1002\/9780470316887"},{"key":"19","doi-asserted-by":"publisher","unstructured":"[19] R.A. Nazib and S. Moh, \u201cReinforcement learning-based routing protocols for vehicular ad hoc networks: A comparative survey,\u201d IEEE Access, vol.9, pp.27552-27587, 2021. 10.1109\/access.2021.3058388","DOI":"10.1109\/ACCESS.2021.3058388"},{"key":"20","doi-asserted-by":"publisher","unstructured":"[20] C. Wu, K. Kumekawa, and T. Kato, \u201cDistributed reinforcement learning approach for vehicular ad hoc networks,\u201d IEICE Trans. Commun., vol.E93-B, no.6, pp.1431-1442, June 2010. 10.1587\/transcom.e93.b.1431","DOI":"10.1587\/transcom.E93.B.1431"},{"key":"21","doi-asserted-by":"publisher","unstructured":"[21] X. Yang, W. Zhang, H. Lu, and L. Zhao, \u201cV2V routing in VANET based on heuristic Q-learning,\u201d Int. J. Comput., Commun. Control, vol.15, no.5, 2020. 10.15837\/ijccc.2020.5.3928","DOI":"10.15837\/ijccc.2020.5.3928"},{"key":"22","doi-asserted-by":"publisher","unstructured":"[22] D. Zhang, T. Zhang, and X. Liu, \u201cNovel self-adaptive routing service algorithm for application in vanet,\u201d Appl. Intell., vol.49, no.5, pp.1866-1879, 2019. 10.1007\/s10489-018-1368-y","DOI":"10.1007\/s10489-018-1368-y"},{"key":"23","doi-asserted-by":"publisher","unstructured":"[23] J. Wu, M. Fang, H. Li, and X. Li, \u201cRSU-assisted traffic-aware routing based on reinforcement learning for urban VANETs,\u201d IEEE Access, vol.8, pp.5733-5748, 2020. 10.1109\/access.2020.2963850","DOI":"10.1109\/ACCESS.2020.2963850"},{"key":"24","doi-asserted-by":"crossref","unstructured":"[24] S.S. Doddalinganavar, P.V. Tergundi, and R.S. Patil, \u201cSurvey on deep reinforcement learning protocol in VANET,\u201d 2019 1st International Conference on Advances in Information Technology (ICAIT), pp.81-86, 2019. 10.1109\/icait47043.2019.8987282","DOI":"10.1109\/ICAIT47043.2019.8987282"},{"key":"25","unstructured":"[25] A. Juliani, \u201cSimple reinforcement learning with tensorflow part0: Q-learning with tables and neural networks,\u201d Medium.com, 2016."},{"key":"26","doi-asserted-by":"crossref","unstructured":"[26] J. Skiles and I. Mahgoub, \u201cA geographical hybrid solution for inter-vehicular communication in VANET,\u201d 2016 International Wireless Communications and Mobile Computing Conference (IWCMC), pp.250-255, 2016. 10.1109\/iwcmc.2016.7577066","DOI":"10.1109\/IWCMC.2016.7577066"},{"key":"27","doi-asserted-by":"publisher","unstructured":"[27] M. Al-Rabayah and R. Malaney, \u201cA new scalable hybrid routing protocol for VANETs,\u201d IEEE Trans. Veh. Technol., vol.61, no.6, pp.2625-2635, 2012. 10.1109\/tvt.2012.2198837","DOI":"10.1109\/TVT.2012.2198837"},{"key":"28","doi-asserted-by":"crossref","unstructured":"[28] K.N. Qureshi, A.H. Abdullah, F. Bashir, S. Iqbal, and K.M. Awan, \u201cCluster-based data dissemination, cluster head formation under sparse, and dense traffic conditions for vehicular ad hoc networks,\u201d Int. J. Commun. Syst., vol.31, no.8, p.e3533, 2018. 10.1002\/dac.3533","DOI":"10.1002\/dac.3533"},{"key":"29","doi-asserted-by":"crossref","unstructured":"[29] M. Alawi, E. Sundararajan, R. Alsaqour, and M. Ismail, \u201cGateway selection techniques in heterogeneous vehicular network: Review and challenges,\u201d 2017 6th International Conference on Electrical Engineering and Informatics (ICEEI), pp.1-6, 2017. 10.1109\/iceei.2017.8312425","DOI":"10.1109\/ICEEI.2017.8312425"},{"key":"30","unstructured":"[30] ASTM E2213-03, \u201cStandard specification for telecommunications and information exchange between roadside and vehicle systems,\u201d 2018. 10.1520\/e2213-03"},{"key":"31","doi-asserted-by":"crossref","unstructured":"[31] C. Perkins, E. Belding-Royer, and S. Das, \u201cAd hoc on-demand distance vector (AODV) routing,\u201d RFC3561, 2003. 10.17487\/rfc3561","DOI":"10.17487\/rfc3561"},{"key":"32","unstructured":"[32] K.N. Qureshi and A.H. Abdullah, \u201cTopology based routing protocols for vanet and their comparison with manet,\u201d Journal of Theoretical and Applied Information Technology, vol.58, pp.707-715, 2013."},{"key":"33","doi-asserted-by":"publisher","unstructured":"[33] X. Jiang and D.H.C. Du, \u201cBUS-VANET: A bus vehicular network integrated with traffic infrastructure,\u201d IEEE Intell. Transport. Syst. Mag., vol.7, no.2, pp.47-57, 2015. 10.1109\/mits.2015.2408137","DOI":"10.1109\/MITS.2015.2408137"},{"key":"34","doi-asserted-by":"crossref","unstructured":"[34] A. Varga, \u201cOMNeT++,\u201d Modeling and Tools for Network Simulation, pp.35-59, Springer, 2010. 10.1007\/978-3-642-12331-3_3","DOI":"10.1007\/978-3-642-12331-3_3"},{"key":"35","unstructured":"[35] M. Behrisch, L. Bieker, J. Erdmann, and D. Krajzewicz, \u201cSUMO \u2014 Simulation of urban mobility: An overview,\u201d Proc. SIMUL 2011, The Third International Conference on Advances in System Simulation, ThinkMind, 2011."},{"key":"36","doi-asserted-by":"publisher","unstructured":"[36] J. Cheng, J. Cheng, M. Zhou, F. Liu, S. Gao, and C. Liu, \u201cRouting in internet of vehicles: A review,\u201d IEEE Trans. Intell. Transp. Syst., vol.16, no.5, pp.2339-2352, 2015. 10.1109\/tits.2015.2423667","DOI":"10.1109\/TITS.2015.2423667"},{"key":"37","doi-asserted-by":"publisher","unstructured":"[37] D. Naboulsi and M. Fiore, \u201cCharacterizing the instantaneous connectivity of large-scale urban vehicular networks,\u201d IEEE Trans. Mobile Comput., vol.16, no.5, p.1272-1286, 2017. 10.1109\/tmc.2016.2591527","DOI":"10.1109\/TMC.2016.2591527"},{"key":"38","unstructured":"[38] D. Zhang, Y. Zhu, S. Liu, X. Zhang, and J. Song, \u201cMulti-radio multi-channel (MRMC) resource optimization method for wireless mesh network,\u201d Journal of Information Science & Engineering, vol.32, no.2, 2016."}],"container-title":["IEICE Transactions on Communications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.jstage.jst.go.jp\/article\/transcom\/E106.B\/1\/E106.B_2021EBP3210\/_pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,1,10]],"date-time":"2024-01-10T15:00:39Z","timestamp":1704898839000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.jstage.jst.go.jp\/article\/transcom\/E106.B\/1\/E106.B_2021EBP3210\/_article"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,1]]},"references-count":38,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2023]]}},"URL":"https:\/\/doi.org\/10.1587\/transcom.2021ebp3210","relation":{},"ISSN":["0916-8516","1745-1345"],"issn-type":[{"value":"0916-8516","type":"print"},{"value":"1745-1345","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,1,1]]},"article-number":"2021EBP3210"}}