{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,25]],"date-time":"2025-10-25T14:22:47Z","timestamp":1761402167349},"reference-count":35,"publisher":"Engineering and Technology Publishing","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["jcm"],"published-print":{"date-parts":[[2021]]},"abstract":"<jats:p>Internet of vehicles commonly known as IOV is a newly emerged area which with the help of internet assisted communication provides the support to the vehicles. Due to the access of more than one radio access network, 5G makes the connectivity ubiquitous. Vehicle mobility demands for handover in such heterogeneous networks. Instead of using better technology for long ranges and other types of traffic, the vehicles are using devoted short range communications at short ranges. Commonly, networks for handovers were used to be selected directly or with the available radio access it used to connect automatically. With the help of this, the hand over occurrence now takes places frequently. This paper is based on the incorporation of DSRC, LTE as well as mm Wave on Internet of vehicles which is integrated with the Handover decision making algorithm, Network Selection and Routing. The decision of the handovers is to ensure that if there is any requirement of the vertical handovers using dynamic Q-learning algorithms in which entropy function is used to predict the threshold according to the characteristics of the environment. The network selection process is done using Fuzzy Convolution Neural Network commonly known as FCNN which makes the fuzzy rules by considering the parameters such as strength of its signal, its distance, the density of the vehicle, the type of its data as well the Line of Sight (LoS). V2V chain routing is presented in such a manner that V2V pairs are also selected with the help of jellyfish optimization algorithm considering three metrics \u2013 Vehicle metrics, Channel metrics and Vehicle performance metrics. OMNET++ simulator is the software in which system is developed. The performance evaluation is done according to its Handover Success Probability, Handover Failure, Redundant Handover, Mean Throughput, delay and Packet Loss.<\/jats:p>","DOI":"10.12720\/jcm.16.5.155-166","type":"journal-article","created":{"date-parts":[[2021,5,25]],"date-time":"2021-05-25T06:29:58Z","timestamp":1621924198000},"page":"155-166","source":"Crossref","is-referenced-by-count":26,"title":["Dynamic Q-learning and Fuzzy CNN Based Vertical Handover Decision for Integration of DSRC, mmWave 5G and LTE in Internet of Vehicles (IoV)"],"prefix":"10.12720","author":[{"name":"Department of Communications Engineering & Advanced Telecommunication Technology (ATT), School of Electrical Engineering, Faculty of Engineering, Universiti Teknologi Malaysia","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shaik Mazhar","family":"Hussain","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kamaludin Mohamad","family":"Yusof","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"4977","published-online":{"date-parts":[[2021]]},"reference":[{"key":"ref0","doi-asserted-by":"publisher","unstructured":"[1] Y. Yang and K. Hua, \"Emerging technologies for 5G-enabled vehicular networks,\" IEEE Access, vol. 7, 2019.","DOI":"10.1109\/ACCESS.2019.2954466"},{"key":"ref1","doi-asserted-by":"publisher","unstructured":"[2] Carlos Renato Storck, F\u00e1tima Duarte-Figueiredo, \"A survey of 5G technology evolution, standards, and infrastructure associated with vehicle-to-everything communications by internet of things,\" IEEE Access, vol. 8, 2020.","DOI":"10.1109\/ACCESS.2020.3004779"},{"key":"ref2","doi-asserted-by":"publisher","unstructured":"[3] R. Sanchez-Iborra, J. Santa, J. Gallego-Madrid, S. Covaci, and A. Skarmeta, \"Empowering the internet of vehicles with Multi-RAT 5G network slicing,\" Sensors, MDPI, vol. 19, no. 14, 2019.","DOI":"10.3390\/s19143107"},{"key":"ref3","doi-asserted-by":"publisher","unstructured":"[4] E. Benalia, S. Bitam, and A. Mellouk, \"Data dissemination for Internet of vehicles based on 5G communications: A survey,\" Transactions on Emerging Telecommunications Technologies, Future Internet of Vehicles, vol. 31, no. 5, 2020.","DOI":"10.1002\/ett.3881"},{"key":"ref4","doi-asserted-by":"publisher","unstructured":"[5] T. Zugno, M. Drago, M. Giordani, M. Polese, and M. Zorzi, \"Toward standardization of millimeter-wave vehicle-to-vehicle networks: Open challenges and performance evaluation,\" IEEE Communications Magazine, vol. 58, no. 9, pp. 79-85, 2020.","DOI":"10.1109\/MCOM.001.2000041"},{"key":"ref5","doi-asserted-by":"publisher","unstructured":"[6] K. Z. Ghafoor, L. Kong, S. Zeadally, A. S. Sadiq, G. Epiphaniou, M. Hammoudeh, A. K. Bashir, and S. Mumtaz, \"Millimeter-Wave communication for internet of vehicles: Status, challenges, and perspectives,\" IEEE Internet of Things Journal, vol. 7, no. 9, pp. 8525-8546, 2020.","DOI":"10.1109\/JIOT.2020.2992449"},{"key":"ref6","doi-asserted-by":"publisher","unstructured":"[7] T. M. Duong and S. Kwon, \"Vertical handover analysis for randomly deployed small cells in heterogeneous networks,\" IEEE Transactions on Wireless Communications, vol. l, no. 4, pp. 2282-2292, 2020.","DOI":"10.1109\/TWC.2019.2963829"},{"key":"ref7","doi-asserted-by":"publisher","unstructured":"[8] E. Skondras, A. Michalas, N. Tsolis, and D. D. Vergados, \"A VHO scheme healthcare services in 5G vehicular cloud computing systems,\" in Proc. Wireless Telecommunications Symposium (WTS), 2018.","DOI":"10.1109\/WTS.2018.8363956"},{"key":"ref8","doi-asserted-by":"publisher","unstructured":"[9] M. Giordani, A. Zanella, T. Higuchi, O. Altintas, and M. Zorzi, \"On the feasibility of integrating mmWave and IEEE 802.11p for V2V communications,\" in Proc. IEEE 88th Vehicular Technology Conference, 2019.","DOI":"10.1109\/VTCFall.2018.8690697"},{"key":"ref9","doi-asserted-by":"publisher","unstructured":"[10] S. Kaur, S. K. Sehra, and S. S. Sehra, \"A framework for software quality model selection using TOPSIS,\" in Proc. IEEE International Conference on Recent Trends in Electronics, Information & Communication Technology (RTEICT), 2017.","DOI":"10.1109\/RTEICT.2016.7807922"},{"key":"ref10","doi-asserted-by":"publisher","unstructured":"[11] S. Goudarzi, W. H. Hassan, M. H. Anisi, M. K. Khan, and S. A. Soleymani, \"Intelligent technique for seamless vertical handover in vehicular networks,\" Mobile Networks and Applications, pp. 1462-1477, 2018.","DOI":"10.1007\/s11036-017-0979-6"},{"key":"ref11","doi-asserted-by":"publisher","unstructured":"[12] S. Goudarzi, W. H. Hassan, M. H. Anisi, M. K. Khan, and S. A. Soleymani, \"Intelligent technique for seamless vertical handover in vehicular networks,\" Mobile Networks and Applications, pp. 1462-1477, 2018.","DOI":"10.1007\/s11036-017-0979-6"},{"key":"ref12","doi-asserted-by":"publisher","unstructured":"[13] A. Bathich, M. A. Mansor, S. I. Sulimn, and S. G. A. Ali, \"Q-learning vertical handover scheme in two-tier LTE-A networks,\" International Journal of Electrical and Computer Engineering, vol. 10, no. 6, pp. 5824-5831, 2020.","DOI":"10.11591\/ijece.v10i6.pp5824-5831"},{"key":"ref13","doi-asserted-by":"publisher","unstructured":"[14] C. Ksouri, I. Jemili, M. Mosbah, and A. Belghith, \"Towards general Internet of Vehicles networking: Routing protocols survey,\" Concurrency and Computation Practice and Experience, 2020.","DOI":"10.1002\/cpe.5994"},{"key":"ref14","doi-asserted-by":"publisher","unstructured":"[15] J. Wu, M. Fang, H. Li, and X. Li, \"RSU-Assisted traffic-aware routing based on reinforcement learning for urban vanets,\" IEEE Access, vol. 8, pp. 5733-5748, 2020.","DOI":"10.1109\/ACCESS.2020.2963850"},{"key":"ref15","doi-asserted-by":"publisher","unstructured":"[16] N. Lin, Y. Shi, T. Zhang, and X. Wang, \"An efficient order-aware hybrid genetic algorithm for capacitated vehicle routing problems in internet of things,\" IEEE Access, vol. 7, pp. 86102-86114, 2019.","DOI":"10.1109\/ACCESS.2019.2925831"},{"key":"ref16","doi-asserted-by":"publisher","unstructured":"[17] J. J. Q. Yu, W. Yu, and J. Gu, \"Online vehicle routing with neural combinatorial optimization and deep reinforcement learning,\" IEEE Transactions on Intelligent Transportation Systems, vol. 20, no. 10, pp. 3806-3817, 2019.","DOI":"10.1109\/TITS.2019.2909109"},{"key":"ref17","doi-asserted-by":"publisher","unstructured":"[18] K. M. Awan, M. Nadeem, A. S. Sadiq, A. Alghushami, I. Khan, and K. Rabie, \"Smart handoff technique for internet of vehicles communication using dynamic edge-backup node,\" Electronics, MDPI, vol. 9, no. 3, 2020.","DOI":"10.3390\/electronics9030524"},{"key":"ref18","doi-asserted-by":"publisher","unstructured":"[19] E. Ndashimye, N. I. Sarkar, and S. K. Ray, \"A network selection method for handover in vehicle-to-infrastructure communications in multi-tier networks,\" Wireless Networks, Springer, pp. 387-401, 2020.","DOI":"10.1007\/s11276-018-1817-x"},{"key":"ref19","doi-asserted-by":"publisher","unstructured":"[20] A. Tassi, M. Egan, R. J. Piechocki, and A. Nix, \"Modeling and design of millimeter-wave networks for highway vehicular communication,\" IEEE Transactions on Vehicular Technology, vol. 66, no, 12, pp. 10676-10691, 2017.","DOI":"10.1109\/TVT.2017.2734684"},{"key":"ref20","doi-asserted-by":"publisher","unstructured":"[21] D. Jiang, L. Huo, Z. Lv, H. Song, and W. Qin, \"A joint multi-criteria utility-based network selection approach for vehicle-to-infrastructure networking,\" IEEE Transactions on Intelligent Transportation Systems, vol. 19, no. 10, pp. 3305-3319, 2018.","DOI":"10.1109\/TITS.2017.2778939"},{"key":"ref21","doi-asserted-by":"publisher","unstructured":"[22] Q. Si, Z. Cheng, Y. Lin, L. Huang, and Y. Tang, 'Network selection in heterogeneous vehicular network: A one-to-many matching approach,\" in Proc. IEEE 91st Vehicular Technology Conference, 2020.","DOI":"10.1109\/VTC2020-Spring48590.2020.9129074"},{"key":"ref22","doi-asserted-by":"publisher","unstructured":"[23] X. Zhao, X. Li, Z. Xu, and T. Chen, 'An optimal game approach for heterogeneous vehicular network selection with varying network performance,\" IEEE Intelligent Transportation Systems Magazine, vol. 11, no. 3, pp. 80 - 92, 2019.","DOI":"10.1109\/MITS.2019.2919563"},{"key":"ref23","doi-asserted-by":"publisher","unstructured":"[24] H. Ahmed, S. Pierre, and A. Quintero, \"A cooperative road topology based handoff management scheme,\" IEEE Transactions on Vehicular Technology, vol. 68, no. 4, pp. 3154-3162, 2019.","DOI":"10.1109\/TVT.2018.2872824"},{"key":"ref24","doi-asserted-by":"publisher","unstructured":"[25] T. H. Nguyen and J. J. Jung, \"ACO-based approach on dynamic MSMD routing in IoV environment,\" in Proc. 16th International Conference on Intelligent Environments, 2020.","DOI":"10.1109\/IE49459.2020.9154927"},{"key":"ref25","doi-asserted-by":"publisher","unstructured":"[26] N. M. Al-Kharasani, Z. A. Zukarnain, S. K. Subramaniam, and Z. M. Hanapi, \"An adaptive relay selection scheme for enhancing network stability in VANETs,\" IEEE Access, vol. 8, pp. 128757-128765, 2020.","DOI":"10.1109\/ACCESS.2020.2974105"},{"key":"ref26","doi-asserted-by":"publisher","unstructured":"[27] B. Fan, H. Tian, S. Zhu, Y. Chen, and X. Zhu, 'Traffic-Aware relay vehicle selection in millimeter-wave vehicle-to-vehicle communication,\" IEEE Wireless Communications Letters, vol. 8, no. 2, pp. 400-403, 2019.","DOI":"10.1109\/LWC.2018.2873585"},{"key":"ref27","doi-asserted-by":"publisher","unstructured":"[28] C. Chen, L. Liu, T. Qiu, D. O. Wu, and Z. Ren, \"Delay-Aware Grid-Based geographic routing in urban VANETs: A backbone approach,\" IEEE\/ACM Transactions on Networking, vol. 27, no. 6, pp. 2324-2337, 2019.","DOI":"10.1109\/TNET.2019.2944595"},{"key":"ref28","doi-asserted-by":"publisher","unstructured":"[29] G. T. Santhosh and S. Dhandapani, \"Hybridization of monarch butterfly and grey wolf optimization for optimal routing in VANET,\" International Journal of Engineering and Advanced Technology, vol. 9, no. 2, 2019.","DOI":"10.35940\/ijeat.B4112.129219"},{"key":"ref29","doi-asserted-by":"publisher","unstructured":"[30] O. Alzamzami and I. Mahgoub, \"Fuzzy logic-based geographic routing for urban vehicular networks using link quality and achievable throughput estimations,\" IEEE Transactions on Intelligent Transportation Systems, vol. 20, no. 6, pp. 2289-2300, 2019.","DOI":"10.1109\/TITS.2018.2867177"},{"key":"ref30","doi-asserted-by":"publisher","unstructured":"[31] Z. Sheng, A. Pressas, V. Ocheri, F. Ali, R. Rudd, and M. Nekovee, 'Intelligent 5G vehicular networks: An integration of DSRC and mmWave communications,\" in Proc. International Conference on Information and Communication Technology Convergence (ICTC), IEEE, 2018.","DOI":"10.1109\/ICTC.2018.8539687"},{"key":"ref31","doi-asserted-by":"publisher","unstructured":"[32] L. Yan, H. Ding, L. Zhang, J. Liu, X. Fang, Y. Fang, M. Xiao, and X. Huang, \"Machine learning based handovers for Sub-6 GHz and mmWave integrated vehicular networks,\" IEEE Transactions on Wireless Communications, vol. 18, no. 10, pp. 4873-4885, 2019.","DOI":"10.1109\/TWC.2019.2930193"},{"key":"ref32","doi-asserted-by":"publisher","unstructured":"[33] M. Lahby, A. Essouiri, and A. Sekkaki, \"A novel modeling approach for vertical handover based on dynamic k-partite graph in heterogeneous networks,\" Digital Communications and Networks, Sciencedirect, vol. 5, no. 4, pp. 297-307, 2019.","DOI":"10.1016\/j.dcan.2019.10.001"},{"key":"ref33","doi-asserted-by":"publisher","unstructured":"[34] H. H. R. Sherazi, Z. A. Khan, R. Iqbal, S. Rizwan, M. A. Imran, and K. Awan, \"A heterogeneous IoV architecture for data forwarding in vehicle to infrastructure communication,\" Mobile Information Systems, Hindawi, 2019.","DOI":"10.1155\/2019\/3101276"},{"key":"ref34","doi-asserted-by":"publisher","unstructured":"[35] C. R. Storck and F. Duarte-Figueiredo, \"A 5G V2X ecosystem providing internet of vehicles,\" Sensors, MDPI, vol. 19, no. 3, 2019.","DOI":"10.3390\/s19030550"}],"container-title":["Journal of Communications"],"original-title":[],"link":[{"URL":"http:\/\/www.jocm.us\/uploadfile\/2021\/0422\/20210422103012199.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,11,25]],"date-time":"2021-11-25T05:55:30Z","timestamp":1637819730000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.jocm.us\/show-255-1651-1.html"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021]]},"references-count":35,"URL":"https:\/\/doi.org\/10.12720\/jcm.16.5.155-166","relation":{},"ISSN":["2374-4367"],"issn-type":[{"type":"print","value":"2374-4367"}],"subject":[],"published":{"date-parts":[[2021]]}}}