{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,5,3]],"date-time":"2025-05-03T19:06:15Z","timestamp":1746299175110},"reference-count":13,"publisher":"Engineering and Technology Publishing","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["jcm"],"published-print":{"date-parts":[[2021]]},"abstract":"<jats:p>Next-generation wireless network systems and technologies provide a new paradigm for achieving the fastest access to any network. But one of the significant design concerns is the support of handoff, irrespective of the services. The key objective of this work is to enable a node to make appropriate decisions for performing handoff through Reinforcement learning. The work concentrates on the handoff decision phase for choosing the best network with a minimum delay during the handoff process. The reduction in decision delay has been achieved by minimizing the number of handoffs. The environment is modeled as a Markov decision process with the aim of increasing the total anticipated reward per link. The network resources that are used by the link is taken by a reward function and network switching cost that is utilized to model the signaling and processing load incurred on the network during handoff. It has been shown that the total number of unnecessary handoffs can be decreased enhancing the performance of heterogeneous networks. Also, an assessment of the proposed scheme with the existing Vertical handoff decision algorithm like the Simple Additive Weighting method (SAW) has been made and the results show an improved performance over SAW.<\/jats:p>","DOI":"10.12720\/jcm.16.12.566-575","type":"journal-article","created":{"date-parts":[[2021,11,24]],"date-time":"2021-11-24T03:19:49Z","timestamp":1637723989000},"page":"566-575","source":"Crossref","is-referenced-by-count":5,"title":["Reinforcement Learning Based Vertical Handoff Decision Algorithm for Next Generation Wireless Network"],"prefix":"10.12720","author":[{"name":"B.M.S.C.E, Bengaluru and 560019, India","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hemavathi","family":"Hemavathi","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"S.","family":"Akhila","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"4977","published-online":{"date-parts":[[2021]]},"reference":[{"key":"ref0","unstructured":"[1] S. Akhila, J. K. Murthy, A. R. Shankar, and S. Kumar, \"An overview on decision techniques for vertical handoffs across wireless heterogeneous networks,\" International Journal of Scientific & Engineering Research, vol. 3, no. 1, January 2012."},{"key":"ref1","doi-asserted-by":"publisher","unstructured":"[2] E. Stevens-Navarro, Y. Lin, and V. W. S. Wong, \"An MDP-based vertical handoff decision algorithm for heterogeneous wireless networks,\" IEEE Transactions on Vehicular Technology, vol. 57, no. 2, pp. 1243-1254, 2008.","DOI":"10.1109\/TVT.2007.907072"},{"key":"ref2","doi-asserted-by":"crossref","unstructured":"[3] R. Chai, W. G. Zhou, Q. B. Chen, and L. Tang, \"A survey on vertical handoff decision for heterogeneous wireless networks,\" in Proc. IEEE Youth Conference on Information, Computing and Telecommunication, 2009, pp. 279-282.","DOI":"10.1109\/YCICT.2009.5382368"},{"key":"ref3","doi-asserted-by":"crossref","unstructured":"[4] Y. Chen, H. Chen, and L. Xie, \"An MDP-based handoff decision algorithm for multi-domain heterogeneous wireless access networks,\" in Proc. International Conference on Communications, Circuits and Systems (ICCCAS), 2010, pp. 163-167.","DOI":"10.1109\/ICCCAS.2010.5582045"},{"key":"ref4","doi-asserted-by":"publisher","unstructured":"[5] M. Bin, D. Hong, X. Xianzhong, et al., \"An optimized vertical handoff algorithm based on Markov process in vehicle heterogeneous network,\" China Communications, vol. 12, no. 12, pp. 106-116, 2015.","DOI":"10.1109\/CC.2015.7114057"},{"key":"ref5","doi-asserted-by":"publisher","unstructured":"[6] H. Tabrizi, G. Farhadi, and J. Cioffi, \"A learning-based network selection method in heterogeneous wireless systems,\" in Proc. Global Telecommunications Conference (GLOBECOM 2011), 2011, pp. 1-5.","DOI":"10.1109\/GLOCOM.2011.6134269"},{"key":"ref6","doi-asserted-by":"crossref","unstructured":"[7] G. Ren, J. Zhao, and H. Qu, \"A user mobility pattern based vertical handoff decision algorithm in cellular-WLAN integrated networks,\" in Proc. Second IEEE International Conference on Computer and Communications, 2016, pp. 1550-1554.","DOI":"10.1109\/CompComm.2016.7924962"},{"key":"ref7","doi-asserted-by":"publisher","unstructured":"[8] S. Gueziz and D. Korichi, \"Performance analysis of handover optimization based on Media Independent handover in new networks NGWN,\" in Proc. International Symposium on Networks, Computers and Communications (ISNCC), 2016, pp. 1-6.","DOI":"10.1109\/ISNCC.2016.7746095"},{"key":"ref8","doi-asserted-by":"publisher","unstructured":"[9] S. Sasi, R. D. Daruwala, T. Palav, and P. Mule, \"A hybrid vertical handoff decision algorithm for seamless mobility in heterogeneous wireless networks,\" in Proc. International Conference on Wireless Communications, Signal Processing and Networking (WiSPNET), 2016, pp. 1921-1923.","DOI":"10.1109\/WiSPNET.2016.7566477"},{"key":"ref9","unstructured":"[10] David Silver. RL course by [Online]. Available: https:\/\/medium.com\/biffures\/rl-course-by-david-silver-lectures-1-to-4-7667608bf7d3"},{"key":"ref10","unstructured":"[11] The IEEE 802.21 Working Group finished all PAR Related Activities and Entered a State of Hibernation on July 19, 2019"},{"key":"ref11","unstructured":"[12] Markov Decision Process. [Online]. Available: https:\/\/en.wikipedia.org\/wiki\/Markov_decision_process"},{"key":"ref12","unstructured":"[13] E. Alpaydin, Introduction to Machine Learning, The MIT Press, 3rd edition, 2014."}],"container-title":["Journal of Communications"],"original-title":[],"link":[{"URL":"http:\/\/www.jocm.us\/uploadfile\/2021\/1122\/20211122051900648.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,12]],"date-time":"2024-09-12T22:29:39Z","timestamp":1726180179000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.jocm.us\/show-262-1714-1.html"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021]]},"references-count":13,"URL":"https:\/\/doi.org\/10.12720\/jcm.16.12.566-575","relation":{},"ISSN":["2374-4367"],"issn-type":[{"type":"print","value":"2374-4367"}],"subject":[],"published":{"date-parts":[[2021]]}}}