{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,4]],"date-time":"2026-05-04T12:34:30Z","timestamp":1777898070636,"version":"3.51.4"},"reference-count":18,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,3,19]],"date-time":"2021-03-19T00:00:00Z","timestamp":1616112000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,3,19]],"date-time":"2021-03-19T00:00:00Z","timestamp":1616112000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Wireless Com Network"],"published-print":{"date-parts":[[2021,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>It has been widely acknowledged that network slicing is a key architectural technology to accommodate diversified services for the next generation network (5G). By partitioning the underlying network into multiple dedicated logical networks, 5G can support a variety of extreme business service needs. As network slicing is implemented in radio access networks (RAN), user handoff becomes much more complicated than that in traditional mobile networks. As both physical resource constraints of base stations and logical connection constraints of network slices should be considered in handoff decision, an intelligent handoff policy becomes imperative. In this paper, we model the handoff in RAN slicing as a Markov decision process and resort to deep reinforcement learning to pursue long-term performance improvement in terms of user quality of service and network throughput. The effectiveness of our proposed handoff policy is validated via simulation experiments.<\/jats:p>","DOI":"10.1186\/s13638-021-01939-x","type":"journal-article","created":{"date-parts":[[2021,3,19]],"date-time":"2021-03-19T06:16:03Z","timestamp":1616134563000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["Dynamic handoff policy for RAN slicing by exploiting deep reinforcement learning"],"prefix":"10.1186","volume":"2021","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6193-3918","authenticated-orcid":false,"given":"Yuansheng","family":"Wu","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Guanqun","family":"Zhao","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dadong","family":"Ni","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Junyi","family":"Du","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2021,3,19]]},"reference":[{"key":"1939_CR1","doi-asserted-by":"publisher","first-page":"19691","DOI":"10.1109\/ACCESS.2018.2822398","volume":"6","author":"W Guan","year":"2018","unstructured":"W. Guan et al., A service-oriented deployment policy of end-to-end network slicing based on complex network theory. IEEE Access 6, 19691\u201319701 (2018)","journal-title":"IEEE Access"},{"issue":"5","key":"1939_CR2","doi-asserted-by":"publisher","first-page":"80","DOI":"10.1109\/MCOM.2017.1600935","volume":"55","author":"J Ordonez Lucena","year":"2017","unstructured":"J. Ordonez Lucena, P. Ameigeiras, D. Lopez, J.J. Ramos-Munoz, J. Lorca, J. Folgueira, Network slicing for 5G with SDN\/NFV: concepts, architectures, and challenges. IEEE Commun. Mag. 55(5), 80\u201387 (2017)","journal-title":"IEEE Commun. Mag."},{"key":"1939_CR3","doi-asserted-by":"crossref","unstructured":"H. Wei, Z. Zhang, B. Fan, Network slice access selection scheme in 5G, in 2017 IEEE 2nd Information Technology, Networking, Electronic and Automation Control Conference (ITNEC) (IEEE, 2017)","DOI":"10.1109\/ITNEC.2017.8284751"},{"key":"1939_CR4","doi-asserted-by":"crossref","unstructured":"M.R. Sama et al., Service-based slice selection function for 5G, in 2016 IEEE Global communications conference (GLOBECOM) (IEEE, 2016)","DOI":"10.1109\/GLOCOM.2016.7842265"},{"key":"1939_CR5","unstructured":"3GPP, TS 38.300, NR and NG-RAN Overall Description. Stage 2 (Release 15) (2018)"},{"key":"1939_CR6","doi-asserted-by":"publisher","first-page":"1054","DOI":"10.1109\/TNN.1998.712192","volume":"9","author":"R Sutton","year":"1998","unstructured":"R. Sutton, A. Barto. Reinforcement Learning: An Introduction (MIT Press, Cambridge, 1998)","journal-title":"IEEE Trans. Neural Netw."},{"key":"1939_CR7","doi-asserted-by":"publisher","DOI":"10.1002\/9780470316887","volume-title":"Markov Decision Processes: Discrete Stochastic Dynamic Programming","author":"M Puterman","year":"1994","unstructured":"M. Puterman, Markov Decision Processes: Discrete Stochastic Dynamic Programming (Wiley and Sons, Hoboken, 1994)"},{"key":"1939_CR8","unstructured":"A.H. Arani, M.J. Omidi, A. Mehbodniya, et al., A handoff algorithm based on estimated load for dense green 5G networks, in 2015 IEEE Global Communications Conference (GLOBECOM) (2015), pp. 1\u20137"},{"key":"1939_CR9","unstructured":"G. Araniti, J. Cosmas, A. Iera, et al., Energy efficient handover algorithm for green radio networks, in 2014 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (2014), pp. 1\u20136"},{"issue":"6","key":"1939_CR10","doi-asserted-by":"publisher","first-page":"1456","DOI":"10.1109\/TMC.2017.2762668","volume":"17","author":"Y Sun","year":"2018","unstructured":"Y. Sun et al., The SMART handoff policy for millimeter wave heterogeneous cellular networks. IEEE Trans. Mob. Comput. 17(6), 1456\u20131468 (2018)","journal-title":"IEEE Trans. Mob. Comput."},{"key":"1939_CR11","doi-asserted-by":"crossref","unstructured":"H. Tabrizi, G. Farhadi, J. Cioffi, Dynamic handoff decision in heterogeneous wireless systems: Q-learning approach, in 2012 IEEE International Conference on Communications (ICC) (IEEE, 2012)","DOI":"10.1109\/ICC.2012.6364194"},{"key":"1939_CR12","doi-asserted-by":"crossref","unstructured":"L. Chen, H. Li, An MDP-based vertical handoff decision algorithm for heterogeneous wireless networks, in 2016 IEEE Wireless Communications and Networking Conference (WCNC) (IEEE, 2016)","DOI":"10.1109\/WCNC.2016.7564804"},{"issue":"2","key":"1939_CR13","doi-asserted-by":"publisher","first-page":"1243","DOI":"10.1109\/TVT.2007.907072","volume":"57","author":"E Stevens-Navarro","year":"2008","unstructured":"E. Stevens-Navarro, Y. Lin, V.W.S. Wong, An MDP-based vertical handoff decision algorithm for heterogeneous wireless networks. IEEE Trans. Veh. Technol. 57(2), 1243\u20131254 (2008)","journal-title":"IEEE Trans. Veh. Technol."},{"issue":"4","key":"1939_CR14","doi-asserted-by":"publisher","first-page":"2620","DOI":"10.1109\/TNSM.2020.3031079","volume":"17","author":"Y Sun","year":"2020","unstructured":"Y. Sun, W. Jiang, G. Feng, P. Valente Klaine, L. Zhang, M.A. Imran, Y.-C. Liang, Efficient handover mechanism for radio access network slicing by exploiting distributed learning. IEEE Trans. Netw. Serv. Manag. 17(4), 2620\u20132633 (2020). https:\/\/doi.org\/10.1109\/TNSM.2020.3031079","journal-title":"IEEE Trans. Netw. Serv. Manag."},{"issue":"12","key":"1939_CR15","doi-asserted-by":"publisher","first-page":"15731","DOI":"10.1109\/TVT.2020.3033035","volume":"69","author":"Y Liu","year":"2020","unstructured":"Y. Liu, G. Feng, Y. Sun, S. Qin, Y.-C. Liang, Device association for RAN slicing based on hybrid federated deep reinforcement learning. IEEE Trans. Veh. Technol.\u00a069(12), 15731\u201315745 (2020). https:\/\/doi.org\/10.1109\/TVT.2020.3033035","journal-title":"IEEE Trans. Veh. Technol."},{"key":"1939_CR16","doi-asserted-by":"publisher","DOI":"10.1109\/TMC.2020.3000657","author":"Y Sun","year":"2020","unstructured":"Y. Sun, S. Qin, G. Feng, L. Zhang, M.A. Imran, Service provisioning framework for RAN slicing: user admissibility, slice association and bandwidth allocation. IEEE Trans. Mob. Comput. (2020). https:\/\/doi.org\/10.1109\/TMC.2020.3000657","journal-title":"IEEE Trans. Mob. Comput."},{"issue":"1","key":"1939_CR17","doi-asserted-by":"publisher","first-page":"e3617","DOI":"10.1002\/ett.3617","volume":"31","author":"G Zhao","year":"2020","unstructured":"G. Zhao, S. Qin, G. Feng, Y. Sun, Network slice selection in softwarization-based mobile networks. Trans. Emerg. Telecommun. Technol. 31(1), e3617 (2020). https:\/\/doi.org\/10.1002\/ett.3617","journal-title":"Trans. Emerg. Telecommun. Technol."},{"key":"1939_CR18","unstructured":"3GPP TS 36.331, E-UTRA Radio Resource Control (RRC); Protocol specification (Release 9) (2018)"}],"container-title":["EURASIP Journal on Wireless Communications and Networking"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s13638-021-01939-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1186\/s13638-021-01939-x\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s13638-021-01939-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,3,19]],"date-time":"2021-03-19T06:27:50Z","timestamp":1616135270000},"score":1,"resource":{"primary":{"URL":"https:\/\/jwcn-eurasipjournals.springeropen.com\/articles\/10.1186\/s13638-021-01939-x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,19]]},"references-count":18,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,12]]}},"alternative-id":["1939"],"URL":"https:\/\/doi.org\/10.1186\/s13638-021-01939-x","relation":{"has-preprint":[{"id-type":"doi","id":"10.21203\/rs.3.rs-137200\/v1","asserted-by":"object"}]},"ISSN":["1687-1499"],"issn-type":[{"value":"1687-1499","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,3,19]]},"assertion":[{"value":"22 December 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"4 March 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 March 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"61"}}